This paper presents the architecture of a Configurable Multimedia Middleware (CoMM). For distributed environments, the component based software framework and object-oriented technology are used in CoMM. Which contributs that it may be configured for various multimedia services with the reusable components conveniently. Also, the active QoS adaption mechanism, which protects the server from overload with the management of the resource vector, is introduced in detail.