Home . Projects . Research . Publications . Members . Demos
BilVideo-7 is an MPEG-7 compatible, distributed video indexing and retrieval system that supports complex multimodal queries in an integrated way. An MPEG-7 profile is developed to represent the videos by decomposing them into Shots, Keyframes, Still Regions and Moving Regions. The MPEG-7 compatible XML representations of videos according to this profile are obtained by the MPEG-7 compatible video feature extraction and annotation tool of BilVideo-7, and stored in a native XML database. Users can formulate text-based semantic, color, texture, shape, location, motion and spatio-temporal queries on an intuitive, easy-to-use Visual Query Interface, whose Composite Query Interface can be used to specify very complex queries containing any type and number of video segments with their descriptors. The multi-threaded Query Processing Server parses queries into subqueries and executes each subquery in a separate thread. Then, it fuses subquery results in a bottom-up manner to obtain the final query result. The whole system is unique in that it provides very powerful querying capabilities with a wide range of descriptors and multimodal query processing in an MPEG-7 compatible interoperable environment.
Figure 1: Distributed, client-server architecture of BilVideo-7.
Users formulate queries on BilVideo-7 clients (Figure 2 below), which communicate with BilVideo-7 Query Processing server using an XML-based query language over TCP/IP. The Query Processing Server parses queries into subqueries, retrieves the required data from XML database using XQuery, executes subqueries, fuses outputs of subqueries and sends query results back to the clients.
Figure 2: Visual Query Interface on BilVideo-7 clients.
Please see BilVideo-7 website for details.