MPEG-7 standard

The MPEG-7 standard is referred to as the "multimedia content description interface", which provides a standardized description of various types of multimedia information. This description will be related to the content itself, allowing quick and efficient querying of data that the user is interested in. It will extend the limited capabilities of existing content-aware dedicated solutions, in particular it also includes more data types. In other words, MPEG-7 specifies a standard set of descriptors for describing various types of multimedia information. The standard was submitted in October 1998.

The goal of MPEG-7 is to support a variety of audio and visual descriptions, including free text, N-dimensional space-time structures, statistical information, objective attributes, subjective attributes, production attributes, and portfolio information. For visual information, descriptions will include colors, visual objects, textures, sketches, shapes, volumes, spatial relationships, motions, and deformations.

The goal of MPEG-7 is to provide a method of describing multimedia materials according to the level of abstraction of information in order to represent the user's demand for information at different levels. Using visual content as an example, the lower abstraction layer will include a description of shape, size, texture, color, motion (orbit), and position. The lower level of abstraction for audio includes pitch, mode, speed of sound, change in speed of sound, and acoustic spatial location. The highest level will give semantic information: "This is a scenario: a duck is hiding behind a tree and a car is passing behind the scenes." The abstraction layer is related to the way in which features are extracted: many low-level features can be extracted in a completely automatic manner. And higher-level features require more interactions. MPEG-7 also allows retrieval of voice data based on visually-described queries, and vice versa.

The goal of MPEG-7 is to support data management flexibility, globalization of data resources, and interoperability.

The scope of MPEG-7 standardization includes: a series of descriptors (descriptors are the representation of features, a descriptor is the grammar and semantics of defining features), and a series of description structures (details of the structure and semantics between members). A description of the description of the structure of the language, Description Definition Language (DDL); one or more encoding description method.

In our daily lives, the ever-growing amount of available audio and video data requires effective multimedia systems to access and interact. This type of demand is related to a number of important social and economic issues, and is urgently needed in many professional and consumer applications, especially when the network is highly developed. The ultimate goal of MPEG-7 is to turn online multimedia content into Like the current text content, it is searchable. This allows the public access to a large amount of multimedia content, MPEG-7 standard can support a very wide range of applications, as follows:

(1) Storage and retrieval of audiovisual database;

(2) Choice of broadcast media (broadcasting, television programs);

(3) personalized news services on the Internet;

(4) smart multimedia, multimedia editing;

(5) Applications in education (such as digital multimedia libraries, etc.);

(6) remote shopping;

(7) Social and cultural services (historical museums, art corridors, etc.);

(8) investigation services (identification, debate, etc. of human characteristics);

(9) Remote sensing;

(10) Surveillance (traffic control, ground transportation, etc.);

(11) Biomedical applications;

(12) Construction, Real Estate and Interior Design;

(13) Multimedia directory services (eg, yellow pages, travel information, geographic information systems, etc.);

(14) Home entertainment (personal multimedia collection management system, etc.).

In principle, any type of AV (Audio-Video) material can be retrieved through any type of query material, for example, AV material can be queried by video, music, language, etc., and the query data and MPEG-7 can be matched by a search engine. Audio and video description. Here are some examples of queries:

Music: Play several notes on the keyboard to get a list of music compositions that contain (or approximate) the requested tune, or an image that matches the notes in some way, for example, from an emotional perspective.

Graphics: Draw a few lines on the screen to get a set of images like graphics, logos, ideograms (symbols), etc.

Motion: For a given set of objects, describing the movements and relationships between the objects, you get an animation list that implements the described spatio-temporal relationships.

Film-drama script (drama description): For a given content, describe the action and get a list of movie-drama scripts (drama descriptions) where similar actions take place.