Abstract:
Systems and methods for describing image content establish image description records which include an object set (24), an object hierarchy (26) and entity relation graphs (28). For image content, image objects can include global objects (O0 8) and local objects (O1 2 and O2 6). The image objects are further defined by a number of features of different classes (36, 38 and 40), which in turn are further defined by a number of feature descriptors. The relationships between and among the objects in the object set are defined by the object hierarchy (26) and entity relation graphs (28). The image description records provide a standard vehicle for describing the content and context of image information for subsequent access and processing by computer applications such as search engines, filters, and archive systems.
Abstract:
Systems and methods for generating standard description records from multimedia information are provided. The invention utilizes fundamental entity-relation models for the Generic AV DS that classify the entities, the entity attributes, and the relationships in relevant types describing visual data. It involves classification of entity attributes into syntactic and semantic attributes. Syntactic attributes can be categorized into different levels: type/technique, global distribution, local structure, and global composition. Semantic attributes can be categorized into different levels: generic object, generic scene, specific object, specific scene, abstract object, and abstract scene. The invention further utilizes classification of entity relationships into syntactic and semantic categories. Syntactic relationships can be categorized into spatial, temporal, and visual categories. Semantic relationships can be categorized into lexical and predicative categories.
Abstract:
A multimedia archive description scheme is provided for characterizing a multimedia archive having records and associated record descriptions. The multimedia archive description scheme provides a data structure which relates records by similarity measures. The principle data structure in the multimedia archive description scheme is a cluster (100). A cluster includes one or more attributes of the records in the archive and can include one or more cluster relationships (110). Cluster attributes (105) can include feature space attributes, semantic attributes, media attributes and meta attributes of the records in the archive. The cluster relationships (110) can relate records to clusters or clusters to clusters. Cluster relationships can include feature space (syntactic) relationships, sematic relationships, media relationships and meta relationships. The multimedia archive description scheme provides an efficient form for describing a collection of records.
Abstract:
PROBLEM TO BE SOLVED: To provide a method and an apparatus for constructing and implementing a universal extension module for processing objects in a database. SOLUTION: A multi-tier database architecture comprises an object-relational database engine as a top tier, one or more domain-specific extension modules as a bottom tier, and one or more universal extension modules as a middle tier. The individual extension modules of the bottom tier operationally connect with the one or more universal extension modules which, themselves operationally connect with the database engine. The domain-specific extension modules preferably provide such functions as searching, indexing, and retrieval services of images, video, audio, time series, web pages, text, XML, spatial data, etc.
Abstract:
A computer implemented method, apparatus, and computer program product code for temporal, event-based video fingerprinting. In one embodiment, events in video content are detected. The video content comprises a plurality of video frames. An event represents discrete points of interest in the video content. A set of temporal, event-based segments are generated using the events. Each temporal, event-based segment is a segment of the video content covering a set of events. A time series signal is derived from each temporal, event-based segment using temporal tracking of content-based features of a set of frames associated with the each temporal, event-based segment. A temporal segment based fingerprint is extracted based on the time series signal for the each temporal, event-based segment to form a set of temporal segment based fingerprints associated with the video content.
Abstract:
PROBLEM TO BE SOLVED: To make it easy for a general computing device to display web contents by changing elements in an HTML file by using information included in a retrieved content modification file. SOLUTION: When the general computing device requests an HTML file (B100), the HTML file is analyzed and a link to a content-modified file including information regarding the modification of elements in the HTML file is discriminated so that the file can be displayed by the general computing device (B200). Then the link is used to retrieve the discriminated content-modified file (B300). The information in the retrieved content-modified file is used to change selected elements of the HTML file so that the file is displayed by the reqeust-side general computing device (B600).
Abstract:
A method and apparatus is provided for automatically classifying a multimedia artifact (204) based on scoring, and selecting the appropriate set of ontologies from among all possible sets of ontologies (206), preferably using a recursive routing selection technique (202). The semantic tagging of the multimedia artifact (204) is enhanced by applying only classifiers (208) from the selected ontology (206), for use in classifying the multimedia artifact (204), wherein the classifiers are selected based on the context of the multimedia artifact (204). One embodiment of the invention, directed to a method for classifying a multimedia artifact (204), uses a specified criteria to select one or more ontologies (206), wherein the specified criteria indicates the comparative similarity between specified characteristics of the multimedia artifact (204) and each ontology (206). The method further comprises scoring and selecting one or more classifiers (208) from a plurality of classifiers (208) that respectively correspond to semantic element of the selected ontologies (206), and evaluating the multimedia artifact (204) using the selected classifiers (208) to determine a classification for the multimedia artifact (204).
Abstract:
A multimedia archive description scheme is provided for characterizing a multimedia archive having records and associated record descriptions. The multimedia archive description scheme provides a data structure which relates records by similarity measures. The principle data structure in the multimedia archive description scheme is a cluster (100). A cluster includes one or more attributes of the records in the archive and can include one or more cluster relationships (110). Cluster attributes (105) can include feature space attributes, semantic attributes, media attributes and meta attributes of the records in the archive. The cluster relationships (110) can relate records to clusters or clusters to clusters. Cluster relationships can include feature space (syntactic) relationships, sematic relationships, media relationships and meta relationships. The multimedia archive description scheme provides an efficient form for describing a collection of records.
Abstract:
A manual annotation system of multi-modal characteristics in multimedia files. There is provided an arrangement for selection an observation modality of video with audio, video without audio, audio with video, or audio without video, to be used to annotate multimedia content. While annotating video or audio features is isolation results in less confidence in the identification of features, observing both audio and video simultaneously and annotating that observation results in a higher confidence level.
Abstract:
A method and apparatus is provided for automatically classifying a multimedia artifact (204) based on scoring, and selecting the appropriate set of ontologies from among all possible sets of ontologies (206), preferably using a recursive routing selection technique (202). The semantic tagging of the multimedia artifact (204) is enhanced by applying only classifiers (208) from the selected ontology (206), for use in classifying the multimedia artifact (204), wherein the classifiers are selected based on the context of the multimedia artifact (204). One embodiment of the invention, directed to a method for classifying a multimedia artifact (204), uses a specified criteria to select one or more ontologies (206), wherein the specified criteria indicates the comparative similarity between specified characteristics of the multimedia artifact (204) and each ontology (206). The method further comprises scoring and selecting one or more classifiers (208) from a plurality of classifiers (208) that respectively correspond to semantic element of the selected ontologies (206), and evaluating the multimedia artifact (204) using the selected classifiers (208) to determine a classification for the multimedia artifact (204).