Fusing multimodal data using recurrent neural networks

    公开(公告)号:GB2604552A

    公开(公告)日:2022-09-07

    申请号:GB202208680

    申请日:2020-11-10

    Applicant: IBM

    Abstract: Embodiments relate to a system, program product, and method for employing deep learning techniques to fused data across modalities. A multi-modal data set is received, including a first data set having a first modality and a second data set having a second modality, with the second modality being different from the first modality. The first and second data sets are processed, including encoding the first data set into one or more first vectors, and encoding the second data set into one or more second vectors. The processed multi-modal data set is analyzed, and the encoded features from the first and second modalities are iteratively and asynchronously fused. The fused modalities include combined vectors from the first and second data sets representing correlated temporal behavior. The fused vectors are then returned as output data.

    Natural language interface to databases

    公开(公告)号:GB2557535A

    公开(公告)日:2018-06-20

    申请号:GB201805522

    申请日:2016-09-15

    Applicant: IBM

    Abstract: An embodiment of the invention provides a method wherein a natural language query is received from a user with an interface. An ontological representation of data in a database is received with an input port, including names of concepts and names of concept properties. Template rules are received with the input port, the templates rules being language dependent and ontology independent, the template rules including widely used constructs of a language. Rules are automatically generated with a rule generation engine with the ontological representation of the data in the database and the template rules to identify entities and relations in the natural language query. Entities and relations are identified with a processor, the entities and relations being identified in the natural language query with the rules. The structured data language query is generated with a query generation engine from the entities and relations.

Patent Agency Ranking