MULTI-HOP TRANSFORMER FOR SPATIO-TEMPORAL REASONING AND LOCALIZATION

    公开(公告)号:WO2022066388A1

    公开(公告)日:2022-03-31

    申请号:PCT/US2021/048832

    申请日:2021-09-02

    Abstract: A method for using a multi-hop reasoning framework to perform multi-step compositional long-term reasoning is presented. The method includes extracting (1001) feature maps and frame-level representations from a video stream by using a convolutional neural network (CNN), performing (1003) object representation learning and detection, linking (1005) objects through time via tracking to generate object tracks and image feature tracks, feeding (1007) the object tracks and the image feature tracks to a multi-hop transformer that hops over frames in the video stream while concurrently attending to one or more of the objects in the video stream until the multi-hop transformer arrives at a correct answer, and employing (1009) video representation learning and recognition from the objects and image context to locate a target object within the video stream.

    SENSOR CONTRIBUTION RANKING
    3.
    发明申请

    公开(公告)号:WO2021071911A1

    公开(公告)日:2021-04-15

    申请号:PCT/US2020/054529

    申请日:2020-10-07

    Abstract: Methods and systems for detecting and correcting anomalies include detecting (202) an anomaly in a cyber-physical system, based on a classification of time series information from sensors that monitor the cyber-physical system as being anomalous. A similarity graph is determined (302) for each of the sensors, based on the time series information. A subset of the sensors that are related to the classification is selected (308), based on a spectral embedding of the similarity graphs. A corrective action is performed (206) responsive to the detected anomaly, prioritized according to the selected subset.

    RECONSTRUCTOR AND CONTRASTOR FOR ANOMALY DETECTION

    公开(公告)号:WO2019005457A1

    公开(公告)日:2019-01-03

    申请号:PCT/US2018/036809

    申请日:2018-06-11

    Abstract: Systems and methods for detecting and correcting defective products include capturing (221) at least one image of a product with at least one image sensor to generate an original image of the product. An encoder (223a) encodes portions of an image extracted from the original image to generate feature space vectors. A decoder (223b) decodes the feature space vectors to reconstruct the portions of the image into reconstructed portions by predicting defect-free structural features in each of the portions according to hidden layers trained to predict defect-free products. Each of the reconstructed portions are merged (224) into a reconstructed image of a defect-free representation of the product. The reconstructed image (225) is communicated to a contrastor (230) to detect anomalies indicating defects in the product.

Patent Agency Ranking