-
公开(公告)号:US11613018B2
公开(公告)日:2023-03-28
申请号:US16297030
申请日:2019-03-08
Applicant: ABB Schweiz AG
Inventor: Gregory A. Cole , Gregory F. Rossano , Jordi Artigas , Harald Staab , Thomas A. Fuhlbrigge , Carlos Martinez , Sangeun Choi , Jianjun Wang , Xiongzi Li
IPC: G06Q20/20 , B25J9/16 , B65G47/90 , G06Q10/087
Abstract: Systems and methods for automatic restocking different items in retail store environments having POS locations for the items are disclosed. The method includes, for a first item of the different items, storing at least one first item parameter uniquely identifying the first item. The method includes determining, based on the at least one first item parameter, a first autonomous movement control scheme for manipulation of the first item by a robotic arm. The method includes executing, by the robotic arm, the first control scheme, the executing including shelving the first item on the shelf. The method includes evaluating, by a processor or a user of the robotic arm, the executing for the first item according to at least one predetermined first performance criteria. The method includes determining and storing, based on the evaluating, an updated first control scheme for subsequent executing by the robotic arm for the first item.
-
公开(公告)号:US11407111B2
公开(公告)日:2022-08-09
申请号:US16019768
申请日:2018-06-27
Applicant: ABB Schweiz AG
Inventor: Biao Zhang , Remus Boca , Carlos W. Morato , Carlos Martinez , Jianjun Wang , Zhou Teng , Jinmiao Huang , Magnus Wahlstrom , Johnny Holmberg
Abstract: A robot is configured to perform a task on an object using a method for generating a 3D model sufficient to determine a collision free path and identify the object in an industrial scene. The method includes determining a predefined collision free path and scanning an industrial scene around the robot. Stored images of the industrial scene are retrieved from a memory and analyzed to construct a new 3D model. After an object is detected in the new 3D model, the robot can further scan the image in the industrial scene while moving along a collision free path until the object is identified at a predefined certainty level. The robot can then perform a robot task on the object.
-
公开(公告)号:US10751877B2
公开(公告)日:2020-08-25
申请号:US15902142
申请日:2018-02-22
Applicant: ABB Schweiz AG
Inventor: Jianjun Wang , Remus Boca , Biao Zhang , Carlos Martinez , Thomas Fuhlbrigge
Abstract: Unique systems, methods, techniques and apparatuses of a robot training system are disclosed. One exemplary embodiment is an industrial robot training system comprising a mixed reality display device structured to superimpose a virtual scene on a real-world view of a real-world scene including a plurality of physical objects including an industrial robot, a video input device, and a computing device. The computing device is structured to detect physical objects using video output from the video input device, generate virtual objects using the detected physical objects, simulate a virtual robot path, determine one movement of the series of robot movements causes a collision, adjust the virtual robot path so as to avoid the collision between the two virtual objects of the plurality of virtual objects, and program the industrial robot to perform a real robot path using the adjusted virtual robot path.
-
公开(公告)号:US10730180B2
公开(公告)日:2020-08-04
申请号:US15825914
申请日:2017-11-29
Applicant: ABB Schweiz AG
Inventor: Gregory F. Rossano , Carlos Martinez , Jianjun Wang , Biao Zhang , Thomas A. Fuhlbrigge
IPC: B25J9/16 , B25J13/02 , B25J13/06 , B25J13/08 , B25J11/00 , G06F3/0484 , G06K9/20 , G06K9/62 , G06K9/78
Abstract: A teleoperated robotic system that utilizes a graphical user interface (GUI) to perform work on a workpiece(s) using a robot. A coordinate system of the GUI is correlated to the tool center point (TCP) of the robot and the TCP or workspace of a teleoperated member, such as a haptic joystick. Operable manipulation of the teleoperated member is correlated to a movement at a particular location in the robot station, such as movement of the TCP of the robot. The GUI can also provide digital representations of the workpiece, which is based on inputted and/or scanned information relating to a reference workpiece and/or the particular workpiece on which the robot is performing work. The GUI can further provide indications of the various stages of assembly of the workpiece, as well as an indication of work already, or to be, performed on the workpiece.
-
公开(公告)号:US20200001458A1
公开(公告)日:2020-01-02
申请号:US16019768
申请日:2018-06-27
Applicant: ABB Schweiz AG
Inventor: Biao Zhang , Remus Boca , Carlos W. Morato , Carlos Martinez , Jianjun Wang , Zhou Teng , Jinmiao Huang , Magnus Wahlstrom , Johnny Holmberg
Abstract: A robot is configured to perform a task on an object using a method for generating a 3D model sufficient to determine a collision free path and identify the object in an industrial scene. The method includes determining a predefined collision free path and scanning an industrial scene around the robot. Stored images of the industrial scene are retrieved from a memory and analyzed to construct a new 3D model. After an object is detected in the new 3D model, the robot can further scan the image in the industrial scene while moving along a collision free path until the object is identified at a predefined certainty level. The robot can then perform a robot task on the object.
-
公开(公告)号:US20180154518A1
公开(公告)日:2018-06-07
申请号:US15825914
申请日:2017-11-29
Applicant: ABB Schweiz AG
Inventor: Gregory F. Rossano , Carlos Martinez , Jianjun Wang , Biao Zhang , Thomas A. Fuhlbrigge
IPC: B25J9/16 , G06F3/0484 , B25J11/00 , B25J13/02 , B25J13/06 , B25J13/08 , G06K9/20 , G06K9/62 , G06K9/78
CPC classification number: B25J9/161 , B25J9/1671 , B25J9/1689 , B25J9/1692 , B25J9/1697 , B25J11/0055 , B25J13/025 , B25J13/065 , B25J13/085 , G05B2219/39014 , G05B2219/40219 , G06F3/04842 , G06K9/209 , G06K9/6202 , G06K9/78 , Y10S901/02 , Y10S901/09 , Y10S901/41 , Y10S901/47
Abstract: A teleoperated robotic system that utilizes a graphical user interface (GUI) to perform work on a workpiece(s) using a robot. A coordinate system of the GUI can be correlated to the tool center point (TCP) of the robot and the TCP or workspace of a teleoperated member, such as a haptic joystick. Operable manipulation of the teleoperated member can be correlated to a movement at a particular location in the robot station, such as movement of the TCP of the robot. The GUI can also provide digital representations of the workpiece, which can be based on inputted and/or scanned information relating to a reference workpiece and/or the particular workpiece on which the robot is performing work. The GUI can further provide indications of the various stages of assembly of the workpiece, as well as an indication of work already, or to be, performed on the workpiece.
-
公开(公告)号:US11027921B2
公开(公告)日:2021-06-08
申请号:US16380351
申请日:2019-04-10
Applicant: ABB Schweiz AG
Inventor: Gregory A. Cole , Harald Staab , Thomas A. Fuhlbrigge , Carlos Martinez , Sangeun Choi , Gregory F. Rossano , Jianjun Wang
Abstract: A product manipulation tool for interacting with products and containers at, for example, a retail facility can include a securing mechanism to secure an exposed portion of the container with respect to a horizontal surface such as a shelf. The product manipulation tool can also include a stabilizing device to stabilize the container with respect to the horizontal surface prior to securing the container. The product manipulation tool can also include a support structure for insertion underneath the container to support the load. The stabilizing mechanism may lift or tilt the container prior to insertion of the support structure. In an example, the product manipulation tool may be disposed on a mobile unit configured for locomotion about the retail facility.
-
公开(公告)号:US20200331144A1
公开(公告)日:2020-10-22
申请号:US16385470
申请日:2019-04-16
Applicant: ABB Schweiz AG
Inventor: Jinmiao Huang , Carlos Martinez , Sangeun Choi
IPC: B25J9/16
Abstract: Methods, systems, and software for controlling object picking and placement by a robot system are disclosed. The method includes assigning machine learning training data of a machine learning model for an object. The machine learning training data includes a plurality of known grasp location labels assigned to the object positioned in a plurality of different object poses. The method includes providing the object in a work space of the robot system. For the object in the work space in a first pose of the plurality of different object poses, the method includes: mapping a first candidate grasp location on the object; executing robotic movements for the first candidate grasp location on the object; and evaluating a result of the executing for the first candidate grasp location according to at least one predetermined performance criteria.
-
公开(公告)号:US20200306959A1
公开(公告)日:2020-10-01
申请号:US16366700
申请日:2019-03-27
Applicant: ABB Schweiz AG
Inventor: Jinmiao Huang , Carlos Martinez , Sangeun Choi , Thomas A. Fuhlbrigge
Abstract: For training an object picking robot with real and simulated grasp performance data, grasp locations on an object are assigned based on object physical properties. A simulation experiment for robot grasping is performed using a first set of assigned locations. Based on simulation data from the simulation, a simulated object grasp quality of the robot is evaluated for each of the assigned locations. A first set of candidate grasp locations on the object is determined based on data representative of simulated grasp quality from the evaluation. Based on sensor data from an actual experiment for the robot grasping using each of the candidate grasp locations, an actual object grasp quality is evaluated for each of the candidate locations.
-
公开(公告)号:US10166673B2
公开(公告)日:2019-01-01
申请号:US15235719
申请日:2016-08-12
Applicant: ABB Schweiz AG
Inventor: Maciej Orman , Wanli Jiang , Carlos Martinez , Jacek Plesnar
IPC: B25J9/16 , G06F3/01 , B25J13/08 , G06F3/0346 , G06F3/0488
Abstract: A portable apparatus for controlling a robot and a method therefor. The portable apparatus includes: an orientation sensor adapted for measuring orientation of the portable apparatus; an HMI device adapted for detecting two-dimensional manual motion relative to the HMI device; and a processing unit adapted for receiving a first signal representing the measured orientation of the portable apparatus and a second signal representing the detected two-dimensional manual motion relative to the HMI device and controlling a part of the robot to move in a direction in consideration of the measured orientation of the portable apparatus and the detected two-dimensional manual motion relative to the HMI device. By having the portable apparatus and the method therefor as explained herein, the two-dimensional manual movement on touch panel is integrated with orientation of the portable apparatus and an integration of these is mapped by the robot, which makes it possible to define a path in three dimensional space for jogging/teaching robot's movements in three dimension.
-
-
-
-
-
-
-
-
-