-
公开(公告)号:US20250014322A1
公开(公告)日:2025-01-09
申请号:US18570721
申请日:2021-06-17
Applicant: ABB Schweiz AG
Inventor: Qilin Zhang , Yinwei Zhang , Biao Zhang , Jorge Vidal-Ribas
IPC: G06V10/82
Abstract: A robotic system capable of being trained with a plurality of images that are synthetically augmented from an initial image data set includes a training system toward that end. An image augmentation system includes in one form a neural network trained to generate synthetic images using a generative adversarial network which includes the ability to synthesize images having various poses with adjustments to image parameters such as light and color among potential others. In another form the image augmentation system includes a set of images projected or transformed from its original pose to a number of different poses using an affine transform, and the ability to progress across an entire dimensional space of anticipated robot movements which produce various potential poses.
-
公开(公告)号:US20220410397A1
公开(公告)日:2022-12-29
申请号:US17772370
申请日:2019-10-29
Applicant: Biao Zhang , ABB Schweiz AG
Inventor: Biao Zhang , Saumya Sharma , Yixin Liu , Jianjun Wang , William J. Eakins , Andrew M. Salm , Yun Hsuan Su , Jorge Vidal-Ribas , Jordi Artigas , Ramon Casanelles
IPC: B25J9/16
Abstract: A system and method for use of artificial and nature racking features to calibrate sensors and tune a robotic control system of a sensor fusion guided robotic assembly. The artificial tracking features can have a configuration, or be at a location, that may be less susceptible to noise and error. Thus, the sensors can at least initially be calibrated, and the control system initially tuned, using the first tracking features until the sensors and control system satisfy operation performance criteria. Second tracking features, which may correspond to features on a workpiece that will be utilized in an assembly operation performed by the robot. By pre-calibrating the sensors, and pre-tuning the control system prior to calibration using the second tracking features, sensor calibration and system tuning based on the second tracking features can be attained faster and with less complexity.
-
公开(公告)号:US11518027B2
公开(公告)日:2022-12-06
申请号:US16864804
申请日:2020-05-01
Applicant: ABB Schweiz AG
Inventor: Biao Zhang , Saumya Sharma , Yixin Liu , Jianjun Wang , Will Eakins , Andrew M. Salm , Yun Hsuan Su , Jorge Vidal-Ribas , Jordi Artigas , Ramon Casanelles
Abstract: A robotic system is provided for assembling parts together. In the assembly process, both parts are moving separately with one part moving on an assembly base and another part moving on a moveable arm of a robot base. Motion data is measured by an inertial measurement unit (IMU) sensor. Movement of the robot base or moveable arm is then compensated based on the measured motion to align the first and second parts with each other and assemble the parts together.
-
公开(公告)号:US20210331322A1
公开(公告)日:2021-10-28
申请号:US16856508
申请日:2020-04-23
Applicant: ABB Schweiz AG
Inventor: Biao Zhang , Jianjun Wang , Yixin Liu , Saumya Sharma , Jorge Vidal-Ribas , Jordi Artigas , Ramon Casanelles
Abstract: A system and method for predicting the location at which a feature that is being tracked during a robotic assembly operation will be located within one or more images captured by a vision device. A vision device can be mounted to a robot such that the location of the vision device as the robot moves can be known or determined. In the event of an interruption of the tracking of the feature by the vision device as the corresponding workpiece is moving, the location of the feature relative to a vision device can be predicted, such as, via use of current or past historical movement information for the feature and/or the associated workpiece. Using the predicted location of the feature and the known location of the vision device, the location at which the feature will be located in an image(s) captured by the vision device can be predicted.
-
公开(公告)号:US10828778B2
公开(公告)日:2020-11-10
申请号:US15827334
申请日:2017-11-30
Applicant: ABB Schweiz AG
Inventor: Biao Zhang , Xiongzi Li , George Q. Zhang
IPC: B25J9/16
Abstract: A method for operating a robot includes: creating a production robot program for execution on a robotic controller, wherein the robot program defines a robot path; performing an offline simulation of robot motion along the robot path using the production robot program; analyzing loads between a robot end effector and an object along the robot path, based on the offline simulation, to identify a maximum load experienced during the simulation; tuning production robot program parameters to reduce the maximum load if the maximum load is not within a predefined limit; generating a test robot program to test the end effector and the object with the maximum load within the predefined limit; testing the end effector with the object online using the test robot program; repeating the tuning and testing until no objects are dropped during the testing; and operating the robot during production using tuned robot program parameters.
-
公开(公告)号:US20190323191A1
公开(公告)日:2019-10-24
申请号:US16434676
申请日:2019-06-07
Applicant: ABB Schweiz AG
Inventor: Gregory A. Cole , William J. Eakins , Daniel T. Lasko , Harshang Shah , Thomas A. Fuhlbrigge , Luiz V. Cheim , Poorvi Patel , Biao Zhang , Gregory F. Rossano , Saumya Sharma , Sanguen Choi
Abstract: A deployment system for an inspection vehicle operable in a housing having a liquid medium is disclosed in the present application. The deployment system includes a mount connectable to the housing through an aperture formed in a wall thereof. An extendable arm is connected to the mount and positioned within the housing. A tether is slidably coupled to the extendable arm and adapted to connect with the inspection vehicle. A control mechanism is operable to control deployment of the tether and the position of the extendable arm.
-
公开(公告)号:US20180158232A1
公开(公告)日:2018-06-07
申请号:US15835178
申请日:2017-12-07
Applicant: ABB Schweiz AG
Inventor: Gregory Cole , William Eakins , Daniel Lasko , Harshang Shah , Thomas Fuhlbrigge , Carlos Morato , Biao Zhang , Luiz Cheim , Poorvi Patel , Harald Staab , Saumya Sharma
CPC classification number: G06T15/205 , B63B2702/12 , B63G8/001 , B63G2008/005 , G06F17/5009 , G06T7/55 , G06T7/593 , G06T7/73 , G06T7/97 , G06T17/20 , G06T2200/08 , G06T2207/10012
Abstract: A submersible vehicle which includes a plurality of cameras can be used to collect visual images of an object of interest submerged in a liquid environment, such as in a tank (e.g. transformer tank). In one form the submersible vehicle is remotely operated such as an ROV or an autonomous vehicle. Image information from the submersible along with inertial measurements in some embodiments is used with a vision based modelling system to form a model of an internal object of interest in the tank. The vision based modelling system can include a number of processes to form the model such as but not limited to tracking, sparse and dense reconstruction, model generation, and rectification.
-
8.
公开(公告)号:US20180157251A1
公开(公告)日:2018-06-07
申请号:US15833916
申请日:2017-12-06
Applicant: ABB Schweiz AG
Inventor: Gregory A. Cole , William Eakins , Daniel Lasko , Harshang Shah , Thomas Fuhlbrigge , Carlos Morato , Biao Zhang , Luiz Cheim , Poorvi Patel , Andrew Salm
CPC classification number: G05D1/0022 , B63G8/001 , B63G8/24 , B63G2008/005 , G05D1/0077 , G08C17/02 , G08C2201/51 , G08C2201/60 , H04B1/69 , H04B2201/696 , H04B2201/70715 , H04W72/02
Abstract: A submersible inspection device used for inspection of, for example, liquid cooled electrical transformers can include a number of separate cameras for imaging the internal structure of the transformer. The submersible can be configured to communicate to a base station using a number of wireless transmitters and receivers. Signals transmitted to the submersible include command signals useful to effect an action on the submersible but also a heartbeat signal to indicate health of the transmitted signal. A redundant channel selection logic is provided to switch from a channel which no longer receives a heartbeat to another channel that includes a current heartbeat. Multiple signals can be received and evaluated in software, and another signal received via a firmware radio.
-
公开(公告)号:US09914221B2
公开(公告)日:2018-03-13
申请号:US15617475
申请日:2017-06-08
Applicant: ABB Schweiz AG
Inventor: Biao Zhang , Jianjun Wang , George Q. Zhang , Sangeun Choi , Remus Boca , Thomas A. Fuhlbrigge , Tomas Groth
CPC classification number: B25J9/1689 , G05B2219/40195 , G05B2219/40204 , Y10S901/09 , Y10S901/46
Abstract: A machine has at least one actuated mechanism is remotely located from a control station. A two way real-time communication link connects the machine location with the control station. A controller at the machine location has program code that is configured to determine from data from one or more sensors at the machine location if an actual fault has occurred in the machine when the machine is performing its predetermined function and to determine for an actual fault one or more types for the fault and transmit the one or more fault types to the control station for analysis. The code in the controller is configured to be a preprogrammed trap routine specific to the machine function that is automatically executed when an error in machine operation is detected at the machine location. The controller also has a default trap routine that is executed when the specific routine does not exist.
-
公开(公告)号:US20240278434A1
公开(公告)日:2024-08-22
申请号:US18570156
申请日:2021-06-17
Applicant: ABB Schweiz AG
Inventor: Yinwei Zhang , Qilin Zhang , Biao Zhang , Jorge Vidal-Ribas
CPC classification number: B25J9/1697 , B25J9/1664 , B25J11/0075
Abstract: A robotic system for use in installing final trim and assembly part includes an auto-labeling system that combines images of a primary component, such as a vehicle, with those of computer based model, where feature based object tracking methods are used to compare the two. In some forms a camera can be mounted to a moveable robot, while in other the camera can be fixed in position relative to the robot. An artificial marker can be used in some forms. Robot movement tracking can also be used. A runtime operation can utilize a deep learning network to augment feature-based object tracking to aid in initializing a pose of the vehicle as well as an aid in restoring tracking if lost.
-
-
-
-
-
-
-
-
-