公开(公告)号：US11458630B2

公开(公告)日：2022-10-04

申请号：US16653858

申请日：2019-10-15

Applicant: X Development LLC

Inventor： Yunfei Bai ,  Yuchen Wu

IPC: B25J9/16

Abstract: Mitigating the reality gap through utilization of technique(s) that enable compliant robotic control and/or compliant robotic contact to be simulated effectively by a robotic simulator. The technique(s) can include, for example: (1) utilizing a compliant end effector model in simulated episodes of the robotic simulator; (2) using, during the simulated episodes, a soft constraint for a contact constraint of a simulated contact model of the robotic simulator; and/or (3) using proportional derivative (PD) control in generating joint control forces, for simulated joints of the simulated robot, during the simulated episodes. Implementations additionally or alternatively relate to determining parameter(s), for use in one or more of the techniques that enable effective simulation of compliant robotic control and/or compliant robotic contact.

公开(公告)号：US20220203535A1

公开(公告)日：2022-06-30

申请号：US17337815

申请日：2021-06-03

Applicant: X Development LLC

Inventor： Yunfei Bai ,  Tigran Gasparian ,  Brent Austin ,  Andreas Christiansen ,  Matthew Bennice ,  Paul Bechard

IPC: B25J9/16

Abstract: Active utilization of a robotic simulator in control of one or more real world robots. A simulated environment of the robotic simulator can be configured to reflect a real world environment in which a real robot is currently disposed, or will be disposed. The robotic simulator can then be used to determine a sequence of robotic actions for use by the real world robot(s) in performing at least part of a robotic task. The sequence of robotic actions can be applied, to a simulated robot of the robotic simulator, to generate a sequence of anticipated simulated state data instances. The real robot can be controlled to implement the sequence of robotic actions. The implementation of one or more of the robotic actions can be contingent on a real state data instance having at least a threshold degree of similarity to a corresponding one of the anticipated simulated state data instances.

公开(公告)号：US20220134546A1

公开(公告)日：2022-05-05

申请号：US17515490

申请日：2021-10-31

Applicant: X Development LLC

Inventor： Zhuo Xu ,  Wenhao Yu ,  Alexander Herzog ,  Wenlong Lu ,  Chuyuan Fu ,  Yunfei Bai ,  C. Karen Liu ,  Daniel Ho

IPC: B25J9/16 ,  B25J13/08 ,  B25J19/02

Abstract: Utilization of past dynamics sample(s), that reflect past contact physics information, in training and/or utilizing a neural network model. The neural network model represents a learned value function (e.g., a Q-value function) and that, when trained, can be used in selecting a sequence of robotic actions to implement in robotic manipulation (e.g., pushing) of an object by a robot. In various implementations, a past dynamics sample for an episode of robotic manipulation can include at least two past images from the episode, as well as one or more past force sensor readings that temporally correspond to the past images from the episode.

公开(公告)号：US11213946B1

公开(公告)日：2022-01-04

申请号：US16234289

申请日：2018-12-27

Applicant: X Development LLC

Inventor： Yunfei Bai ,  Elmar Mair ,  Yuchen Wu ,  Ian Wilkes ,  Max Moroz ,  Weidan Wu

IPC: G06F17/00 ,  B25J9/16 ,  G05B13/02 ,  G05B13/04

Abstract: Mitigating the reality gap through optimization of one or more simulated hardware parameters for simulated hardware components of a simulated robot. Implementations generate and store real navigation data instances that are each based on a corresponding episode of locomotion of a real robot. A real navigation data instance can include a sequence of velocity control instances generated to control a real robot during a real episode of locomotion of the real robot, and one or more ground truth values, where each of the ground truth values is a measured value of a corresponding property of the real robot (e.g., pose). The velocity control instances can be applied to a simulated robot, and one or more losses can be generated based on comparing the ground truth value(s) to corresponding simulated value(s) generated from applying the velocity control instances to the simulated robot. The simulated hardware parameters and environmental parameters can be optimized based on the loss(es).

公开(公告)号：US20210107157A1

公开(公告)日：2021-04-15

申请号：US16653858

申请日：2019-10-15

Applicant: X Development LLC

Inventor： Yunfei Bai ,  Yuchen Wu

IPC: B25J9/16

Abstract: Mitigating the reality gap through utilization of technique(s) that enable compliant robotic control and/or compliant robotic contact to be simulated effectively by a robotic simulator. The technique(s) can include, for example: (1) utilizing a compliant end effector model in simulated episodes of the robotic simulator; (2) using, during the simulated episodes, a soft constraint for a contact constraint of a simulated contact model of the robotic simulator; and/or (3) using proportional derivative (PD) control in generating joint control forces, for simulated joints of the simulated robot, during the simulated episodes. Implementations additionally or alternatively relate to determining parameter(s), for use in one or more of the techniques that enable effective simulation of compliant robotic control and/or compliant robotic contact.

公开(公告)号：US10556336B1

公开(公告)日：2020-02-11

申请号：US15419451

申请日：2017-01-30

Applicant: X Development LLC

Inventor： Yunfei Bai

IPC: B25J9/16

Abstract: Methods and systems for modifying the inertial parameters used in a virtual robot model that simulates the interactions of a real-world robot with an environment to better reflect the actual inertial properties of the real-world robot. In one aspect, a method includes obtaining joint physical parameter measurements for the joints of a real-world robot, determining simulated joint physical parameter values for each of the joint physical parameter measurements, and adjusting an estimate of inertial properties of the real-world robot used by the virtual robot dynamic model to reduce a difference between the simulated joint physical parameter values and the corresponding joint physical parameter measurements.