Embodied AI Real2Sim Engineer

Job Description:

Core Objective: Build the digital pipeline from the real world to simulation space. Reconstruct and calibrate visual and physical properties of robots, objects and scenes, and deliver SimReady interactive assets to reduce the sim-to-real gap, supporting algorithm training, simulation evaluation and policy transfer to real hardware.

 

Responsibilities

1. Own the end-to-end Real2Sim workflow based on Isaac Sim, MuJoCo, Genesis, Blender and other simulation platforms, including 3D reconstruction, appearance reconstruction, dynamic identification, calibration of contact, friction and inertia parameters, to align dynamic and perceptual behaviors between simulation and real robots.

2. Create, validate and iterate SimReady assets following USD / URDF / MJCF standards. Configure joints, collision shapes, mass/inertia, joint limits, semantic labels and affordance properties for robots and interactive objects, to achieve physical parameter calibration of simulation assets, ensuring stable usability in simulation training.

3. Process multi-modal real-world captured data: camera calibration, point cloud & mesh processing, texture and PBR material calibration. Leverage 3DGS / NeRF and related reconstruction methods to digitize real scenes and export assets compatible with simulation engines.

4. Develop automated tools for calibration, data processing and asset quality inspection. Document asset specifications, calibration workflows and evaluation metrics to improve pipeline throughput and sim-real alignment accuracy.

5. Collaborate with perception, robot learning, simulation engine and hardware teams, design quantitative sim-real benchmark experiments, identify simulation bias, and continuously improve calibration protocols and asset standards for closed-loop data iteration.

6. Design excitation trajectories for robot system identification, collect time-series dynamic data from physical robots, calibrate and reproduce non-ideal dynamic behaviors including nonlinear joint friction and transmission backlash.

 

Requirements

Must-have

1. Proficiency in at least one simulation/graphics tool such as Isaac Sim, MuJoCo, Genesis or Blender, with solid understanding of computer graphics and rigid-body dynamics. Familiar with physics simulation engines such as PhysX and Newton.

2. Hands-on experience with Real2Sim pipelines and SimReady asset standards; capable of independently building, configuring and validating robot or object assets including joint setup and physical property tuning.

3. Knowledge of 3D reconstruction, camera imaging, point cloud processing and camera calibration; fundamental understanding of system identification, parameter calibration and contact/friction models for physical simulation. Familiar with PBR rendering and material creation.

4. Ability to decompose requirements, implement technical solutions, run comparative experiments and root-cause sim-real mismatches from visual reconstruction or physical simulation.

5. Capable of designing dynamic system identification experiments, analyzing measured hardware data, and quantifying sim-real errors introduced by nonlinear dynamics.

 

Nice-to-have

1. Proven track record delivering Real2Sim projects, especially for robotic arms, dexterous hands or humanoid robots.

2. Deep familiarity with USD / URDF / MJCF, experience building asset libraries and automated asset validation pipelines.

3. Skilled in Python / C++ for calibration scripts, engine extensions and data processing tools.

4. Experience with 3DGS, NeRF, PBR reconstruction and photogrammetry.

5. Background in system identification, excitation trajectory design, dynamic parameter estimation and contact model tuning.

6. Understanding of Sim2Real, reinforcement learning and embodied AI closed-loop systems.

7. Experience with motion capture, multi-sensor calibration and real robot hardware experiments.

8. Familiar with nonlinear friction models such as LuGre and Stribeck, with experience modeling and tuning joint hysteresis and backlash.

Default Benefits:

• Health insurance

• Vision care

• Dental coverage

• 401(k)

• Paid holidays

• PTO (Paid Time Off)

• Sick leave