Zordi reposted this
Real2sim, sim2real! Zordi is solving one of the hardest manipulation problems in the world: agricultural manipulation — precise, dexterous manipulation in clutter. Millimeter precision & high visuomotor coordination. Why is this exciting? Agriculture is the perfect domain for Robotic Foundation Models (e.g. Physical Intelligence, NVIDIA GR00T) and Reinforcement Learning to thrive: Mistakes are forgiving. Every scene is organically different. A perfect domain for learning-based approaches to thrive. https://lnkd.in/eV5qHSXZ Having built the world-best dexterous manipulation system for this challenge, we’re now taking it to the next level with Robotics Foundation Models and Reinforcement Learning. Key ingredients? Good simulation with high fidelity. Strong expertise in building learning-based robotic frameworks. We’re excited to share some early works with Lightwheel on strawberry plant assets that lets us test harvesting, pruning, etc. Adapted from our 3D Gaussian Splatting scans, Lightwheel's assets are photorealistic and deformable, and 'cuttable'. Our real-world perception models are already able to detect everything in simulation right out of the box, and vice-versa. Built in NVIDIA IsaacSim. More to come! #NVIDIAInception #Zordi #Lightwheel #IsaacSim #Sim2Real #Real2Sim Khosla Ventures YANMAR VENTURES DSC Investment Shinhan Financial Group Co., Ltd.