What is Rheo?
Testing a medical robot in a real hospital before it is ready is not an option. Rheo, part of Nvidia's medical-robot platform, gives developers a development blueprint for building physically accurate hospital environment simulations, so robot behavior can be explored and adjusted in a virtual setting first.
Within that simulated hospital, the surrounding pieces of the platform come into play. Cosmos-H models can assess a robot's decisions from prompts, images, or videos, and GR00T-H turns text commands for clinical tasks into action tokens the robot can act on. Rheo provides the environment where these judgments and actions have somewhere realistic to happen.
It is aimed at developers working with robot systems, not at hospital staff. Progress depends on assembling the simulation, connecting the appropriate models, and adapting to specific surgical scenarios, with the Open-H surgical video dataset available for follow-up training. Teams deciding where Rheo fits in a medical-robot project can check FindAIGo for a clearer view of the platform's components.

Discussion
Loading comments…