Gemini Robotics 2 Brings Whole Body Intelligence to Robots
We are introducing Gemini Robotics 2, an intelligence layer enabling robots to think, act, and interact intelligently. This update unlocks intelligent whole-body control, advanced dexterity, and multi-robot collaboration. Our new models allow robots to adapt to new bodies in hours and run locally on-device, moving us closer to general-purpose physical AI that can safely work alongside humans.
For decades, we've dreamed of robots that can seamlessly step into our world and lend a hand.
- canyon289
I'm a researcher at Deepmind that contributed to these models. (And the opinions here are my own)
Just want to say, Deepmind is a great place to work and the only (Edit: one the few unique labs!) lab where you can move from large frontier models (Gemini), frontier open models (Gemma), robotics (what you see here), science (weather, biology, more) and basically any other topic related to intelligence. It's really an incredible place to be, with incredible people. Consider joining! And thank you for the enthusiasm here.
- xnx
While Anthropic and Open AI get 80% of the attention here, it's impressive to see how much Google is doing: near frontier model, fast models, open weight models, image generation, video generation, music generation, robotics, etc.
- FartyMcFarter
These robots look slow and not very fluid in their motions, but LLMs like ChatGPT also looked very dumb initially. If progress is as fast as LLMs , this could have massive applications in a few years.
- Geee
I've kind of given up on humanoid robotics, because of how bad the actuators are. There has been no innovation in robotic actuators since Honda's Asimo. There's just no way that someone wants a 80kg wobbling tin can in their home or workplace.
My bet is that the final robotic revolution will use genetically modified human/animal bodies with replaced brains. You'll have to stretch your ethics a bit, but if you grow a bear genetically modified in a way that it has no consciousness or thought, it'll make a much better construction worker than any humanoid robot. You'll just need to wire it up with neuralink and then control it via LLM. Fast animals can be used to deliver packages, and giraffes for warehouses.
- jwpapi
I don’t want to be a hater, but somehow i still keep throwing vacuum roboters away and prefer the manual machine. It somehow always ends up worrying me more than helping. Crashing, charging putting away, putting things away for it to work (peeping). There are a lot of small things that come to these things that have evolved over the last 100 of years.
When i think about humanoids and household. I have so much particular ways of how I want my household to be done. I find it really hard to believe you can make it act that way. I struggled to teach humans how I want it. So I ended up doing everything myself again.
- aabhay
Can anyone that works on this technology provide an honest assessment of where this technology actually stands? How much instrumentation is actually required, what the interaction quality is, how much trouble do humanoids have with in the wild daily tasks like turning doorknobs, recovering from falls, avoiding knocking into things, etc.
- logankeenan
Robotics with AI is the real revolution.
Today, humans convert their labor to capital. Capital holders need labor (humans) to acquire more capital. When the price of inference for these robots becomes less than the price of labor then capital holders don’t need labor.
Obviously, AI impacts non-manual labor too, but a significant portion of the world population does manual labor.
- dr_blueberry
Doing some initial testing of Gemini ER 2 within the Orion 2 visual agent harness. I'll share a few initial results and chat threads here. I'm impressed with how fast Gemini ER2 is.
1. Crop the segment when adding rice to the rice cooker + analyze a frame: https://chat.vlm.run/c/40b5edfb-6d15-47e8-bedd-c77b1ed92496
2. Extract 16 keyframes in a 4x4 grid + detect the water bottle: https://chat.vlm.run/c/a8542517-0021-4013-9663-a9f41f286e4c
3. Extract the frame at 0:03 + segment the lettuce + generate a 3D reconstruction: https://chat.vlm.run/c/494c7c65-4aa1-442f-a78a-bfd1409c784d
(I work at VLM Run).
- henpa
As a 47-year-old man with no kids, I have to admit I'm looking forward to the possibility of having a robot help take care of me in my old age.
- prima-facie
A lot of these household tasks could be automated without the need for humanoid robots. Roombas can clean your floor, automated rubbish disposal can be integrated into houses and flats, grocery delivery and storage could be done via an automated intake, cataloguing, and storage system. Humanoids are just creepy and you can't really trust them.
Could you sleep easily knowing that you have one in your house?
What if you oppose the political views of its creators?