Tap to unmute
Tesla Bot Update | Sort & Stretch
Вставка
- Опубліковано 23 вер 2023
- Optimus can now sort objects autonomously 🤖 . Its neural network is trained fully end-to-end: video in, controls out.
Join us to help develop Optimus (& improve its yoga routine 🧘) → tesla.com/AI 
Авто та транспорт
![Evolution of Boston Dynamic’s Robots [1992-2023]](http://i.ytimg.com/vi/Rdm2ggtFvmQ/mqdefault.jpg)
![Evolution of Boston Dynamic’s Robots [1992-2023]](/img/tr.png)
It didn't just move its hand and arm to finish the job, rather it coordinates the joints of the whole body to do so, which is really human-like
yeah i think the most impressive thing here is its leaning over and constantly balancing while sorting those blocks, very human esque, previous most bots just kinda planted their body in a place and only moved their arms and maybe rotated their torso.
he should just buy Boston robotics instead of embarrassing himself with those grotesque automatons
i don't understand the obsession with making them human-like
shouldn't we be innovative rather than being emotionally attached to our limitations?
That, as well as continuously replanning/re-coordinating to account for obstacle, object, and environment changes along the way of completing a task.
@reyash The argument (not sure I am completely sold on it) is that the world is made to fit a human form factor, so by making it humanoid it will at least physically be able to do all the jobs humans do. It might not be the best shape, but as so often with standards, they are hard to change, and humans have looked like humans a long time.
Of course plenty of robots with different bodies already exist and are highly efficient at ther specialized task. Since they are specialized it is easier to change the environment to fit them. A generalist would need to go everywhere a human can.
If you are on the Optimus team you rule. This is insane progress.
Not so surprised, anybody can achieve the same objetcs recognition performance inside the garage with experimental A.I with a Jetson Nano of 150$ of 0.45Tops, a Jetson Xavier NX of 400$ and 21Teraflops or the beast Jetson AGX Orin of 270Tops (the level of processing power of a primitive mammal) of 2000$ from Nvidia. The most expensive is the hardware, motors, battery and sensors. But the A.I boards are already on the market for everyone who like robotics since 2015. Here in UAclips, there are videos of people, fans, and profesionals of electronics making robots who recognize their faces and follow it at animal reaction speeds, moreover with the Jetson Nano and Xavier A.I boards. Dangerous technology if you put this intelligence on a dron, for example. However, the genius already is out of the bottle, and the knowledge is dominated by at least 1 million people around the world.
Thank you
It's amazing that people are actually still fooled.
There was a high school girl who did even better with an Arduino kit. You can look it up.
@AZHURA NSMX1 There's not a single robotics company who makes such humanoid fluid movements as Tesla, no matter what neural network components they use. They havent even done anything close to Tesla bot's fluid movements.
Imagine how much progress they’ll make in 5-10 years this is crazy
That thought literally keeps me up at night. Like the night before Christmas morning.
it wont take 5-10 years for these to be out there doing stuff. 5-10 months max.
Even though for us activities like these looks mundane but it actually is a major thing for AI development. It's crazy how it can balance itself perfectly and have the ability to detect things.
self balancing robots have been a thing for a long time now, it used to be normal algorithms but im pretty sure atlas (boston dynamics) also uses onboard AI to balance itself
its still very impressive how optimus can sort things by itself automatically, when the only instruction told was "sort this", who knows what it can do in 6 months
The way it was sorting those blocks was so natural. The fact that it's only using visual input to do it is absolutely insane.
lol, its a joke
Neural nets are what sets Optimus apart from most competition. Constantly learning and improving. No experience is wasted here. This is amazing.
The corrective action was crazy. So impressed. It moves so fluidly and naturally
But since the days of Azimo, all robots still stand and walk like an old man who just poooped his pants.
@danRgive them 2 years
it placed a block on top of another , its absolute junk and 10 years behind, more musk bs
@Javi
In 2 years they be like very old men who just poopedtheir pants. I mean Asimo is some 20 years ago, how hard _is_ this?
The electrical impulse is 2500.000 times faster than biological animal nervous sensitive impulse and 5 million times faster than the motor impulse (120m/s and 60m/s vs 300 million m/s) so the recognition process and the speed of reaction with artificial neural networks works and occurs indeed better and faster than in their biological counterpart.
Looking good. As an older person I can see a huge market for robot assist in the home existing.
"Mr. Smith I think you need a neck massage."
"Naw, I'm good."
"This will only take a minute..."
@danRlmaoooooo
@danR hahahahhahhahah
It will be a long time beofre these things are affordable.
@danR🗿
This is actually really cool with the self calibration. I’ve noticed in the past how many robots and things have issues with positioning and how precise their movements need to be.
Incredible 😊 I love the future, from the new soda cans to the progress of these machines. Can't wait to see the next version of the hoverboard
At first I thought that they could surely make something more streamlined and human looking than this and then saw the movements and am surprised how humanlike it moves. No doubt the motors and everything will be miniaturised once the motor skills are perfected. We're certainly getting closer to having personal robot assistants.
Lol you wish
Incredible stuff, the arm and hand movements are incredibly life like! Also Tesla is doing really well with legs movements 👏🏾, my jaw nearly reached the floor when I spotted this a couple of days ago. More info please, keep it coming.
Next update he'll have learned to efficiently stop the human from messing with his blocks by slapping the shit of of him
🤣🤣🤣
Will Smith Matrix program.
Just my thoughts
When the Neural network realizes that humans are the problem … the Robot will slap the shit out of government authorities blocking the Starship launch.
I was gonna say he will wrap his big hand around intruders neck and lift him up while he is sorting. But sure that would work too..
In a few years we'll probably see Optimus in public interacting with other people or robots
I think they will be change healthcare for old people. They will be helpers for ild folks and servents in restaraunts, i can imagine that being the first 2 primary roles, then probably cleaners and construction next
They'd be underutilized! I think it's better to have them building the hyperloop, driving the robo taxis, and blowing up rockets.
20 years maybe.
Insane improvement, can’t wait to see the future of Tesla’s AI on FSD and Optimus man 🥹
Lol
Looking forward to a robot that's actually useful (unlike the boston dynamics ones)! How they've been working on this for ~40 years and still have no consumer or mass market applications I have no idea, but can't wait to have one of these cooking me 3 amazing meals a day
the Boston Dynamic robots are incredibly useful. their market isn't everyday consumers.
@Azael what are they used for?
@Azaelwait what?! werent they fake? i saw a video about it... but i dont know you tell me, have u seen any of them in real life
@Culture, Science Nope, the fake ones were the Tesla bots. They literally had a dude dressed in a condom dancing like he was a robot. Then they had a few technicians helping some of the robots from failing on live demo day. And the manufactured demo video (helping in an office with a few tables and screens) was shown to be a scam, as in, the video is intended to make you think it's a normal sequence with different angles, but objects around are changing position, it was heavily edited. Who knows how many times the robot failed. Kinda like the self driving "demoes" that were actually hardcoded and they edited out the accidents and interventions along the way
I remember Honda's Asimo robot taking significantly longer to manipulate objects with its hands. The progress here is very impressive
Tesla sped the video up. Look at the guy interacting with the robot. His arms/hands sway back and forth quickly
And Asimo could only lift a square box upwards
Guys, I've been watching technology change for the last five years and it just seems incredible. What an amazing time we live in
What's more impressive than these new abilities is the rate of progress the Optimus Bot team is making. Remember the first announcement of the bot was 2 years ago and the first prototype was first shown publicly less than 1 year ago.
Absolutely agree 100%, these guys are on fire
Wheres that cpu located 🎯🔫
Another CRUCIAL thing is the robot is trained end-to-end, meaning it’s given video as input, and it performs the actions as an output. There is explicit programming done here!
While true, we need to see progress on mass market tasks like cleaning bathrooms or doing laundry in sight unseen novel environments. Even if they fail spectacularly at present, we need to see work on practical tasks instead of literal toys.
@James Salsman I'm sure it'll be doing practical tasks in environments that it is well familiar with soon and for several years before "we" will be purchasing it to do our laundry. It is much more valuable as a shift worker in a plant/warehouse than being a maid.
The one leg stuff is impressive. There are a large number of humans who can't move on one leg that fluidly.
Looks very good. I think right now we should focus on improving the servo/motor technology to increase power and sort out wonky weight disteibution. Looks like motor size is dictating a lot of design decisions limiting overall ability.
Don't forget they should be self charging actuators generating to movement really hoping this gets through
Approaching robotics and AI from the perspective of what inputs humans have is a very interesting decision on the side of Tesla.
Except for sensory feedback via touch (and maybe sound [and maybe smell, if proven useful]), this is a pretty good reduction of what it takes to perform human / human-like motoric functions.
The way the robot grabs and places the items reflects this human-likeness very well imo.
Sound and smell could help in situational awareness, i.e. things that happen outside the robot's "field of focus", if that term can apply to a robot.
If this was all done live without preprogramming big kudos to you.
This hand tech on Boston Dynamics' Atlas robot would be insane.
I also wanna see this hand tech on one of the spot robots too, one of the ones with the arm. Theres just something funny about a quadriped robot with an incredibly human looking arm/hand
Wow! This is a huge leap compared to their unveiling! Good job y’all!
😱💀
😂 what they want u to think Toyota had humanoids for decades
This is worse than Honda's robot from over 20 years ago. It easy to be impressed if you've never seen over robots before
@AL exactly it I remember all the car companies having them as the admins and we used to get the reacting robot Dino’s as kids 😂
Questions for Tesla Devs. What “training” was done or required prior to this? Also what were the task instructions and how are they conveyed to Optimus? (Also if these details could be provided with each update video please).
Noted
It's trained with video, just like Tesla self-driving.
What's more amazing is how little time it took them to get to this point.
It's so adorable, I hope to see them functional very soon.
This is really amazing work, as a Robotics engineer myself, i am amazed by the control system and the torso to arm coordination. Really great work tesla team!
Tell me why are you as an engineer not frightened by developing these kind of technology which are robots? Aren't you a little scared for the future of how it will turn out especially in working forces where people could lose jobs for replacing with robots. Why do you guys develop such things?
To take your jobs
The robotic AI revolution against humanity is getting better every time👍
So every 6 months Optimus is going to improve 300 percent?
Exponentially.
give A.I. opposable thumbs and it's over
2030 is robot takeover apocalypse
@Pixelsplasher Improving 300% every 6 months *is* exponential.
the more we learn about the tesla bot the more i appreciate that this is a necessary technology...
It will be cool to see it use both hands to sort these blocks at the same time
Curious to see when we will get humanoids with more than two arms
The man who made this Robot once said, " mark my words, AI will be more dangerous in the upcoming days "
corrective action was cool, very nice work but would have liked to see it coordinating both hands to do the work 2 blocks at a time
I could see a few years down the road these being used on future unmanned missions to the moon and mars to set up bases and explore harsh terrain. Obviously not as capable as, for example, a rover, but it's limbs and similar height to humans could definitely help!
A few years, lol, in real time or Elon guesstimation time?
Usually robots that stand on two legs have a clumsy way of sorting and handling things I'm actually quite impressed.
They can do anything with CGI.
@Brian & Sylviait isn’t CGI. Real industry experts, including Boston Dynamics, say it is real. If Teslas literal competitors agree that it is real, why do you think you know it’s fake.
@Synthetic Spy Objects don't move through other objects in reality.
@Synthetic Spyyou can literally see it’s a doctored video on the blue blocks at 00:46.
@Brian & Sylvia They don't in the video either.
That was so cool. First time seeing a robot use the fingers in a useful way.
I love the choice in music. It's from the movie Ex-Machina, specifically the part where the robots kill their maker. Nice Work!
i clocked that
So impressive! Just a decade behind Boston Dynamics now!
Already 😲 Mind Blowing 🤯🚀 Congrats to all the different teams 👏 🙌 👌✌️
Such innovation! Much technology! Boston Dynamics must really be losing sleep now, given that you're only 15+ years behind them at this point. Amazing work! Tesla promises AND delivers yet again. Can't wait for the video where the robot makes a summersault. Maybe in 5 years? Again, awesome work!
Boston Dynamics might have proven technology but Eloo Mosk has STAINLESS STEEL EXOSKELETON WallEs. It's the same steel as the nerf-gun-proof Cybatruck, so fuck BD.
Sarcasm detected. That other robot is way better though.
Given that Elon keeps warning us that AI is dangerous... some how I look at this and wonder....
Its good advertising to get people talking about AI
Well I have already seen a video of chat GPT directly controlling a Physical robot.
@Johnny ShollajWell yeah and it's also better for the future if we start developing AI faster, as in 10 years, the impact of AI will be overwhelmebly huge. I love elon as he always directs the world to the right way.
This is not AI. This is a tech demo after they hired some interns from Boston Dynamics and had them replicate something they remembered from their internship there.
@Alexander S.Optimus is not instructed to move, it moves based on video inputs which are passed through ML and then turned into required motions to make the outcome happen. Way different than programming motion in.
Wow! When Tesla put their mind to it, progress rapidly happens.
Elon these things are getting more intense with every update!!! when can we have one???
For the first time, I am seeing a real robot move like an actual human
When neuralink is installed they said that the first wave would be used to gather brain inputs for body movement. They will use our movement data to massively increase the movement of the tesla bot. Really great idea imo.
Oh yeah, neuralink. "AI is dangerous!!!" but let me replace you with a robot, replace your driving skills with self-driving, connect my software to your brain, and download your political beliefs into a database. What could go wrong?
@olemew why do you need the government?
@Rhumple I'm saying Elon spends his time warning about AI and all his companies are leading to exactly that. Particularly Neuralink and Tesla
This is frightening, not going to lie... but also impressive and inevitable.
Wasn't it just a year ago this thing was barely walking? Insane rate of progress
A year ago it couldn´t even walk
This needs to stop. You have no idea what you all are creating and promoting. We are done. We are all done for. Good luck humans.
@Pepper GuyThis is still just an algorithm... a bunch of computational math that amounts to a smart walking toaster. There are ways to create "AI" that doesnt cross the threshold into sentience.
@Pepper GuyNah it's not that big of a deal. It's impressive from a kinematic and structural perspective, and I am very impressed with the pace of software development, but the compute systems on board are just not advanced enough to have a terminator moment. If there ever is a terminator moment, it will happen in a data center, not in a humanoid robot designed to do factory labor. Remember in the movies it was the computer that designed the robots, not humans. Trust me when I tell you that there isn't a battery in the world that could power a fully sentient robot for more than a few hours. There is no feasible scenario where this project goes horribly wrong in the way you're thinking.
remember when they first showed it on stage, and they were terrified at showing it off, because it was it's first time being untethered. Now it's doing yoga poses on 1 foot?!?!?
nice, I wonder if Telsa will use pneumatic artificial muscles or just artificial muscles in general. They could be smoother and we could also use the human anatomy to our advantage when designing robots with artificial muscles. But the amount of human-like movement is just so impressive!
As an all in tesla investor and model 3 owner, THANK YOU OPTOMUS TEAM!!!!
Can we just appreciate that beautiful studio setup.
Soon enough we will have videos showing off how Optimus are capable of developing perfect human beings
It would be amazing if it did a full yoga routine!
Amazing dexterity when it turned the block right way up.
optimus's pronouns are they/them
@Rizwan Ali it's a object.
@Rizwan Aliit's a object.
It's almost like it didn't happen.
That’s impressive it can balance on one leg now can’t wait to see further progress in the next update. Not going to lie I wanted to see more but that’s just me being excited all good things come in time.
Names seem to have a charm of its own. You are basically guaranteed to get an Optimus Prime at some point. Can't wait to meet them.
These things are going to be everywhere in 15-20 years. Insane
Maybe even less
Try next year
Planned production of 10,000 over the next year
When Musk first showed off this line of robots the somewhat shaky and jittery movement was seen as a failure by some given what we have been used to from the likes of Boston Dynamics but with the Tesla robot it is all AI controlled so with time and training those rather humble beginnings have rapidly progressed to something really quite remarkable. Because it's all AI controlled emergent properties start to become noticeable like the way the body moves to balance the arm and the ability to rapidly move between tasks with no QR code prompts on items it interacts with.
So they finally got it to stand on its own (sometimes, when it isn’t leaning against a table) and it can work its hands …. Please show the behind the scenes footage that shows how many times they had to repeat everything before they got something worthwhile
Who knows. But this is development. It has made huge leaps in just a few months. Imagine where it will be 5 years from now?
The amount of progress Tesla has done in such a relatively short time is crazy
And yet the Tesls cyber truck and roadster (that both took preorder money in 2019) are yet to have a release date 4 years later.
It's almost like it's complete bs.
@Nathan MZCsemi's feasibility in the long run is also still a big question
this is how much progress would be made by most r&d teams given the same time frame and funding
actually it is probably a little less given the blocker of Elon Musk...
@RM "this is how much progress would be made by most r&d teams given the same time frame and funding". That's the point. Tesla commits to this level of funding & risk when no one else has. The Tesla bot team also has access to the fabrication tech & facilities Tesla has developed over its years of vertical integration plus access to Tesla's materials science knowledge and battery science.
The fine motor movements of the fingers and hands is really cool.
This is just impossibly amazing. Probably the most human looking, moving, and functioning robot system we've seen to date. I can't wait to see where this will go in the near future, because something tells me the future is already here.
Bro it’s sorting blocks 🤡
@Billy Bernercan you?
@Mahesh Nayaki bet you he can 😂
It would be great to have one of these to help you set up big complicated messy board games like Gloomhaven.
We love ! Don't stop robotic evolution.
This is a massive improvement from the last update, impressive how far it has come!
Sangat menajubkan robot dari tesla saya harap bisa segera diproduksi masal dan bisa menjadi asisten rumah membantu pekerjaan rumah
I absolutely love the song they used in this. I'm pretty sure it's a remix of a song that's used in one of my favourite Sci-Fi movies ever 'Ex Machina'.
If you're into robots and AI, you absolutely have to watch that film. It's just so good. Hearing it again in this video, man I'm watching that again tonight.
do you know the name of the track?
i have never seen technology this advance before.its crazy elon musk has come up to this kind of technology
They even have the ex machina music, sensational.
They actually doing it, they really turning a dream into a reality... It goes to show you, any dream can be realized with consistent action.
Optimus industrial application would be mind blowing. Kudos team Tesla.
I want it so it can follow my kids around and clean up after them.
@Gordon Childbut unfortunately kids will become obsolete in robots world
Industry already uses robots from companies with decades of experience and known safety protocols like KUKA and ABB.
@Andreas Hämäläinen а эти роботы будут заменять не промышленные манипуляторы а людей, которые обслуживают эти промышленные манипуляторы, и людей на всех остальных работах
I saw one of these on display at the Tesla store in Waikiki, Hawaii. It just gave me iRobot turning against humans vibes.
... when he uses both hands at the same time while sorting the building blocks and stands on real feet (and not like now, with his plate feet creeping around like a grandpa with slippers), then it gets really interesting. Playing the piano by ear and writing sticky notes for the fridge, he should be able to learn along the way without being explicitly taught.
And when he has understood the cheating at the shell game by observation, then he is ready - then I would like to have one ...
People have no idea how big this is for the block sorting community
This is awesome and terrifying at the same time
For those that might not know, babies and children learn to visually coordinate their movements in space the same way, while also dealing with instant dynamic changes, to build their own “on board neural net”. Very interesting that Tesla is using this approach to create more organic machine learning, while supplementing with cloud computing. Very excited to one day have these machines be part of our everyday lives.
Unfortunately, Optimus did not learn to manipulate objects like a child. That involves edge case learning. Optimus does not have an edge case solving neural architecture. Optimus can be taught at the supercomputer level. Now, Optimus appears to be able to put together simple sequential solutions to specific tasks. That is truely remarkable two years into this project. True edge case solving has yet to arrive. When it does, FSD will be fully solved at the robot/vehicle level.
This is right but incomplete. Humans also have proprioception, which means that even if you are completely unable to see your limbs you can still roughly figure out their position in space. That's important, because whether you're a robot or a human, it is unrealistic to keep visual track of your entire body at all times, even though obviously it helps for some task (remember hand-eye coordination in PE?).
That will be awesome when one day someone makes a machine that can do that. For now we have to console ourselves with these CGI movies.
@Darwin Boor It may be two years into this project but Tesla was working with vision baded neural networks for quite some time now. Ofc they will be pretty fast at figuring that out.
I would like to see 2 hands sorting at the same time. That would be difficult task for a human, at double the speed
If they had made a child size model this process would still be "cute", like aahw look how fast he is growing. But because its adult size i feel intimidated by its learning process,capability and speed. I'm really curious to how robots will try to "upgrade" humans in the future, hmm maybe in the same way as we are training ore pets?🤔
the fine motor control of fingers is impressive
The epitome of expectations vs reality.
This is legitimately impressive. Can't wait to see it doing tasks that require both hands handling an object at the same time!
Yeah. I'm surprised it wasn't using both hands at once to sort/unsort the blocks. I guess it was trained by one-handed sorters. Two handed sorting would show off its calibration as well as hint at the multitasking capabilities.
😏
What could you possibly mean??
Can't wait to see it using more than 2 hands
@Mark Holland I want to see it use a broom to sweep the floor. Or use pruning shears on a bush.
If you placed the green block onto the blue tray would it have rectified it and place it on the correct tray?
One step close to the reign of our robot overlords
This won't end badly at all. Just keep making stronger and smarter non-human stuff, I'm sure we'll all be fine.
Welp we will be on a premiere for the 1st live action terminator movie
Literally being in it which is scary!
I am pretty sure I remember a robot doing something like this 15 years back.
Doing something similar sure, but it's the magic underneath that is the amazing part. It's the how not the what.
Imagine sending group of those to mars using starship to build and preparing the planet . This will be real live sci-fi
This is actually very beautiful. When it went to turn over the one block, because it wasn't situated properly, watch it's pinky and ring fingers bend, so to not touch the block as it flips - it's just incredible. I am so excited for the future, and would love to work on this team...
Green?
Ok child
True, the smooth hand-object manipulation is the most lowkey impressive thing about this.
@Lewis Heasman What's wrong with what the OP said? Why were you complaining over nothing? If you dislike robots why did you click on this video?
In my opinion its impressive that the movements is fast
Why does the robot not use both hands to sort each colour with multi-tasking, so he's faster?
If he can respond to a dynamic environment, can he also do it with it's own influence to the dynamic environment?
I wonder how long before we get to verbal commands being carried out. For example on the big legos, halfway through, instruct bot to place the blocks in opposing trays, and place them upside down or something, stack them etc, like how we communicate with alexa, siri etc.
Can’t wait to receive a perfectly symmetrical big mac from this guy
0:49 That movement was so natural 🤯
It would be if it weren't sped up.
@Waldohow do you know that part is sped up?
@Sal3600 Humans don't move that fast buddy, please use your critical thinking skills.
Yea it was unbelievably natural. I am seriously impressed.
@Perceptencetheyre not programmed to move fast or slow, this one uses a neural network which learns to control its motor movement to achieve a particular end and the reason why it moves so slow is because the current architectures, software, and hardware just cant process fast enough when doing something very complex like this
Can't wait for them to teach the robots how to perform underpaid jobs! I can really use a replacement for my shift about now.
With AI and Robotics we are working towards the greatest "I told you so" moment in human history.
Hope I don't die watching updates after updates
That guy messing with the robot's blocks is definitely at the top of the list when the AI takes over..
These things are a testament to how well humans are designed.
Those movements look much more human! There's a lot of fluidity even in the finer movements of the fingers and hand.
Would love to see its balance while being pushed around like Atlas!
What’s the bet they are running an advanced AI to make that happen. Google need to step up Boston dynamic’s access to good AI before they get left in the dust
You do realize they speed up and slow down the video right? Looks like a stop motion animation
Gee Wez, that bot is so human like and graceful!!! Soon it will be able to be a professional ballet dancer!!! Wow!!
@THANOSthat's not true at all
@THANOSyeah, maybe a little. Like it's probably 1.25x.
You can see it better when there'a the human that moves the blocks.
Optimus doing yoga? I can’t even stand on one foot without wobbling. 😂