Tesla unveils its new supercomputer (5th most powerful in the world) to train self-driving AI

[Hamartia Antidote]

Using their own custom chips...geez

Tesla unveils its new supercomputer (5th most powerful in the world) to train self-driving AI

Tesla has unveiled its new supercomputer, which is already the fifth most powerful in the world, and it’s going to...

electrek.co

Tesla has unveiled its new supercomputer, which is already the fifth most powerful in the world, and it’s going to be the predecessor of Tesla’s upcoming new Dojo supercomputer.

It is being used to train the neural nets powering Tesla’s Autopilot and upcoming self-driving AI.



Over the last few years, Tesla has had a clear focus on computing power both inside and outside its vehicles.

Inside, it needs computers powerful enough to run its self-driving software, and outside, it needs supercomputers to train its self-driving software powered by neural nets that are fed an insane amount of data coming from the fleet.

CEO Elon Musk has been teasing Tesla’s Dojo project, which apparently consists of a supercomputer capable of an exaFLOP, one quintillion (1018) floating-point operations per second, or 1,000 petaFLOPS – making it one of the most powerful computers in the world.

Tesla has been working on Dojo for the last few years, and Musk has been hinting that it should be ready by the end of this year.

But the company has developed other supercomputers on its way to Dojo, and now Andrej Karpathy, Tesla’s head of AI, has unveiled the latest one during a presentation at the 2021 Conference on Computer Vision and Pattern Recognition.

During the presentation, Karpathy gave a shoutout to Tesla’s supercomputing team and showcased their latest work, Tesla’s third supercomputer cluster:

Tesla is claiming some fairly insane specs on this new cluster, which should make it roughly the fifth most-powerful computer in the world:

• 720 nodes of 8x A100 80GB. (5760 GPUs total)
• 1.8 EFLOPS (720 nodes * 312 TFLOPS-FP16-A100 * 8 gpu/nodes)
• 10 PB of “hot tier” NVME storage @ 1.6 TBps
• 640 Tbps of total switching capacity

Karpathy commented on the effort:

“We have a neural net architecture network and we have a data set, a 1.5 petabytes data set that requires a huge amount of computing. So I wanted to give a plug to this insane supercomputer that we are building and using now. For us, computer vision is the bread and butter of what we do and what enables Autopilot. And for that to work really well, we need to master the data from the fleet, and train massive neural nets and experiment a lot. So we invested a lot into the compute. In this case, we have a cluster that we built with 720 nodes of 8x A100 of the 80GB version. So this is a massive supercomputer. I actually think that in terms of flops, it’s roughly the number 5 supercomputer in the world.”

The Tesla engineer didn’t want to elaborate on project Dojo, but he did say that it will be an even better supercomputer optimized for neural net training than Tesla’s current cluster.

Musk also previously said that Tesla plans to eventually make its supercomputers available to other companies in order for them to train their neural nets on it.

 

[hyperman]

That new Plaid is ridiculous. wonder how the roadster will be.

 

[Saddam Hussein]

Tesla is for soyboys, I got an offer for one and refuse it. A true camel walks to his destinations

 

[Menthol]

I don't know...

Tesla self-driving technology is not based on 3D LIDAR radar, but instead, just image recognition.

It's flawed and in many real-world tests, Tesla unable to recognize a big object in front of the car.

How much data is collected, if there's a new kind of object never seen before, it will fail again.

If they add LIDAR radar, a change for not hitting the object is higher despite unrecognized, but the 3D image of the object will indicate there's an object and the car should hit the brake.

It's kinda useless I think and very costly by putting the world's 5th fastest supercomputer to train better image recognition AI.

It's more like a publicity gimmick by spending investor money with little result.


If Tesla decided to use LIDAR radar and then use the world's 5th fastest supercomputer to improve to make better driving decisions under any scenario plus a more efficient way to handle traffic in a city when all cars on the road are automated, it will be much promising.

 

[Hamartia Antidote]

I don't know...

Tesla self-driving technology is not based on 3D LIDAR radar, but instead, just image recognition.

It's flawed and in many real-world tests, Tesla unable to recognize a big object in front of the car.

How much data is collected, if there's a new kind of object never seen before, it will fail again.

If they add LIDAR radar, a change for not hitting the object is higher despite unrecognized, but the 3D image of the object will indicate there's an object and the car should hit the brake.

It's kinda useless I think and very costly by putting the world's 5th fastest supercomputer to train better image recognition AI.

It's more like a publicity gimmick by spending investor money with little result.


If Tesla decided to use LIDAR radar and then use the world's 5th fastest supercomputer to improve to make better driving decisions under any scenario plus a more efficient way to handle traffic in a city when all cars on the road are automated, it will be much promising.

People don't need LIDAR to avoid hitting poles while walking down the street. LIDAR isn't going to help you determine if it is about to rain.

AI will be looking at the whole picture including things far off in the distance.

The objective of using this harder AI approach is to recreate the decision making you use to avoid hitting that pole or looking up at the sky. This will then be leveraged into other fields besides cars...for instance a robot running through a thick forest.

People who are simply focusing on a solution for cars in cities are being shortsighted as to what Tesla is ultimately attempting to create and how it will be marketed in future products.

 

[Hamartia Antidote]

 

[Hamartia Antidote]

Tesla self-driving technology is not based on 3D LIDAR radar, but instead, just image recognition.

It's flawed and in many real-world tests, Tesla unable to recognize a big object in front of the car.

Here it is...finally the BETA release using just pure vision/AI...hundreds of videos will be posted in the next few months

No LIDAR
No RADAR
No pre-mapping of streets...100% dynamic using just vision and crude Garmin type road maps.

Incredible first-in-world achievement by Tesla.