In a new tweet, or whatever it might be called these days, Musk revealed that Tesla is working on "the final piece of the FSD AI puzzle," which apparently is vehicle control. Instead of direct coded instructions, Tesla will rely more on neural networks for vehicle control. More than that, Musk confirmed that Tesla is already training these neural networks. However, the progress is slow because the EV maker is currently "training compute-constrained."
This is interesting, as most talks until now revolved around data gathering and how many miles the Tesla fleet was covering. Musk implied that Tesla now has more data than it can chew and obviously needs more computing power to accelerate development. At the moment, the whole AI industry is constrained because of a shortage of Nvidia GPUs. Tesla also admitted during the second-quarter earnings call that it can't get enough cards, and that's the main reason why Tesla deployed the Dojo supercomputer using processors designed in-house.
The Dojo supercomputer thrilled many Tesla fans as if it was a magic solution to the FSD woes. During the second-quarter earnings call, Elon poured cold water on these hopes, admitting that he would've preferred to have more Nvidia GPUs instead. Dojo is still useful to complement Tesla's Nvidia supercomputer, being optimized for processing large amounts of video images.
Previously, Musk said that V12 of the Tesla FSD software will be end-to-end AI, "from images in, to steering, brakes & acceleration out." What he meant was that the neural networks would be used throughout, from processing the images caught by the car's cameras to controlling the car's movements. In his latest tweet, Musk revealed that switching to neural networks would allow Tesla to drop over 300 thousand lines of C++ control code. This is a massive simplification, which should improve speed and accuracy by an order of magnitude.
More than that, the FSD V12 will be "the thing," dropping the "beta" from its name and becoming commercial software. This shows Musk's confidence that the next software iteration will prove safe enough to be installed by anyone who pays for the FSD capability. Tesla CEO already tested an alpha build of V12 and considered it "mind-blowing," something he also said about previous versions of the FSD Beta.
Vehicle control is the final piece of the Tesla FSD AI puzzle. That will drop >300k lines of C++ control code by ~2 orders of magnitude.— Elon Musk (@elonmusk) August 1, 2023
It is training as I write this. Our progress is currently training compute constrained, not engineer constrained.