NVIDIA Drops DRIVE Atlan SoC, Introduces 2 PFLOPS DRIVE Thor for 2025 Autos

Among the many spate of bulletins from NVIDIA in the present day as a part of their fall GTC 2022 occasion, the corporate is delivering a shocking shake-up to their DRIVE automotive SoC plans. Efficient instantly, NVIDIA has cancelled Atlan, their deliberate post-Orin SoC for 2025 cars. Instead, NVIDIA is asserting Thor, an much more highly effective SoC set to launch in the identical 2025 timeframe.

NVIDIA’s Atlan SoC was first revealed again at spring GTC 2021, the place NVIDIA introduced it as their next-generation automotive SoC to succeed the (now present) Orin SoC. On the time of its announcement, Atlan was deliberate to be a high-performance SoC providing 1000 TOPS of INT8 inference efficiency, utilizing a next-generation (Lovelace) GPU design and next-generation Grace CPU design. The chip even built-in a BlueField DPU as a networking and safety processor, with the intent of delivering a single SoC that would deal with the entire compute features required by a self-driving automobile.

Atlan-that-was

However no matter Atlan was meant to be, now it’s no extra. As of NVIDIA new DRIVE SoC roadmap, Atlan has been scrapped. Instead is a brand new SoC, Thor, which is slated to be much more highly effective than what NVIDIA had deliberate for Atlan.

Just like the Atlan announcement in 2021, NVIDIA is simply releasing a handful of particulars about Thor this far forward of its launch. The high-level particulars embody that, whereas not naming particular NVIDIA CPU and GPU architectures, the SoC is tapping options that have been first launched with the Grace CPU, Ampere GPU structure, and Lovelace GPU structure. In the meantime, NVIDIA’s weblog submit on the matter does go one additional, stating that the SoC makes use of an Automotive Enhanced (AE) model of Arm’s to date secretive Poseidon CPU core. Of what little we find out about Poseidon, it’s a next-generation high-performance CPU core being developed by Arm that will probably be used of their next-generation Neoverse V-series platform, changing the just-released Neoverse V2.

From a efficiency standpoint, Thor is slated to ship 2 PFLOPS (2000 TFLOPS) of floating level inference efficiency utilizing the newly-standardized FP8 knowledge format. Which, though not apples-to-apples with Atlan’s 1000 TFLOPS INT8 determine, nonetheless represents twice the throughput for 8-bit precision computing. The SoC’s tensor cores may also characteristic NVIDIA’s transformer engines, permitting the SoC to additional speed up the processing of transformer networks.

Notably, packing in all of this efficiency goes to make Thor a really cumbersome chip. Whereas NVIDIA just isn’t asserting the method node, they’re already saying that it’ll use 77 billion transistors, which is all of three billion transistors lower than their new flagship GH100 GPU. NVIDIA’s efficiency claims don’t point out whether or not matrix sparsity is in use, however even whether it is that may put Thor at half the FP8 efficiency as NVIDIA’s flagship GPU. All of which underscores NVIDIA’s excessive efficiency objectives for the deliberate SoC.

And whereas NVIDIA’s mockup for the chip exhibits it on an AGX board in a single chip configuration, in the present day’s announcement additionally makes express point out of NVLink chip-to-chip (NVLink-C2C) chip interconnect expertise. This can be a curious point out, since NVIDIA’s key artwork doesn’t present Thor as being chiplet-based. This will likely imply that NVIDIA is as an alternative going to make use of NVLink-C2C for much more highly effective multi-chip DRIVE AGX boards (ala Pegasus), or it may very properly be that Thor is a chiplet-based design and NVIDIA is being purposely generic with their artwork.

Past that, NVIDIA just isn’t supplied any additional technical particulars on the SoC. So particulars on the reminiscence kind used, the GPU structure, and different useful blocks stays to be seen.

At this level, NVIDIA has additionally not detailed why they cancelled Atlan instead of Thor. Thor is actually a extra highly effective design and would appear to include some newer options not discovered on (or no less than by no means disclosed for) Atlan. Whether or not this implies NVIDIA is by some means pulling in what would have been a post-Atlan chip or if they’ve tossed Atlan as a result of their clients want higher AI inference efficiency for his or her self-driving vehicles stays to be seen.

{Hardware} upgrades apart, what is obvious is that NVIDIA is designing Thor for a similar market phase as Atlan. Which is to say it’s meant to be a high-performance single-chip design for dealing with the entire computational wants of a self-driving automobile, from infotainment techniques and sensor fusion as much as the precise self-driving algorithms themselves. As with Atlan, the aim is to exchange what are presently separate computer systems inside a automobile with a single laptop that does all of it, leveraging the useful security design strategies with in depth isolation (together with MIG) to maintain the separate duties from interfering with one another.

Maybe essentially the most shocking factor of all, nevertheless, is that this alteration in SoCs just isn’t anticipated to influence NVIDIA’s SoC supply date. NVIDIA says that they’ll have Thor in automakers’ arms for his or her 2025 vehicles, the identical timeframe that Atlan was meant to reach in. So whereas the satan is within the particulars, at a excessive degree NVIDIA is aiming to ship Thor close to the identical time as they might have delivered Atlan. It’s price noting, nevertheless, that whereas NVIDIA had beforehand introduced that Atlan can be sampling in 2023, no such announcement has been made about Thor. As such, Thor’s sampling date could find yourself being later than what would have been Atlan’s.