Based on a report by Phoronix, Intel quietly confirmed the existence of a brand new ASIC, the Versatile Processing Unit (VPU), through a brand new Linux driver posted yesterday. This new unit is designed to speed up AI interference for deep studying purposes and can arrive in 14th Gen Meteor Lake processors.
For the uninitiated, AI interference refers to utilizing skilled AI networks to make predictions and is a key a part of all trendy AI workflows. With the tech business so closely targeted on AI algorithms, it solely is sensible for Intel to place these “AI cores” into its chips to fulfill shopper and developer demand in workflows. You possibly can consider this new unit as an identical different to Nvidia’s Tensor cores.
This silent announcement comes six years after Intel acquired AI processing unit skilled Movidius. Movidius’ creation on the time was revolutionary; its VPUs may pack spectacular efficiency per watt, with a heterogeneous bundle consisting of a number of extra processors designed for particular duties. With this specialised structure, Movidius’ creation may pull off 4 TOPS in a 1.5W energy envelope.
In layman’s phrases, this chip had a degree of energy effectivity different firms within the business may solely dream of on the time — together with Nvidia.
No doubt, this new chip is constructed at the least partially by the staff behind Movidius. Sadly, we do not understand how highly effective this new Versatile Processing Unit will likely be in Intel’s Meteor Lake processors. Nonetheless, after 5 years of analysis and growth, we count on Intel and Movidius’ new ASIC to carry out very effectively.
Because of the motive force patch notes, all that we all know presently is among the chip’s internals. Intel’s VPU will embody a reminiscence administration unit for translating VPU knowledge to host DMA addresses and isolating person workloads, a RISC-based microcontroller, a Neural Compute Subsystem, and a Community on Chip.
Meteor Lake continues to be two CPU generations away, so it will likely be a while earlier than Intel releases this product to market. However apparently, this chip will likely be accessible explicitly for shopper CPUs. Because of this, we do not know if server chips will get this VPU (or maybe a beefed-up variant), however this information at the least ensures we’ll see this AI-focused unit on the patron facet of the market.