Single-Chip Architecture for Generative AI

Designed to trounce the memory wall and accelerate the proliferation of generative AI implementations. Chip architecture provides up to 3.2 petaflops with an implementation efficiency of more than 50% for generative AI.

PARIS, Jul. 18, 2023 — VSORA, an innovative startup offering silicon intellectual property (IP) solutions and silicon chips, today unveiled Jotunn™, an all-in-one single-chip family to provide a massive jump in performance for generative AI inferencing processing challenges.

“As ChatGPT and other generative AI continue reaching a fevered pitch, the semiconductor industry needs to step up with supporting hardware,” remarks Khaled Maalej, VSORA founder and CEO. “That’s what we intend to do with our single-chip architecture to trounce the memory wall and accelerate generative AI implementations.”

“The VSORA ChatGPT-on-chip architecture can unleash the unbounded potential of Generative AI such as ChatGPT,” states Nicolas von Bülow, managing partner at Clipperton Finance, a VSORA financial adviser. “It will spearhead a paradigm shift in the semiconductor industry.”

Jotunn can accelerate the proliferation of low-cost, low-power generative AI implementations whose monthly visit numbers have increased geometrically to close to two billion. Current leading processors idle almost 97% of the time waiting for processing data when implementing GPT-3 or GPT-4.

ChatGPT, based on GPT-3.5, can be handled by Jotunn4 entirely on-chip, dropping power consumption by more than an order of magnitude versus its competitors. Jotunn4 improves the cost effectiveness of a GPT-4 solution by more than 150 times compared to its closest competitor.

The Jotunn4 solution provides 1.6 petaflops with efficiencies of more than 50% for GPT-3.5 and GPT-4. Typically, efficiencies currently range around 2-4%. Further, Jotunn4 has 192 GB of on-chip memory and consumes less than 100W in a 45 x 45 mm package.

Initially designed as a low-power, low-cost and high-performance chip architecture for L3-L5 autonomous driving vehicles, VSORA extended its unique and patented architecture to accelerate GenAI applications.

Algorithm implementation is quick and easy, utilizing the VSORA high-level language and graph compiler development flow. The future-proof VSORA architecture is algorithm agnostic, allowing existing as well as new algorithms to be run on any VSORA chip.

Availability and Pricing

Jotunn4 is expected to ship in 2024. [email protected]

About VSORA

VSORA provides high-performance silicon solutions for autonomous driving (AD) and intellectual property (IP) solutions for chipmakers designing the latest generations of artificial intelligence (AI), general high-end signal processing used in advanced driver-assistance systems (ADAS) and digital communications systems including 5G. Its powerful multicore architecture eliminates the need for digital signal processing (DSP) and/or AI co-processors and hardware accelerators to provide a level of flexibility achievable only with software programming. Founded in 2015 by a team of DSP and AI scientists and engineers with a long history of successes, VSORA has offices in Meudon-La-Forêt, France, San Diego, Calif., and Taiwan.