Nvidia launches enhanced AI chip for accelerating generative AI apps

Share post:

Nvidia has announced a new configuration for its advanced artificial intelligence chips that is designed to speed generative AI applications.

The new version of the Grace Hopper Superchip boosts the amount of high-bandwidth memory, which will give the design the capacity to power larger AI models. The configuration is optimized to perform AI inference functions that effectively power generative AI applications such as ChatGPT.

Nvidia’s Grace Hopper Superchip design stitches together one of the company’s H100 graphics processing units (GPU) with an Nvidia-designed central processor. The additional memory in the new configuration will allow AI models to remain resident on a single GPU, which will improve performance and reduce the need for multiple systems or GPUs to run the models.

The new configuration, called GH200, will be available in the second quarter of 2023. Nvidia plans to sell two flavors of the chip: a version that includes two chips that customers can integrate into systems, and a complete server system that combines two Grace Hopper designs.

The sources for this piece include an article in Reuters.

Featured Tech Jobs


Related articles

Toyota AI teaches robots to make breakfast

Toyota Research Institute (TRI) has used generative AI to teach robots to make breakfast, or at least, the...

Google’s Bard chatbot gets new features

Google's Bard chatbot has received a major update that gives users the ability to double-check its answers and...

Microsoft AI researchers accidentally leak 38TB of data

Microsoft AI researchers accidentally leaked 38TB of sensitive data, including backups of personal information belonging to Microsoft employees....

Tech giants call for regulation of artificial intelligence

Tech giants such as Tesla, Meta, Google, and Microsoft have called for regulation of artificial intelligence (AI), following...

Become a member

New, Relevant Tech Stories. Our article selection is done by industry professionals. Our writers summarize them to give you the key takeaways