Nvidia launches enhanced AI chip for accelerating generative AI apps

Share post:

Nvidia has announced a new configuration for its advanced artificial intelligence chips that is designed to speed generative AI applications.

The new version of the Grace Hopper Superchip boosts the amount of high-bandwidth memory, which will give the design the capacity to power larger AI models. The configuration is optimized to perform AI inference functions that effectively power generative AI applications such as ChatGPT.

Nvidia’s Grace Hopper Superchip design stitches together one of the company’s H100 graphics processing units (GPU) with an Nvidia-designed central processor. The additional memory in the new configuration will allow AI models to remain resident on a single GPU, which will improve performance and reduce the need for multiple systems or GPUs to run the models.

The new configuration, called GH200, will be available in the second quarter of 2023. Nvidia plans to sell two flavors of the chip: a version that includes two chips that customers can integrate into systems, and a complete server system that combines two Grace Hopper designs.

The sources for this piece include an article in Reuters.

Featured Tech Jobs


Related articles

AI surpasses human benchmarks in most areas: Stanford report

Stanford University’s Institute for Human-Centered Artificial Intelligence (HAI) has published the seventh annual issue of its AI Index...

Microsoft and OpenAI partner to build a $100 Billion AI supercomputer “Stargate”

In a bold stride towards computational supremacy, Microsoft, in partnership with OpenAI, is reported to be laying the...

US Bill Aims to Unveil AI Training Data Sources Amid Copyright Concerns

In a significant move toward transparency, a bill was introduced in the US Congress on Tuesday by California...

AI presents an “extinction level threat” – US Gov’t Report: Hashtag Trending for Tuesday, March 12, 2024

A new US government report warns that AI presents an “extinction level threat to the human species. Elon Musk is outsourcing his Grok AI code. Hackers have breached the Cybersecurity and Infrastructure Security Agency in the US and a researcher shows how to steal a Tesla by leveraging a feature of the Tesla charging stations.

Become a member

New, Relevant Tech Stories. Our article selection is done by industry professionals. Our writers summarize them to give you the key takeaways