Technology

AWS Unveils New AI Processors and Strengthens Partnership with Nvidia Amid Intensifying Chip Race

Published November 28, 2023

Amazon Web Services (AWS), the cloud arm of Amazon, recently introduced two new processors aimed at enhancing artificial intelligence (AI) model training efficiency and power consumption. Alongside this reveal, AWS has also fortified its collaboration with Nvidia, a move indicating the growing competitive dynamics within the chip industry.

Introducing Graviton4 and Trainium2

Demonstrated at the AWS re:Invent event, both the Graviton4 and Trainium2 chips exhibit significant improvements over their predecessors. The Graviton4 boasts a 30% performance enhancement, 50% more cores, and up to 75% improved memory capabilities. Meanwhile, the Trainium2 chip promises up to four times the training speed of the initial version and is designed for deployment within AWS's EC2 UltraClusters, which can scale up to 100,000 chips.

With these advancements, AWS aims to offer a more powerful and energy-efficient solution for training foundational AI and large language models (LLMs), ultimately expediting the process and cutting costs for their customers.

Deepening Ties with Nvidia

Completing the announcement, AWS extended its existing agreement with Nvidia. The expanded partnership allows AWS to offer Nvidia’s H200 AI GPUs through the Nvidia DGX Cloud. Additionally, AWS plans to provide the first cloud AI supercomputer integrating the NVIDIA Grace Hopper Superchip with AWS UltraCluster scalability.

These cooperative efforts with Nvidia serve to strengthen AWS’s position within a sensitive market where the demand for high-performing GPUs is surging, driven by the generative AI boom and the scarcity of such chips.

AI Chips: A Growing Battlefield

The competition for AI chip supremacy is not just between AWS and Nvidia. Other tech behemoths, including Microsoft and Google, have been showcasing their AI and cloud computing chips, and AMD intends to join the competition with its upcoming AI accelerators. With each company striving to make strides in this field, a new age of innovation and rivalry emerges, signaling the vitality of AI chip development for future technology growth.

AWS, Nvidia, AI