Technology

Meta Boosts AI Capabilities with Two New Data Centers Featuring NVIDIA GPUs

Published March 14, 2024

Artificial intelligence (AI) has become an integral part of technological advancement and industry giants are heavily investing in this domain. Meta, formerly known as Facebook, is at the forefront of this push with significant investments into their AI infrastructure.

Meta's Expanding AI Infrastructure

Meta recently unveiled their latest progression in AI with the announcement of two new data center scale clusters. Each cluster contains a staggering 24,576 NVIDIA Tensor Core H100 GPUs, demonstrating the company's commitment to developing and researching AI technology. These GPUs represent the cutting-edge of hardware that's essential for powering sophisticated AI models and performing high-level computations.

By the end of 2024, Meta's ambitious plan is to scale up their AI infrastructure to feature 350,000 of these powerful NVIDIA H100 GPUs. This expansion is indicative of their goal to lead the market in AI technology.

Technological Edge in AI

Despite the impressive number of GPUs, Meta's strategy goes beyond just sheer quantity. The two clusters are equipped with advanced network setups. One utilizes Meta's own network fabric based on the Arista 7800, while the other is set up with the NVIDIA Quantum2 fabric, offering network capabilities of up to 400Gbps. This robust network infrastructure is essential for facilitating the massive data flow required for AI computations.

Meta's infrastructure enhancements are not only about hardware but also about creating efficient and reliable systems. These systems are designed to accommodate the rapid evolution of AI models and research, ensuring that Meta remains at the forefront of technological innovation in the AI space.

The company has a wider vision to build artificial general intelligence (AGI) that's open and responsibly developed, aiming to make it accessible for widespread benefit.

Meta, NVIDIA, AI