Image Credits - amd
Advertisement
AMD has secured a major victory in the AI accelerator market, with thousands of its Instinct MI300X units shipped to Vultr, one of the world’s largest privately held cloud computing platforms. Built on AMD’s third-generation CDNA architecture, the Instinct MI300X is designed for heavy AI workloads, featuring 19,456 stream processors, 192GB of HBM3 memory, 304 compute units, 1,216 matrix cores, with a power consumption rated at 750 watts TDP. In early benchmark tests, the MI300X significantly outperformed Nvidia’s RTX 4090, marking AMD’s strength in the AI accelerator space.
Vultr’s decision to integrate AMD’s cutting-edge hardware into its cloud infrastructure represents a crucial step in improving the management of GPU-accelerated workloads. By incorporating the Instinct MI300X accelerators, Vultr aims to optimize performance across its data centres and edge computing networks, further enabling customers to develop AI solutions more effectively.
The collaboration between AMD and Vultr will streamline AI development processes, providing businesses with access to open-source, pre-trained models. The value of open ecosystems in promoting innovation was underscored, with an emphasis on how “The future of enterprise AI workloads depends on open environments that provide flexibility, scalability, and security.”
AMD accelerators give our customers unparalleled cost-to-performance. The combination of high memory capacity and low power consumption enhances sustainability initiatives while providing customers with the tools to effectively drive innovation and growth through AI.
In addition to providing AI solutions, the partnership will also enhance Vultr’s infrastructure for GPU-accelerated Kubernetes clusters, designed to handle complex workloads globally. AMD’s vice president of business development, Negin Oliver, noted, “We are proud of our close collaboration with Vultr, as its cloud platform is designed to manage high-performance AI training and inferencing tasks and provide improved overall efficiency.” The deployment of thousands of AMD Instinct MI300X accelerators highlights Vultr’s commitment to offering world-class AI capabilities to its customers.