AMD partners with Rapt AI to optimise AI workload efficiency

AMD has unveiled a strategic partnership with Rapt AI to enhance AI inference and training workload management on AMD Instinct GPUs.

Rapt AI brings its technology to the table by integrating its intelligent workload automation platform with AMD's Instinct MI300X, MI325X, and forthcoming MI350 series GPUs. This integration promises an efficient, high-performance, and cost-effective solution aimed at organisations needing to improve AI workload efficiency in on-premise and multi-cloud infrastructures.

The collaboration facilitates cost-effective AI implementation by combining AMD Instinct GPUs with Rapt AI's automation capabilities. This integration aims to maximise GPU utilisation, reduce the total cost of ownership, and optimise resource allocation for AI inference and training tasks.

For organisations, this development means a simplified deployment process and increased scalability, as the solution offers streamlined GPU management across diverse environments, whether on-premise or in the cloud. This is achieved through Rapt's platform, which automates resource allocation, allowing data scientists to focus on innovation rather than managing infrastructure terrain.

Rapt's auto-scaling features ensure efficient resource use, enhancing inference performance and scalability, which are crucial for production AI deployments. This feature reduces latency and maximises cost efficiency by allocating resources dynamically based on need.

The partnership also ensures that Rapt's platform, optimised for AMD's Instinct GPUs, offers out-of-the-box performance benefits. Both companies have committed to ongoing collaboration to optimise improvements like GPU scheduling and memory utilisation, aligning with future AI requirements.

Negin Oliver, Corporate Vice President of Business Development, Data Center GPU Business at AMD, commented on the collaboration, "At AMD, we are committed to delivering high-performance, scalable AI solutions that empower organisations to unlock the full potential of their AI workloads. Our collaboration with Rapt AI combines the cutting-edge capabilities of AMD InstinctTM GPUs with Rapt's intelligent workload automation, enabling customers to achieve greater efficiency, flexibility, and cost savings across their AI infrastructure."

Charlie Leeming, CEO of Rapt, added, "Collaboration with AMD allows us to further enhance our platform, optimising it for the powerful AMD Instinct GPUs. This joint solution is set to transform AI infrastructure management, driving better performance, cost efficiency, and faster time to value for our mutual customers. We are excited about the impact this will have on accelerating AI innovation across industries."

Anil Ravindranath, Rapt CTO, stated, "As more organisations move to production AI, maximising infrastructure efficiency and cost-effectiveness becomes paramount. Rapt AI, deeply integrated with powerful AMD InstinctTM GPUs, provides an intelligent, AI-powered platform that dynamically optimises resource allocation across the entire ML pipeline. This comprehensive approach delivers not just accelerated performance and lower latency, but also unprecedented GPU utilisation and simplified deployment, unlocking truly scalable and efficient production AI capabilities."

The partnership marks a concerted effort by both companies to advance AI workload efficiency, reflecting a shared commitment to developing scalable AI infrastructure solutions that meet the demands of evolving industry needs.