SKT, Arm, Rebellions Partner on Data Centers to Boost AI Inference Efficiency

SK Telecom, UK-based semiconductor design firm Arm, and South Korean AI semiconductor startup Rebellions officially kicked off collaboration on AI Data Centers (AIDC) on the 10th with a trilateral memorandum of understanding (MOU). This partnership is crucial for enabling AI to make faster and more efficient decisions. As the AI industry's paradigm shifts from 'training' focused on AI model development to 'inference' for actual service delivery, securing efficiency to provide AI services quickly and affordably with minimal power has become vital. Neural Processing Units (NPUs) are emerging as a new alternative to Graphics Processing Units (GPUs) for AI inference tasks.

The three companies will jointly develop a solution that integrates Arm's 'Arm AGI CPU' and Rebellions' 'Rebel Card' NPU into servers. This solution is structured with the CPU overseeing data flow and system operations, while the NPU handles AI inference computations, thereby enhancing system performance and efficiency.

The partners plan to pilot the developed solution within SK Telecom's AI Data Center (AIDC). SK Telecom is also considering operating its proprietary AI foundation model, 'A.X K1,' on these servers. Arm and Rebellions previously demonstrated AI services combining the two chips at the 'Arm Everywhere' event last month, showcasing their commercial viability.

The VP of Cloud AI Go-To-Market at Arm stated, "The rapid growth of AI inference is driving demand for new data center infrastructure, and our partnership with SK Telecom and Rebellions will play a significant role in modernizing AI inference infrastructure." Rebellions' CTO commented, "This collaboration will set an industry precedent for building AI-specific infrastructure."