Key Points:
- Google has introduced new tensor processing units (TPUs) and an Arm-based central processor, Axion, for data center applications.
- Axion offers superior performance compared to x86 chips and general-purpose Arm chips, and the TPU v5p chip achieves twice the raw performance.
- Google aims to facilitate the transition of existing workloads to Arm architecture with Axion, available via Google Cloud.
- Google plans to expand the deployment of Axion across various services and make it available to the public later this year.
Google has unveiled details of its latest version of data center artificial intelligence chips and introduced an Arm-based central processor, marking a significant development in cloud computing and artificial intelligence.
The new tensor processing units (TPUs) from Google are a notable alternative to Nvidia’s advanced AI chips, albeit currently accessible exclusively through Google’s Cloud Platform rather than being available for direct purchase. However, with the introduction of the Arm-based central processing unit (CPU) named Axion, Google aims to expand its offerings and provide customers with enhanced performance capabilities.
Axion, designed to be superior to x86 chips and general-purpose Arm chips in the cloud, will be offered via Google Cloud, allowing customers to leverage its benefits without needing extensive re-architecting or app re-writing. Mark Lohmeyer, Google Cloud’s vice president and general manager of compute and machine learning infrastructure, emphasized the ease of transitioning existing workloads to Arm architecture, highlighting Axion’s compatibility with open foundations.
The move aligns with strategies adopted by rival cloud operators like Amazon.com and Microsoft, which have ventured into building Arm CPUs to differentiate their computing services. While Google has previously developed custom chips for various purposes, including YouTube, AI, and smartphones, the introduction of Axion marks its entry into the CPU market.
While Google declined to comment on any design partners for Axion, it has collaborated with Broadcom on previous generations of TPU chips. The new TPU v5p chip boasts impressive specifications, achieving twice the raw performance of its predecessor. Google employs liquid cooling technology to ensure optimal performance in pods of 8960 chips.
Axion offers a significant performance boost compared to general-purpose Arm chips and the latest x86 chips from industry leaders like Intel and Advanced Micro Devices (AMD). Already deployed in various Google services, such as YouTube Ads in Google Cloud, Axion is set for broader adoption and availability to the public later this year. Meanwhile, the TPU v5p is generally available through Google’s cloud platform.
