AI Boost Launched Redefined Performance on Intel’s Fifth Generation Xeon Processors
With AI acceleration built into every core of the chip, Intel introduced its 5th generation Xeon processors, the first of which will go on sale in 2024.
At the company’s AI Everywhere event, Pat Gelsinger, CEO of Intel, unveiled the CPUs.
According to the firm, the 5th generation Intel Xeon processors, formerly known as Emerald Rapids, mark the beginning of a new age in computing. These processors offer advancements targeted at increasing performance while reducing total cost of ownership (TCO). They are designed for artificial intelligence, high-performance computing, networking, storage, databases, and security.
The importance of this launch was underlined in a statement by Sandra Rivera, executive vice president of Intel and general manager of the Data Center and AI Group.
“Built for AI, our 5th Gen Intel Xeon processors provide greater performance to customers deploying AI capabilities across cloud, network, and edge use cases. We’re launching 5th Gen Intel Xeon on a proven foundation that will enable rapid adoption and scale at lower TCO,” she said.
5th generation Xeon CPUs’ highlights
AI Acceleration in Every Core:
These processors deliver minimal latency and up to 42% faster inference performance on big language models since they are optimized for AI applications. They improve the efficiency of AI jobs by enabling end-to-end processing without the need for extra accelerators.
Gains in Performance and Efficiency:
These processors offer an average performance gain of 21% in general computing performance when compared to the previous generation. Additionally, they provide a 36% boost in performance per watt for a range of client workloads, which results in notable efficiency gains.
These processors offer better performance and bandwidth thanks to support for up to 64 cores per CPU, an expanded last-level cache, eight DDR5 channels, and faster memory transfer rates. Additionally, they make it possible for CXL Type 3 workflows to be compatible with top cloud service providers.
The CPUs are equipped with Intel Trust Domain Extensions (Intel TDX), which provide better privacy and control over data by providing increased confidentiality and security at the virtual machine (VM) level.
The path ahead
By the first quarter of 2024, top OEMs including Cisco, Dell, HPE, Lenovo, and others will be selling single- and dual-socket systems equipped with the fifth generation of Xeon processors, which are pin-compatible with the previous generation. Throughout the year, major cloud service providers will disclose which instances based on these processors are available.
In the first half of 2024, Intel aims to release Sierra Forest, a platform centered on E-core efficiency with up to 288 cores, in keeping with its roadmap commitments. Granite Rapids will be next, with a focus on P-core performance.