Leading performance with the most built-in accelerators

4th Gen Intel® Xeon® Scalable Processors

Built-in Intel® Accelerator Engines improve performance across AI, data analytics, networking, storage, and HPC. By making the best use of CPU core resources, built-in accelerators can result in more efficient utilization and power efficiency advantages, helping businesses achieve their sustainability goals.
Register Your Interest
2 See [N9] at intel.com/processorclaims: 4th Gen Intel Xeon Scalable processors. Results may vary.
3 See [G1] at intel.com/processorclaims: 4th Gen Intel Xeon Scalable processors. Results may vary.
4 See [A16] at intel.com/processorclaims: 4th Gen Intel Xeon Scalable processors. Results may vary.
5 See [D1] at intel.com/processorclaims: 4th Gen Intel Xeon Scalable processors. Results may vary.
6 See [N18] at intel.com/processorclaims: 4th Gen Intel Xeon Scalable processors. Results may vary.
7 See [N16] at intel.com/processorclaims: 4th Gen Intel Xeon Scalable processors. Results may vary
4th Gen Intel® Xeon® Scalable processors are designed to accelerate performance across the fastest-growing workloads in artificial intelligence (AI), data analytics, networking, storage, and high-performance computing (HPC). These processors have the most built-in accelerators of any CPU on the market. They help bring a zero-trust security strategy to life while unlocking new opportunities for business collaboration and insights—even with sensitive or regulated data—with advanced security technologies. You can scale across multiple clouds and edges to meet your deployment needs. And Intel Xeon Scalable processors offer the most choice and flexibility in cloud selection, with smooth application portability.

Innovation That Makes a Difference

10x
Artificial Intelligence: Up to 10x higher PyTorch performance for both real-time inference and training with built-in Intel AMX (BF16) versus the prior generation (FP32).1
2x
Networking & Storage: Up to 2x the capacity at the same power envelope for vRAN workloads versus prior-generation processors.2
3x
Data Analytics: Up to 3x higher RocksDB performance using integrated Intel IAA versus the prior generation.3

Key Features

Intel® Advanced Matrix Extensions (Intel® AMX)

Significantly accelerate AI capabilities on the CPU with Intel® Advanced Matrix Extensions (Intel® AMX). Intel AMX is a built-in accelerator that improves the performance of deep learning training and inference on 4th Gen Intel® Xeon® Scalable processors, ideal for workloads like natural language processing, recommendation systems, and image recognition.

Intel® QuickAssist Technology (Intel® QAT)

Help reduce system resource consumption—and TCO—by accelerating cryptography and data compression with Intel® QuickAssist Technology (Intel® QAT). By offloading encryption, decryption, and compression, this built-in accelerator helps free up processor cores so that systems can serve a larger number of clients or use less power. Get the most value when you merge compression and encryption—with Intel QAT, 4th Gen Intel® Xeon® Scalable processors are the highest-performance CPU that can compress and encrypt in a single data flow.

Intel® Data Streaming Accelerator (Intel® DSA)

Drive high performance for storage, networking, and data-intensive workloads by improving streaming data movement and transformation operations. Intel® Data Streaming Accelerator (Intel® DSA) is designed to offload the most common data movement tasks that cause overhead in data center-scale deployments. Intel DSA helps speed up data movement across the CPU, memory, and caches, as well as all attached memory, storage, and network devices.

Intel® Dynamic Load Balancer (Intel® DLB)

Improve the system performance related to handling network data on multi-core Intel® Xeon® Scalable processors. Intel® Dynamic Load Balancer (Intel® DLB) enables the efficient distribution of network processing across multiple CPU cores/threads and dynamically distributes network data across multiple CPU cores for processing as the system load varies. Intel DLB also restores the order of networking data packets processed simultaneously on CPU cores.

Intel® In-Memory Analytics Accelerator (Intel® IAA)

Run database and analytics workloads faster, with potentially greater power efficiency. Intel® In-Memory Analytics Accelerator (Intel® IAA) increases query throughput and decreases the memory footprint for in-memory database and big data analytics workloads. Intel IAA is ideal for in-memory databases, open source databases, and data stores like RocksDB and ClickHouse.

Life Sciences

Get up to 53% faster results for life and material sciences for more effective research.1

1. Up to 53% higher average life and material science HPC performance vs. prior generation. See [H1] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.

Financial Services

Meet tight timelines with up to 45% faster results for options pricing.1

1. Up to 45% higher average FSI performance vs. prior generation. See [H1] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.

Manufacturing

Get up to 52% faster results for computer-aided engineering applications.1

1. Up to 52% higher average manufacturing HPC performance vs. prior generation. See [H1] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.

Retail

Offer personalized product recommendations up to 6.3x faster for smoother e-commerce.1

1. Up to 6.3x higher batch recommendation system inference performance (DLRM) with Intel AMX (BF16) vs. the prior generation with FP32. See [A21] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.

Create better consumer experiences and reach your target customers with up to 2.3x faster video analytics in retail locations.2

2. Up to 2.3x higher frames/second using 4th Gen Intel Xeon Scalable processor with Intel AMX (bf16) compared with prior generation (fp32) on end-to-end video streamer.

Digital consumer web services

Run social network microservices up to 88% faster for better user experiences.1

1. Up to 88% higher throughput vs. the prior generation on DeathStarBench – Social Network Microservices workload (Read Home Timeline) with 100ms SLA. See [W1] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.

Run hotel reservation microservices up to 61% faster for better customer experiences.2

2. Up to 61% higher throughput with the 4th Gen Intel Xeon Scalable Processor vs. prior generation on DeathStarBench – Hotel Reservation Microservices workload. See [W2] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.

Media and entertainment

Serve the same number of users on up to 47% fewer cores without slowing down CDNs and web servers.1

1. Utilize up to 47% fewer cores to achieve the same connections/second using integrated Intel® QAT vs. the prior generation on NGINX key handshake. See [N15] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.

Deliver personalized content recommendations up to 6.3x faster for smoother user experiences.2

2. Up to 6.3x higher batch recommendation system inference performance (DLRM) with Intel AMX (BF16) vs. the prior generation with FP32. See [A21] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.

4th Gen Intel® Xeon® Scalable Processors

Improved Performance Where You Need It

General purpose computing

53% average performance gain over the prior generation1

Performance per watt

Gen over gen 2.9x average performance per watt efficiency improvement for targeted workloads utilizing built-in accelerators compared to the previous generation2

Using accelerators vs. not using accelerators on same platform 3.9x average performance per watt efficiency improvement for targeted workloads utilizing built-in accelerators3

Database

Database – Intel® In-Memory Analytics Accelerator Up to 3x higher RocksDB performance using integrated Intel® In-Memory Analytics Accelerator (Intel® IAA) vs. the prior generation10

5G

Up to 2x the capacity at the same power envelope for vRAN workloads vs. prior generation processors13

HPC

Up to 56% higher average HPC performance vs. the prior generation11

High-bandwidth memory (HBM) See Intel® Xeon® CPU Max Series 5.3x higher HPCG performance vs. the prior generation12

Memory and I/O

DDR5 memory bandwidth Up to 50% higher memory bandwidth vs. the prior generation14

PCI Express 5.0 2x PCIe bandwidth improvement15

Artificial intelligence

Deep learning inference – Intel® Advanced Matrix Extensions

Up to 10x higher PyTorch real-time inference performance with built-in Intel® Advanced Matrix Extensions (Intel® AMX) (BF16) vs. the prior generation (FP32)4

Deep learning training – Intel® Advanced Matrix Extensions

Up to 10x higher PyTorch training performance with built-in Intel® Advanced Matrix Extensions (Intel® AMX) (BF16) vs. the prior generation (FP32)5

Networking and Storage

Networking encryption – Intel® QuickAssist Technology Up to 47% fewer cores to achieve the same connections/second using integrated Intel® QuickAssist Technology (Intel® QAT) vs. the prior generation on NGINX key handshake6

Networking and storage compression – Intel® QuickAssist Technology Up to 95% fewer cores and 2x higher level 1 compression throughput using integrated Intel® QuickAssist Technology (Intel® QAT) vs. the prior generation7
Networking – Intel® Data Streaming Accelerator Up to 95% higher vSwitch throughput for packet sizes above ~800B for 200Gbps bi-directional switching with built-in Intel® Data Streaming Accelerator (Intel® DSA) compared to existing software only implementation.8

Storage – Intel® Data Streaming Accelerator Up to 60% higher IOPs and up to 37% latency reduction for large packet sequential read using integrated Intel® Data Streaming Accelerator (Intel® DSA) vs. the prior generation.9

1 See [G1] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
2 See [E1] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
3 See [E2] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
4 See [A17] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
5 See [A16] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
6 See [N15] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
7 See [N16] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
8 See [W8] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.

9 See [N18] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary
10 See [D1] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
11 See [H1] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
12 Intel® Xeon® CPU Max Series has 5.3x higher HPCG performance vs. Intel® Xeon® 8380. See details at edc.intel.com/content/www/us/en/products/performance/benchmarks/supercomputing-22. Results may vary.
13 See [N10] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
14 See [G2] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.
15 See [G8] at intel.com/processorclaims: 4th Gen Intel® Xeon® Scalable processors. Results may vary.

4th Gen Intel® Xeon® Scalable Processors
Leading performance with the most built-in accelerators

Register Your Interest

Leave us a message to find out more!

Performance varies by use, configuration and other factors. Learn more at intel.com/performanceindex.
Performance results are based on testing as of dates shown in configurations and may not reflect all publicly available updates.  See backup for configuration details.  No product or component can be absolutely secure.
Your costs and results may vary.
Intel technologies may require enabled hardware, software or service activation.
Intel does not control or audit third-party data. You should consult other sources to evaluate accuracy.
© Intel Corporation. Intel, the Intel logo, and other Intel marks are trademarks of Intel Corporation or its subsidiaries. Other names and brands may be claimed as the property of others.
Intel contributes to the development of benchmarks by participating in, sponsoring, and/or contributing technical support to various benchmarking groups, including the BenchmarkXPRT Development Community administered by Principled Technologies.
Copyright © 2023 World Peace International (South Asia) Pte Ltd. All rights reserved.
Other names and brands may be claimed as property of others.

Scroll to Top