skip to main content

Lenovo ThinkSystem Servers Continue to Lead the Industry in Performance and Customer Value

Positioning Information

Home
Top
Author
  • Barbora Osuska
Updated
11 Apr 2024
Form Number
LP1145
PDF size
34 pages, 674 KB

Abstract

Lenovo ThinkSystem servers continue to dominate the benchmarks for data center performance with a total of 555 current world record benchmark results spanning a wide range of industry benchmarks.

This total of 555 includes:

  • 184 using third-generation Intel Xeon Scalable processors
  • 45 using second-generation Intel Xeon Scalable processors
  • 48 using fourth-generation Intel Xeon Scalable processors
  • 3 using fifth-generation Intel Xeon Scalable processors
  • 53 using third-generation AMD EPYC processors
  • 2 using second-generation AMD EPYC processors
  • 39 using first-generation Intel Xeon Scalable processors
  • 181 using fourth-generation AMD EPYC processors

These results are current as of April 1, 2024. They were achieved with systems ranging from single-socket (1S) to eight-socket (8S) and workloads ranging from general business applications and infrastructure to Big Data/Analytics, software development/testing/ AI and engineering/technical computing.

Change History

Changes on the April 11, 2024 update:

  • Records as of April 1, 2024
    • Added 4 SPECpower WR with SPR
    • Added 13 MLPerf WRs with IceLake
    • Added 10 MLPerf WRs with Genoa
    • Removed 1 SPECpower WR with IceLake
    • Removed 1 SPECpower WR with CooperLake
    • Removed 3 SPECpower WR with Genoa
    • Removed 1 SPECpower WR with Cascade Lake
    • Removed 3 TPC-H  WR with Milan
    • Total benchmarks now 555 current world records

Introduction

For many customers, the performance of their servers is paramount, and as a result Lenovo strives to design its systems to maximize performance. The proof points to show the success we have achieved doing this are the #1 benchmarks we have achieved. We produce systems that cater across all workloads that our customers require, achieving #1 benchmarks across a broad range of applications types.

As of April 1, 2024 we currently hold a total of 555 world records for performance. This number consists of:

  • 184 third-generation Intel Xeon Scalable processors
  • 45 second-generation Intel Xeon Scalable processors
  • 48 fourth-generation Intel Xeon Scalable processors
  • 3 fifth-generation Intel Xeon Scalable processors
  • 53 third-generation AMD EPYC processors
  • 2 using second-generation AMD EPYC processors
  • 39 using first-generation Intel Xeon Scalable processors
  • 181 fourth-generation AMD EPYC processors

These results were achieved on a wide variety of workloads that include Applications, Data Management, Application Development and Testing, Infrastructure, and Engineering/Technical computing. Lenovo achieved these world-records across multiple ThinkSystem platforms ranging from single-socket to 8-socket, spanning Intel and AMD architectures. This demonstrates Lenovo's ability to design systems that create value for customers across architectures, workloads, and industries.

While specific ThinkSystem models were used for these benchmark tests, much of the same technology and attention to detail is prevalent throughout the ThinkSystem product line, providing exceptional performance and reliability across the product line.

This article summarizes the outstanding performance of the world record ThinkSystem servers.

Applications current world records

Lenovo ThinkSystem SR950, SR860 V2, SR850 V2, SR650 V3, SR635 V3, SR645 V3, SR655 V3, SR665 V3 and SR860 V3 servers achieved 31 current world records in benchmarks designed to test system performance across a range of application workload types. Application types include Collaboration, Enterprise Resource Management, Supply Chain, Customer Resource Management, and other typical data center applications.

SAP Sales and Distribution (SAP SD 2T) Benchmark

The 1 ThinkSystem world record result on the SAP Sales and Distribution Benchmark is:

Performance

ThinkSystem SR655 (1 current world record)

  • 1-Socket

About this benchmark: SAP Sales and Distribution (SD) Standard Application Benchmarks test the hardware and database performance of SAP applications and components. SAP Application Performance Standard (SAPS) is a hardware-independent unit of measurement that describes the performance of a system in creating the order, creating a delivery note for the order, displaying the order, changing the delivery, posting a goods issue, listing orders, and creating an invoice.

Why it matters: If you are running SAP Business Suite applications, a leadership benchmark score means this system is the highest-performing server in the industry for processing your business transaction workflows in an SAP environment.

For more information see the Performance Benchmark Reports section.

SPEC CPU 2017 Benchmark

The 30 ThinkSystem world record results on the SPEC CPU 2017 benchmark include:

SPEC CPU 2017 Performance

ThinkSystem SR950:

  • 6-Socket — 1 current world record
  • 3-Socket — 4 current world records

ThinkSystem SR950 V3:

  • 8-Socket — 1 current world record

ThinkSystem SR860 V2:

  • 4-Socket – 1 current world record

ThinkSystem SR860 V3:

  • 4-Socket – 3 current world record

ThinkSystem SR655 V3:

  • 1-Socket — 8 current world records

ThinkSystem SR665 V3:

  • 2-Socket — 12 current world records

About this benchmark: SPEC CPU 2017 contains SPEC's next-generation, industry-standardized, CPU intensive suites for measuring and comparing compute intensive-performance, stressing a system's processor, memory subsystem and compiler. CPU 2017 has 43 sub-benchmarks, organized into four suites. SPEC designed these suites to provide a comparative measure of compute-intensive performance across the widest practical range of hardware using workloads developed from real user applications. 

Why it matters: If you are running compute-intensive workloads, a world-record benchmark score means this server is the highest performing server in its class in terms of how fast a server completes a CPU-intensive task (speed) and/or how much a server can accomplish in a certain amount of time (throughput or rate measurement).

For more information see the Performance Benchmark Reports section.

Data Management current world records

Lenovo ThinkSystem SR860 V2, SR950, SR665, SR655, SR655 V3, SR650 and SR650 V3 servers delivered 79 current world records on benchmarks designed to test the performance of servers performing Structured Data Management analysis, Structured Data Analytics, and Unstructured Data Analytics.

SAP HANA (BWoH) Benchmark

The 10 ThinkSystem world record results on the HANA BWoH benchmark in a single-node setup include:

Performance

ThinkSystem SR950:

  • 4-Socket (10.4B Records v3) — 1 current world record

ThinkAgile HX7821:

  • 4 Socket – 1 current world record

ThinkAgile VX 4U Certified Node:

  • 8 Socket – 2 current world record

ThinkSystem SR860 V2

  • 4 Socket (1.3B Records v3) – current world record
  • 4 Socket (5.2B Records v3) – current world record
  • 4 Socket (7.8B Records v3) – 1 current world record

ThinkSystem SR650 V2

  • 2 Socket (1.3B Records v3) – 1 current world record
  • 2 Socket (5.2B Records v3) – 1 current world record

ThinkAgile VX650 V3 Certified Node:

  • 2 Socket (7.8B Records Virtualized v3)– 1 current world record

About this benchmark: The SAP BW Edition for SAP HANA (BW/HANA) Standard Application Benchmark is the latest addition to the list of SAP BW benchmarks and goes well beyond the scope and features used in the BW-AML benchmark. The benchmark is designed to fully utilize the new capabilities of SAP HANA to process the benchmark workload. The benchmark consists of three phases: data load, query throughput, and query runtime.

* The current SAP BW edition for SAP HANA benchmark is version 3. Existing v1 and v2 results are still valid; however, SAP will no longer accept new benchmark results for versions v1 and v2.

Why it matters: If you are running SAP HANA, a #1 benchmark score means this server is the highest performing server in its class for processing SAP HANA memory-intensive database and analytics workloads.

For more information see the Performance Benchmark Reports section.

STAC-M3 Benchmarks

The 56 ThinkSystem world record results on the STAC-M3 benchmark include:

STAC-M3

ThinkSystem SR950 (16 current world records):

  • 4-Socket (16 Shasta suite)

ThinkSystem SR860 V2 (26 current world records)

  • 4-Socket ( 3 records Single Node Antuco suite)
  • 4-Socket 2 node (Antuco 8 records, 3 yr Kanaga 15 records)

ThinkSystem SR650 (current world records):

  • 2-Socket (1 Antuco suite)

ThinkSystem SR650 V2 (4 current world records)

  • 2-Socket (4 Antuco suite)

ThinkSystem SR650 V3 (9 current world records)

  • 2-Socket (9 Single-Node Antuco suite)

About this benchmark: The STAC-M3 Benchmark suite is the industry standard for testing solutions that enable high-speed analytics on time series data. The STAC-M3 benchmarks measures challenging areas such as time-series analytics, risk simulations, and processing of very-high-speed data. The key metric is query response time. In particular, STAC benchmarks test high-speed analytics on time-series data — tick-by-tick market data. The benchmark is used by large global banks, brokerage houses, exchanges, hedge funds, proprietary trading shops, and other market participants.

Why it matters: If you are running high-speed financial services or securities workloads, a #1 benchmark score means this server is the highest performing server in its class for processing high-speed analytics and financial transactions.

For more information see the Performance Benchmark Reports section.

TPC-E Benchmark

The 13 ThinkSystem world record results on the TPC-E benchmark include:

TPC-E Performance and Price/Performance

ThinkSystem SR665 (3 current world record):

  • 2-Socket

ThinkSystem SR655 (2 current world record):

  • 1-Socket

ThinkSystem SR655 V3 (3 current world record):

  • 1-Socket

ThinkSystem SR650 V3 (5 current world record):

  • 2-Socket

About this benchmark: The TPC-E benchmark is designed to enable users to more objectively measure and compare the performance and price of various OLTP systems. The TPC-E benchmark uses a database to model a brokerage firm with customers who generate transactions related to trades, account inquiries, and market research. Although the underlying business model of TPC-E is that of a brokerage firm, the database schema, data population, transactions, and implementation rules have been designed to be broadly representative of modern OLTP systems in general.

Why it matters: If you are running On-Line Transaction Processing (OLTP) or decision-support workloads and databases, a #1 benchmark score means this server is the highest-performing server in its class for data-intensive OLTP transactions and data-intensive queries.

For more information see the Performance Benchmark Reports section.

Application Development & Testing current world records

Lenovo ThinkSystem SR950, SR860 V2, SR665 V3, SR655 V3, SN550 V2 and SR860 V3 servers hold 60 current world records in benchmarks designed to test server performance in a Java development and testing environment.

SPECjbb2015

The 60 ThinkSystem world record results on the SPECjbb2015 benchmark include:

Performance

ThinkSystem SR950:

  • 8-Socket — 2 current world records (Windows)
  • 6-Socket — 10 current world records (8 Linux / 2 Windows)
  • 3-Socket — 12 current world records (Linux)

ThinkSystem SR860 V3

  • 4-Socket – 14 current world record (10 Linux / 4 Windows)

ThinkSystem SR665 V3:

  • 2-Socket — 6 current world record (Windows)
  • 2-Socket — 4 current world record (Linux)

ThinkSystem SR655 V3:

  • 1-Socket — 6 current world record (Windows)

ThinkSystem SN550 V2:

  • 2-Socket (14 nodes) — 6 current world record (2 Linux / 4 Windows)

About this benchmark: The SPECjbb 2015 benchmark has been developed from the ground up to measure performance based on the latest Java application features. It is relevant to all audiences interested in Java server performance, including JVM vendors, hardware developers, Java application developers, researchers and members of the academic community.

Why it matters: If you are interested Java server performance, a world-record benchmark score means this server is the highest performing server in its class for Java application response time and throughput needs.

For more information see the Performance Benchmark Reports section.

Infrastructure current world records

Lenovo ThinkSystem SR950, SR860 V2, SR850, SR665, SR665 V3, SR655, SR655 V3, SR645, SR645 V3, SR635, SN850, SN550, SN550 V2 servers earned 36 current world records on benchmarks designed to test the performance of servers utilized in an IT/Web infrastructure/AI role. Workload types include Networking, Systems Management, Virtual Desktop, File & Print, Media Streaming, and Web Serving.

SPEC Power

The 22 ThinkSystem world record results on the SPECpower_ssj2008 benchmark include:

Performance

ThinkSystem SR950 (current world records):

  • 8-Socket (2 Linux / 1 Windows)

ThinkSystem SR860 V3 (2 current world record)

  • 4-Socket (1 Linux/ 1 Windows)

ThinkSystem SR850 V3 (2 current world record):

  • 4-Socket (1 Linux/ 1 Windows)

ThinkSystem SN850 (current world records):

  • 4-Socket/7-node (4S/7N, 1 Linux / 2 Windows)

ThinkSystem SN550 (2 current world record):

  • 14-node (14N, Windows)

ThinkSystem SN550 V2 (1 current world record):

  • 14-node (14N, Linux)

ThinkSystem SR635 V3 (2 current world record)

  • 1-Socket (1 Linux / 1 Windows)

ThinkSystem SR645 V3 (4 current world record)

  • 2-Socket (1 Linux / 3 Windows)

ThinkSystem SR655 V3 (current world record)

  • 1-Socket (2 Linux / 1 Windows)

About this benchmark: The SPECpower_ssj 2008 benchmark suite measures the power and performance characteristics of server-class computer equipment. It is used to compare power and performance among different servers and serves as a tool set for use in improving server efficiency.

Why it matters: The IT industry, computer manufacturers, and governments are increasingly concerned with the energy use of servers. This benchmark provides a means to measure power (at the AC input) in conjunction with a performance metric. This helps IT managers consider power characteristics along with other selection criteria to increase the efficiency of data centers. For those concerned about energy savings, a world-record benchmark score means the server provides the best performance in its class relative to power consumption.

For more information see the Performance Benchmark Reports section.

SPEC VIRT_SC 2013

The 11 ThinkSystem world record results on the SPEC virt_sc 2013 benchmark include:

Performance

ThinkSystem SR950 (current world records):

  • 8-Socket
  • 4-Socket

Performance-per-watt

ThinkSystem SR950 (3 current world records):

  • 8-Socket
  • 4-Socket

ThinkSystem SR650 (1 current world record):

  • 2-Socket

Server Performance-per-watt

ThinkSystem SR950 (3 current world records):

  • 8-Socket
  • 4-Socket

ThinkSystem SR650 (1 current world record):

  • 2-Socket

About this benchmark: The SPEC virt_sc 2013 benchmark measures the end-to-end performance of all system components including the hardware, virtualization platform, and the virtualized guest operating system and application software. SPEC virt_sc 2013 is the second-generation SPEC VIRT benchmark for evaluating the virtualization performance of datacenter server consolidation, including enterprise-class workloads.

Why it matters: If you virtualize multiple workloads, a world-record benchmark score means this system is the highest performing server in its class for memory-intensive virtualized environments.

For more information see the Performance Benchmark Reports section.

SPECvirt Datacenter 2021

ThinkSystem world record results on the SPECvirt Datacenter 2021 benchmark is:

ThinkSystem SR665 (1 current world record):

  • 2-socket, 4 node

ThinkSystem SR665 V3 (2 current world record):

  • 2-socket, 4-node

About this benchmark: The SPECvirt® Datacenter 2021 benchmark is the next generation of virtualization benchmarking for measuring performance of a scaled-out datacenter. The SPECvirt Datacenter 2021 benchmark is a multi-host benchmark using simulated and real-life workloads to measure the overall efficiency of virtualization solutions and their management environments.

The SPECvirt Datacenter 2021 benchmark differs from the SPEC VIRT_SC® 2013 benchmark in that SPEC VIRT_SC benchmark measures single host performance and provides interesting host-level information. However, most of today's datacenters use clusters for reliability, availability, serviceability, and security. Adding virtualization to a clustered solution enhances server optimization, flexibility, and application availability while reducing costs through server and datacenter consolidation.

Why it matters: If you virtualize multiple workloads, a world-record benchmark score means this system is the highest performing server in its class for memory-intensive virtualized environments.

For more information see the Performance Benchmark Reports section.

Engineering/Technical current world records

Lenovo ThinkSystem SD650-N V2, SD650 V2, SR950, SR860 V2, SR670, SR670 V2, SR665, SR665 V3, SR655, SR655 V3, SR650, SR650 V2, SR860 V3 and SE450 servers earned 349 current world records in benchmarks designed to test a system's performance running various Engineering/Technical/HPC/ AI workloads.

SPEC OMP 2012

The 11 ThinkSystem world record results on the SPEC OMP 2012 benchmark include:

Performance

ThinkSystem SR950 (1 current world record):

  • 3-Socket

ThinkSystem SR665 V3 (6 current world record):

  • 2-Socket

ThinkSystem SR655 V3 (2 current world record):

  • 1-Socket

ThinkSystem SR860 V3 (2 current world record):

  • 4-Socket

About this benchmark: The SPECompG 2012 benchmark is designed for measuring performance using applications based on the OpenMP 3.1 standard for shared-memory parallel processing. The benchmark includes 14 scientific and engineering application codes, covering everything from computational fluid dynamics (CFD) to molecular modeling to image manipulation.

Why it matters: If you are running scientific or engineering applications, a leadership benchmark score means this system is the highest performing server in its class for these workloads.

For more information see the Performance Benchmark Reports section.

SPECmpiM 2007

The 67 ThinkSystem world record results on the SPECmpiM 2007 benchmark include:

Performance

Medium 38 current world records

ThinkSystem SR950 (3 current world records):

  • 8-Socket (Medium Metric 1-node)
  • 6-Socket (Medium Metric 1-node)
  • 3-Socket (Medium Metric 1-node)

ThinkSystem SR860 V2 (12 current world records)

  • 4-Socket (Medium Metric 1-node) 
  • 4-Socket (Medium Metric1-node)
  • 4-Socket (Medium Metric 2-node)
  • 4-Socket (Medium Metric 2-node)
  • 4-Socket (Medium Metric 3-node)
  • 4-Socket (Medium Metric 3-node)
  • 4-Socket (Medium Metric 3-node)
  • 4-Socket (Medium Metric 3-node)
  • 4-Socket (Medium Metric 4-node)
  • 4-Socket (Medium Metric 4-node)
  • 4-Socket (Medium Metric 4-node)
  • 4-Socket (Medium Metric 4-node)

ThinkSystem SR665 (11 current world records):

  • 2-Socket (Medium Metric 3-node base and peak)
  • 2-Socket (Medium Metric 3-node base and peak)
  • 2-Socket (Medium Metric 4-node peak)
  • 2-Socket (Medium Metric 5-node base and peak)
  • 2-Socket (Medium Metric 5-node base and peak)
  • 2-Socket (Medium Metric 5-node base and peak)
  • 2-Socket (Medium Metric 5-node base and peak)
  • 2-Socket (Medium Metric 6-node base and base)
  • 2-Socket (Medium Metric 6-node base and base)
  • 2-Socket (Medium Metric 6-node peak and peak)
  • 2-Socket (Medium Metric 6-node peak and peak)

ThinkSystem SR665 V3 (8 current world records):

  • 2-Socket (Medium Metric 1-node base and peak) (4 records)
  • 2-Socket (Medium Metric 2-node base and peak) (4 records)

ThinkSystem SR655 V3 (4 current world records):

  • 1-Socket (Medium Metric 1-node base and peak) (2 records)
  • 1-Socket (Medium Metric 2-node base and peak) (2 records)

Large 29 current world records

ThinkSystem SR860 V2 (16 current world records)

  • 4-Socket (Large Metric 1-node base and peak) (4 records)
  • 4-Socket (Large Metric 2-node base and peak) (4 records)
  • 4-Socket (Large Metric 3-node base and peak) (4 records)
  • 4-Socket (Large Metric 4-node base and peak) (4 records)

ThinkSystem SR665 (9 current world records):

  • 2-Socket (Large Metric 6-node base and base) (2 records)
  • 2-Socket (Large Metric 5-node base and base) (2 records)
  • 2-Socket (Large Metric 4-node base)
  • 2-Socket (Large Metric 3-node base)
  • 2-Socket (Large Metric 2-node base)
  • 2-Socket (Large Metric 1-node base and peak) (2 records)

ThinkSystem SR655 (4 current world records):

  • 1-Socket (2 records Large Metric 2-node base and peak) (2 records)
  • 1-Socket (2 records Large Metric 1-node base and peak) (2 records)

About this benchmark: The SPECmpiM 2007 benchmark suite is used to evaluate MPI-parallel, floating point, compute-intensive performance across a wide range of cluster and SMP hardware. This suite gives users the most objective and representative benchmark suite for measuring and comparing high-performance computer systems.

Why it matters: If you are running compute-intensive technical workloads, a leadership benchmark score means this server is the highest performing server in its class, taking into account the CPUs, MPI library, communication interconnect, memory architecture, compilers, and file system performance.

For more information see the Performance Benchmark Reports section.

SPEC ACCEL

The 20 ThinkSystem world record results on the SPEC ACCEL benchmark include:

Open MP 

Think System SR860 V2 (2 current world records)

  • SR860 V2 4S 

ThinkSystem SR655 (2 current world record):

  • 1-Socket/1-Node (1S/1N)

Open CL 

Think System SR860 V2 (2 current world records)

  • SR860 V2 4S 

ThinkSystem SR665 (4 current world records):

  • 2-Socket/1-Node (2S/1N)

ThinkSystem SR655 (2 current world record):

  • 1-Socket/1-Node (1S/1N)

Open ACC

Think System SR860 V2 (2 current world records)

  • SR860 V2 4S 

ThinkSystem SR665 (4 current world records):

  • 2-Socket/1-Node (2S/1N)

ThinkSystem SR655 (4 current world record):

  • 1-Socket/1-Node (1S/1N)

About this benchmark: The SPEC ACCEL benchmark suite tests performance with computationally intensive parallel applications running under the OpenCL, OpenACC, and OpenMP 4 target offloading APIs. The suite exercises the performance of the accelerator, host CPU, memory transfer between host and accelerator, support libraries and drivers, and compilers.

Why it matters: If you are running servers with accelerators (GPUs, coprocessors), a #1 benchmark score means a solution incorporating this server (equipped with a specific accelerator and supporting software) is the highest performing solution in its class.

For more information see the Performance Benchmark Reports section.

MLPerf

Lenovo ThinkSystem SR650 V2, SR670 V2, SD650 V2, SD650-N V2 and SE450 servers delivered 137 current world records on MLPerf Inference v2.0, v2.1, v3.0 benchmarks designed to test Artificial Intelligence inference performance, that is, to measure how fast systems can process inputs and produce results using a trained model.

MLPerf is a consortium of industry-leading Artificial Intelligence organizations who share the goal of creating fair and meaningful benchmarks for measuring performance of Machine Learning hardware, software and services. Due to it’s extensive support, MLPerf is fast becoming the machine learning benchmark of choice for the industry.

The world record results on the MLPerf benchmark include:

MLPerf v0.2 Inference Closed Datacenter Division: https://mlcommons.org/en/inference-datacenter-20/ 

SR670 V2 2S with 8x80GB A100 PCIe (#2.0-066) Fence by Accelerator type and number  (5 records)

  • Image Classification, 99.0% Accuracy, Server Scenario
  • Object Detection (large), 99.0% Accuracy, Server Scenario
  • Speech-to-Text, 99.0% Accuracy, Server Scenario
  • Speech-to-Text, 99.0% Accuracy, Offline Scenario
  • Natural Language Processing, 99.0% Accuracy, Server Scenario

SR670 V2 2S with 4x80GB A100 SXM (#2.0-067) Fence by Accelerator type and number  (5 records)

  • Image Classification, 99.0% Accuracy, Offline Scenario
  • Medical Imaging, 99.0% Accuracy, Offline Scenario
  • Medical Imaging, 99.9% Accuracy, Offline Scenario
  • Speech-to-Text, 99.0% Accuracy, Server Scenario
  • Speech-to-Text, 99.0% Accuracy, Offline Scenario

SR650 V2 2S with 2xA16 GPU (2 physical GPUs, but 8 logical ones) (#2.0-068) Fence by Accelerator type and number  (10 records)

  • Image Classification, 99.0% Accuracy, Offline Scenario
  • Image Classification, 99.0% Accuracy, Server Scenario
  • Object Detection (large), 99.0% Accuracy, Offline Scenario
  • Object Detection (large), 99.0% Accuracy, Server Scenario
  • Medical Imaging, 99.0% Accuracy, Offline Scenario
  • Medical Imaging, 99.9% Accuracy, Offline Scenario
  • Speech-to-Text, 99.0% Accuracy, Server Scenario
  • Speech-to-Text, 99.0% Accuracy, Offline Scenario
  • Natural Language Processing, 99.0% Accuracy, Offline Scenario
  • Natural Language Processing, 99.0% Accuracy, Server Scenario

SD650 V2  with 2xIntel(R) Xeon(R) Platinum 8380 CPU (no accelerator) (#2.0-070) Fence by No accelerator and 2xCPU (5 records)

  • Image Classification, 99.0% Accuracy, Offline Scenario
  • Image Classification, 99.0% Accuracy, Server Scenario
  • Object Detection (large), 99.0% Accuracy, Offline Scenario
  • Object Detection (large), 99.0% Accuracy, Server Scenario
  • Natural Language Processing, 99.0% Accuracy, Offline Scenario

 

MLPerf v2.0 Inference Closed Edge Division: https://mlcommons.org/en/inference-edge-20/ 

SE450 2S with 2x80GB A100 PCIe (#2.0-071) Fence by Accelerator type and number  (5 records)

  • Image Classification, 99.0% Accuracy, Single Stream; 
  • Object Detection (small), 99.0% accuracy, Single Stream
  • Object Detection (small), 99.0% accuracy, Offline
  • Object Detection (large), 99.0% accuracy, Single Stream
  • Speech-to-text, 99.0% accuracy, Single Stream

SE450 2S with 2xA30 (#2.0-072) Fence by Accelerator type and number  (17 records)

  • Image Classification, 99.0% Accuracy, Single Stream; 
  • Image Classification, 99.0% Accuracy, Multi Stream; 
  • Image Classification, 99.0% Accuracy, Offline Stream;
  • Object Detection (small), 99.0% accuracy, Single Stream
  • Object Detection (small), 99.0% accuracy, Multi Stream
  • Object Detection (small), 99.0% accuracy, Offline
  • Object Detection (large), 99.0% accuracy, Single Stream
  • Object Detection (large), 99.0% accuracy, Multi Stream
  • Object Detection (large), 99.0% accuracy, Offline
  • Medical Imaging, 99.0% accuracy, Single Stream
  • Medical Imaging, 99.0% accuracy, Offline Stream
  • Medical Imaging, 99.9% accuracy, Single Stream
  • Medical Imaging, 99.9% accuracy, Offline Stream
  • Speech-to-text, 99.0% accuracy, Single Stream
  • Speech-to-text, 99.0% accuracy, Offline
  • Natural Language Processing, 99.0% accuracy, Single Stream
  • Natural Language Processing, 99.0% accuracy, Offline
     

MLPerf v2.0 Training: https://mlcommons.org/en/training-normal-20/

SR670 V2 2S with 4x80GB A100 SXM (#2.0-2076) Fence by Accelerator type and number  (1 records)

  • Image Segmentation

SD650 V2-N  with 4x80GB A100 SXM (#2.0-2077) Fence by Accelerator type and number  (1 records)

  • Object detection, heavy-weight

 

MLPerf v2.1 Inference Closed Datacenter Division: https://mlcommons.org/en/inference-datacenter-21/

SR670v2 2S with 8x80GB A100 PCIe (#2.1-0079) Fence by Accelerator type and number  (2 records)

  • Image Classification, 99% Accuracy, Offline
  • Speech-to-text, 99% accuracy, Offline

SE450 2S with 2x80GB A100 PCIe (#2.1-0080) Fence by Accelerator type and number  (2 records)

  • Image Classification, 99% Accuracy, Server Scenario
  • Image Classification, 99% Accuracy, Offline

 

MLPerf v2.1 Training: https://mlcommons.org/en/training-normal-21/ 

SR670v2 2S with 8x80GB A100 PCIe (#2.1-2058) Fence by Accelerator type and number  (2 records)

  • Image Classification, 99.0% Accuracy, Server Scenario
  • Object detection, heavy-weight

SR670v2 2S with 4x40GB A100 SXM4 (#2.1-2057) Fence by Accelerator type and number  (3 records)

  • Object detection, heavy-weight
  • Natural language processing (NLP)
  • Recommendation

 

MLPerf v3.0 Training Closed Datacenter Division: https://mlcommons.org/benchmarks/training

SR670v2 2S with 8x80GB A100 PCIe (#3.0-2019) Fence by Accelerator type and number  (1 record)

  • Image Classification, 99% Accuracy, Offline

 

MLPerf v3.0 Inference Closed Datacenter Division: https://mlcommons.org/en/inference-datacenter-30/

SR670v2 2S with 8x80GB A100 PCIe (#3.0-0062) Fence by Accelerator type and number  (7 records)

  • Image Classification, 99.0% Accuracy, Server Scenario
  • Medical imaging, 99.00% Accuracy, Offline
  • Medical imaging, 99.90% Accuracy, Offline
  • Speech-to-text, 99.00% Accuracy, Server Scenario
  • Speech-to-text, 99.00% Accuracy, Offline
  • Natural Language Processing, 99.00% Accuracy, Server scenario
  • Natural Language Processing, 99.90% Accuracy, Server scenario

 

MLPerf v3.0 Inference Closed Edge Division: https://mlcommons.org/en/inference-edge-30/
SE450 with 4x QAIC100 Lite (#3.0-0064) Fence by Accelerator type and number  (8 records)

  • Image classification, 99% Accuracy, Single stream scenario 
  • Image classification, 99% Accuracy, Multi stream scenario
  • Image classification, 99% Accuracy, Offline
  • Object detection, 99% Accuracy, Single stream scenario 
  • Object detection, 99% Accuracy, Multi stream scenario 
  • Object detection, 99% Accuracy, Offline
  • Natural Language Processing, 99% Accuracy, Single stream scenario 
  • Natural Language Processing, 99% Accuracy, Offline

SE350 with 1x QAIC100 Pro (#3.0-0063) Fence by Accelerator type and number  (8 records)

  • Processing, 99% Accuracy, OfflineImage classification, 99% Accuracy, Single stream scenario 
  • Image classification, 99% Accuracy, Multi stream scenario
  • Image classification, 99% Accuracy, Offline
  • Object detection, 99% Accuracy, Single stream scenario 
  • Object detection, 99% Accuracy, Multi stream scenario 
  • Object detection, 99% Accuracy, Offline
  • Natural Language Processing, 99% Accuracy, Single stream scenario 
  • Natural Language, 99.9% Accuracy, Single stream scenario

 

MLPerf v3.1 Training Closed Datacenter Division: https://mlcommons.org/benchmarks/training

SR675 V3 Server with 4x96GB SXM5 H100 (#3.1-2043) Fence by Accelerator type and number  (6 records)

  • Image Classification (ResNet50)
  • Medical Image Segmentation (3D-UNet)
  • Object Detection, heavy weight (Mask R-CNN)
  • Object Detection, light weight (SSD)
  • Speech Recognition (RNN-T)
  • Natural Language Processing (BERT-large)

 

MLPerf v3.1 Inference Closed Datacenter Division: MLPerf v3.1 Training Closed Datacenter Division: https://mlcommons.org/benchmarks/inference-datacenter

SR675v3 2S with 8x80GB H100 PCIe (#3.1-0102) Fence by Accelerator type and number  (3 records)

  • Natural Language Processing, 99% Accuracy, Offline (Bert)
  • Object detection, 99% Accuracy, Offline (RetinaNet) 
  • Speech-to-text, 99.0% Accuracy, Server Scenario (RNN-T)

SR665v1 2S with 5x QAIC100 Pro (#3.1-0103) Fence by Accelerator type and number  (8 records)

  • Natural Language Processing, 99% Accuracy, Offline (Bert)
  • Natural Language Processing, 99% Accuracy, Server scenario (Bert)
  • Natural Language Processing, 99.9% Accuracy, Offline (Bert)
  • Natural Language Processing, 99.9% Accuracy, Server scenario (Bert)
  • Image Classification, 99.0% Accuracy, Offline (ResNet)
  • Image Classification, 99.0% Accuracy, Server scenario (ResNet)
  • Object detection, 99% Accuracy, Offline (RetinaNet) 
  • Object detection, 99% Accuracy, Server scenario (RetinaNet) 

MLPerf v3.1 Inference Closed Edge Division: https://mlcommons.org/benchmarks/inference-edge

SE450 with 2x L40-48GB-PCIe (#3.1-0104) Fence by Accelerator type and number  (12 records)

  • Medical imaging, 99.0% Accuracy, Offline (3D-UNet)
  • Medical imaging, 99.0% Accuracy, Single stream scenario (3D-UNet)
  • Medical imaging, 99.9% Accuracy, Offline (3D-UNet)
  • Medical imaging, 99.9% Accuracy, Single stream scenario (3D-UNet)
  • Natural Language Processing, 99% Accuracy, Offline (Bert)
  • Natural Language Processing, 99% Accuracy, Single stream scenario (Bert)
  • Image Classification, 99.0% Accuracy, Offline (ResNet)
  • Image Classification, 99.0% Accuracy, Multi stream scenario (ResNet)
  • Image Classification, 99.0% Accuracy, Single stream scenario (ResNet)
  • Object detection, 99% Accuracy, Offline (RetinaNet) 
  • Object detection, 99% Accuracy, Multi stream (RetinaNet) 
  • Object detection, 99% Accuracy, Single stream (RetinaNet) 

SE450 with 4x QAIC100 Standard (#3.1-0105) Fence by Accelerator type and number  (records) 

  • Natural Language Processing, 99.0% Accuracy, Single stream scenario (Bert)
  • Image Classification, 99.0% Accuracy, Offline (ResNet)
  • Object detection, 99% Accuracy, Offline (RetinaNet) 

MLPerf v4.0 Inference Closed Datacenter Division: https://mlcommons.org/benchmarks/inference-datacenter/
SE455 with 4x48GB NVidia L40 PCIe (#4.0-0058) Fence by Accelerator type and number  (10 records)

  • Medical Imaging, 99.0% Accuracy, Offline Scenario (3d-unet)
  • Medical Imaging, 99.9% Accuracy, Offline Scenario (3d-unet)
  • Natural language processing, 99.9% Accuracy, Offline Scenario (Bert)
  • Natural language processing, 99.9% Accuracy, Server Scenario (Bert)
  • Image classification, 99% Accuracy, Offline Scenario (ResNet50-v1.5)
  • Image classification, 99% Accuracy, Server Scenario (ResNet50-v1.5)
  • Object Detection, 99% Accuracy, Offline Scenarion (RetinaNet)
  • Object Detection, 99% Accuracy, Server Scenarion (RetinaNet)
  • Speech-to-Text, 99% Accuracy, Offline Scenario (RNNT)
  • Speech-to-Text, 99% Accuracy, Server Scenario (RNNT)

SR670v2 2S with 8x QualCOMM QAIC –100 Ultra (#4.0-0059) Fence by Accelerator type and number  (2 records)

  • Natural language processing, 99.0% Accuracy, Offline Scenario (Bert)
  • Natural language processing, 99.9% Accuracy, Server Scenario (Bert)

MLPerf v4.0 Inference Closed Edge Division:  https://mlcommons.org/en/inference-edge/

SE450 with 2x NVidia L40 (#4.0-0057) Fence by Accelerator type and number  (11 records)

  • Medical Imaging, 99.0% Accuracy, Offline Scenario (3d-unet)
  • Medical Imaging, 99.0% Accuracy, Single Stream Scenario (3d-unet)
  • Medical Imaging, 99.9% Accuracy, Offline Scenario (3d-unet)
  • Medical Imaging, 99.9% Accuracy, Single Stream Scenario (3d-unet)
  • Natural language processing, 99.0% Accuracy, Offline Scenario (Bert)
  • Natural language processing, 99.0% Accuracy, Singel Stream Scenario (Bert)
  • Image classification, 99% Accuracy, Single Stream Scenario (ResNet50-v1.5)
  • Image classification, 99% Accuracy, Multi Stream Scenario (ResNet50-v1.5)
  • Image classification, 99% Accuracy, Offline Scenario (ResNet50-v1.5)
  • Speech-to-Text, 99% Accuracy, Single Stream Scenario (RNNT)
  • Speech-to-Text, 99% Accuracy, Offline Scenario (RNNT)
     

About this benchmark: The MLPerf inference benchmark measures how fast a system can perform machine learning (ML) inference using a trained model. The MLPerf inference benchmark is intended for a wide range of systems from mobile devices to servers. MLPerf Inference is a benchmark suite for measuring how fast systems can process inputs and produce results using a trained model.

Why it matters: If you are running machine learning (ML) or artificial intelligence (AI) workloads using trained models, a #1 benchmark score means this server is the highest performing server in its class for how fast systems can train models to a target quality metric.

For more information see the Performance Benchmark Reports section.

SPEChpc 2021

The 114 ThinkSystem world record results on the SPEChpc 2021 benchmark include:

Tiny Suite (62 records)

  • ThinkSystem SR655 V3 1S 1-node 1GPU ACC base and peak (2 current world records)
  • ThinkSystem SR655 V3 1S 1-node 2GPU ACC base and peak (2 current world records)
  • ThinkSystem SR675 V3 2S 1-node 1GPU ACC base and peak (2 current world records)
  •  ThinkSystem SR675 V3 2S 1-node 2GPU ACC base and peak (2 current world records)
  • ThinkSystem SR675 V3 2S 1-node 3GPU ACC base and peak (2 current world records)
  • ThinkSystem SR675 V3 2S 1-node 4GPU ACC base and peak (2 current world records)
  • ThinkSystem SR675 V3 2S 1-node 5GPU ACC base and peak (2 current world records)
  • ThinkSystem SR675 V3 2S 1-node 6GPU ACC base and peak (2 current world records)
  • ThinkSystem SR675 V3 2S 1-node 7GPU ACC base and peak (2 current world records)
  • ThinkSystem SR675 V3 2S 1-node 8GPU ACC base and peak + Best 1 node ACC base and peak (2 current world records)
  • ThinkSystem SR655 V3 1S 1-node Peak MPI (1 current world records)
  • ThinkSystem SR655 V3 1-node 1S OMP base and peak (2 current world records)
  • ThinkSystem SR655 V3 2-node 1S OMP base and peak (2 current world records)
  • ThinkSystem SR665 V3 1-node 2S MPI base/peak and base/peak (4 current world records)
  • ThinkSystem SR665 V3 1-node 2S OMP base/peak and base/peak (4 current world records)
  • ThinkSystem SR665 V3 2-node 2S OMP base/peak and base/peak (4 current world records)
  • ThinkSystem SR665 V3 3-node 2S OMP base/peak and base/peak (4 current world records)
  • ThinkSystem SR665 V3 4-node 2S OMP base/peak and base/peak (4 current world records)
  • ThinkSystem SR665 V3 5-node 2S OMP base/peak and base/peak (4 current world records)
  • ThinkSystem SR665 V3 6-node 2S OMP base/peak and base/peak (4 current world records)
  • ThinkSystem SR860 V3 1-node 4S MPI base and peak + Best 1 node MPI base and peak (4 current world records)
  • ThinkSystem SR860 V3 1-node 4S OMP base and peak + Best 1 node MPI base and peak (4 current world records)
  • ThinkSystem SR950 8S 1-node 8 CPU OMP base (1 current world records)

Small Suite (40 records)

  • ThinkSystem SR675 V3 2S 1-node 7GPU ACC base and peak (2 current world records)
  • ThinkSystem SR655 V3 1S 1-node MPI peak (1 current world records)
  • ThinkSystem SR655 V3 1S 1-node OMP base and peak (2 current world records)
  • ThinkSystem SR655 V3 1S 2-node OMP base and peak (2 current world records)
  • ThinkSystem SR665 V3 2S 1-node MPI base/peak (2 current world records)
  • ThinkSystem SR665 V3 2S 1-node OMP base/peak (2 current world records)
  • ThinkSystem SR665 V3 2S 2-node 2S OMP base/peak and base/peak (4 current world records)
  • ThinkSystem SR665 V3 2S 3-node 2S OMP base/peak and base/peak (4 current world records)
  • ThinkSystem SR665 V3 2S 4-node 2S OMP base/peak and base/peak (4 current world records)
  • ThinkSystem SR665 V3 2S 5-node 2S OMP base/peak and base/peak (4 current world records)
  • ThinkSystem SR665 V3 2S 6-node 2S OMP base/peak and base/peak (4 current world records)
  • ThinkSystem SR860 V3 4S 1-node MPI base and peak + Best 1 node MPI base and peak (4 current world records)
  • ThinkSystem SR860 V3 4S 1-node OMP base and peak + Best 1 node MPI base and peak (4 current world records)
  • ThinkSystem SR950 8S 1-node 8 CPU OMP Base (1 current world records)

Medium Suite (12 records)

  • ThinkSystem SR665 V3 4-node 2S OMP base/peak and base/peak (4 current world records)
  • ThinkSystem SR665 V3 5-node 2S OMP base/peak and base/peak (4 current world records)
  • ThinkSystem SR665 V3 6-node 2S OMP base/peak and base/peak (4 current world records)

About this benchmark: The SPEChpc 2021 benchmark was designed to provide a comprehensive measure of real-world performance for High Performance Computing (HPC) systems. Offering science and engineering codes that are representative of HPC workloads and are portable across CPU and accelerators, the benchmark includes four suites, Tiny, Small, Medium, and Large, enabling fair vendor-neutral comparisons of the performance of different HPC systems, ranging from a single node to hundreds of nodes with support multiple programming models, including MPI, MPI+OpenACC, MPI+OpenMP, and MPI+OpenMP with target offload.

Why it matters: HPC systems are getting built with an increased level of heterogeneity. The numerous types of accelerators bring in tremendous extra computing power, while at the same time introduce big challenges in performance evaluation and characterization. More complications are added to the problem when multiple parallel and accelerator programming models have been developed with each only supporting a subset of the computing devices.

The SPEChpc 2021 Benchmark Suites address these challenges by providing a set of application benchmark suites using a comprehensive measure of real-world performance for the state-of-the-art HPC systems. They offer well-selected science and engineering codes that are representative of HPC workloads and are portable across CPU and accelerators, along with certain fair comparative performance metrics.

For more information see the Performance Benchmark Reports section.

Conclusion

The portfolio of Lenovo ThinkSystem servers continues its dominance of data center performance, with 555 world record benchmarks (as of April 1, 2024). This outstanding performance was achieved across multiple configurations and a variety of workloads and industry benchmarks.

To learn more about ThinkSystem servers, go to

Performance Benchmark Reports

Each ThinkSystem benchmark has a Lenovo Performance Benchmark Report. These Performance Benchmark Reports detail the specific benchmark, benchmark result, and hardware/software configuration used for that benchmark result. The reports also provide a link to the specific benchmark results page (e.g., SPEC, TPC, SAP, etc.). View all Performance Benchmark Reports.

The following Lenovo ThinkSystem benchmark world records are current as of April 1, 2024.

SAP SD 2T Reports

SAP BWoH Reports

TPC-E Reports

  • SR665 2S - http://www.tpc.org/4090 (3 record - 16-core performance and 2P & Overall price/performance)
  • SR655 1S - http://tpc.org/4089  (2 records - 64-core performance and 64-core price/performance)
  • SR650 V3 2S EMR - http://tpc.org/4095 (3 WRs- 2P & Overall performance and 128-core price/performance) 
  • SR655 V3 1S Bergamo - http://tpc.org/4094  (1 WRs-  1P performance)
  • SR655 V3 1S Genoa - http://tpc.org/4093  (2 records- 1P & Overall performance and 1P price/performance)
  • SR650 V3 2S SPR http://tpc.org/4091 (2 records- 2P & performance and 120-core price/performance)

SPECvirt Datacenter 2021 Reports

SPECvirt_sc2013 Reports

Performance

Performance Per Watt

Server Performance Per Watt

SPEC CPU 2017 Reports

SPECpower_ssj2008 Reports

STAC-M3 Reports

SPEC ACCEL Reports

SPEC OMP2012 Reports

SPEC MPI2007 Reports

SPECjbb2015 (Linux) Reports

SPECjbb2015 (Windows) Reports

MLPerf Reports

SPEChpc2021 Reports

Tiny Suite

Small Suite

Medium Suite

Trademarks

Lenovo and the Lenovo logo are trademarks or registered trademarks of Lenovo in the United States, other countries, or both. A current list of Lenovo trademarks is available on the Web at https://www.lenovo.com/us/en/legal/copytrade/.

The following terms are trademarks of Lenovo in the United States, other countries, or both:
Lenovo®
ThinkAgile®
ThinkSystem®

The following terms are trademarks of other companies:

Intel® and Xeon® are trademarks of Intel Corporation or its subsidiaries.

Linux® is the trademark of Linus Torvalds in the U.S. and other countries.

Windows® is a trademark of Microsoft Corporation in the United States, other countries, or both.

TPC and TPC-E are trademarks of Transaction Processing Performance Council.

SPEC®, SPEC ACCEL®, SPEC CPU®, SPEC MPI®, SPEC OMP®, SPEC VIRT_SC®, SPEC VIRT®, SPEChpc™, SPECjbb®, and SPECpower_ssj® are trademarks of the Standard Performance Evaluation Corporation (SPEC).

Other company, product, or service names may be trademarks or service marks of others.