Servers
Demand for generative AI services is skyrocketing and driving the need for AI servers and machines that are substantially different from traditional servers. The category is growing so quickly that sales of AI servers are set to reach $150 billion in 2027, according to Liu Yangwei, the chairman of Foxconn, the world's largest electronics manufacturing service (EMS) provider. AI servers are a relatively new category of data center-grade products that use compute GPUs or specialized processors equipped with fast memory, so they tend to be considerably more expensive than traditional servers for data center and enterprise workloads. Demand for various generative AI applications is driving demand for such machines so rapidly that the AI server market will grow from $30 billion in 2023 to a...
Supermicro Lists Intel Data Center GPU Max 'Ponte Vecchio' Based Machines
Supermicro this week began to list the industry's first commercial servers based on Intel's Data Center GPU Max 'Ponte Vecchio' compute GPUs. The machines use Ponte Vecchio in add-in-board...
1 by Anton Shilov on 5/4/2023Intel to Exit Prebuilt Server Business, Sells Data Center Solutions Group to MiTAC
While Intel is best known in the server space for their processors, networking gear, and other components, the company also has a small but respected prebuilt server system business...
8 by Anton Shilov on 4/12/2023Arm Announces Neoverse V2 and E2: The Next Generation of Arm Server CPU Cores
Just under four years ago, Arm announced their Neoverse family of infrastructure CPU designs. Deciding to double-down on the server and edge computing markets by designing Arm CPU cores...
39 by Ryan Smith on 9/15/2022AMD Unveils Siena, A Lower Cost EPYC Family With Up to 64 Zen 4 Cores
As part of AMD's Financial Analyst Day 2022, AMD unveiled an updated server CPU roadmap up to and including 2024. Nestled within AMD's latest server roadmap, it highlighted the...
13 by Gavin Bonshor on 6/9/2022The Ampere Altra Max Review: Pushing it to 128 Cores per Socket
Following last year’s 80-core Altra, Ampere is now delivering the new Altra Max server processor with up to 128 cores, double that of the competition, and with a focus...
62 by Andrei Frumusanu on 10/7/2021Marvell Announces OCTEON 10 DPU Family: First to 5nm with N2 CPUs
It’s been a little over a year since we covered Marvell’s OCTEON TX2 infrastructure processors, and since then, the ecosystem has been evolving in an extremely fast manner &ndash...
19 by Andrei Frumusanu on 6/28/2021AMD EPYC Milan Review Part 2: Testing 8 to 64 Cores in a Production Platform
It’s been a few months since AMD first announced their new third generation EPYC Milan server CPU line-up. We had initially reviewed the first SKUS back in March, covering...
58 by Andrei Frumusanu on 6/25/2021SPEC Updates SERT Suite for ISO-Compliant Server Energy Efficiency Benchmarking
The Standard Performance Evaluation Corporation's SPEC SERT Suite has evolved as the industry-standard for measuring the energy efficiency of servers over the last decade. Regulatory authorities such as the...
4 by Ganesh T S on 6/15/2021Ampere Roadmap Update: Switching to In-House CPU Designs, 128+ 5nm Cores in 2022
Today we’re seeing an Ampere roadmap update: Beyond 128-core Altra Max perf reiterations, and announcing a Microsoft cloud win, the company discloses they’re switching from Neoverse to a new...
160 by Andrei Frumusanu on 5/19/2021Arm Announces Neoverse V1, N2 Platforms & CPUs, CMN-700 Mesh: More Performance, More Cores, More Flexibility
Today Arm is announcing the details on the new Neoverse V1 and N2 CPU microarchitectures, impressive at +50% and +40% IPC, as well as the new CMN-700 mesh network...
96 by Andrei Frumusanu on 4/27/2021Intel 3rd Gen Xeon Scalable (Ice Lake SP) Review: Generationally Big, Competitively Small
The launch of Intel’s Ice Lake Xeon Scalable processors has been in the wings for a number of years. The delays to Intel’s 10nm manufacturing process have given a...
169 by Andrei Frumusanu on 4/6/2021AMD 3rd Gen EPYC Milan Review: A Peak vs Per Core Performance Balance
The arrival of AMD’s 3rd Generation EPYC processor family, using the new Zen 3 core, has been hotly anticipated. The promise of a new processor core microarchitecture, updates to...
120 by Dr. Ian Cutress & Andrei Frumusanu on 3/15/2021NVIDIA Launches Server Certification Program, Offering Direct Technical Support
While a good deal of NVIDIA’s success in servers over the last decade has of course come from their proficient GPUs, as a business NVIDIA these days is much...
10 by Ryan Smith on 1/26/2021Qualcomm to Acquire NUVIA: A CPU Magnitude Shift
Today Qualcomm has announced they will be acquiring NUVIA for $1.4bn – acquiring the start-up company consisting of industry veterans which originally were behind the creation of Apple’s high-performance...
78 by Andrei Frumusanu on 1/13/2021The Ampere Altra Review: 2x 80 Cores Arm Server Performance Monster
Earlier in the year we have a good look at the first ever Arm Neoverse-N1 CPU in the form s of the Graviton2 from Amazon. Whilst that chip was...
148 by Andrei Frumusanu on 12/18/2020Arm Announces Neoverse V1 & N2 Infrastructure CPUs: +50% IPC, SVE Server Cores
Today Arm is announcing its new Neoverse V1 and N2 microarchitectures. The new microarchitectures represent a ever bigger jump than the already vastly successful Neoverse N1 that’s been adopted...
74 by Andrei Frumusanu on 9/22/2020SiPearl Lets Rhea Design Leak: 72x Zeus Cores, 4x HBM2E, 4-6 DDR5
In what seems to be a major blunder by the SiPearl PR team, a recent visit by a local French politician resulted in the public Twitter posting in what...
28 by Andrei Frumusanu on 9/8/2020Marvell Refocuses Thunder Server Platforms Towards Custom Silicon Business
Yesterday during Marvell’s quarterly earnings call, the company had made a surprise announcement that they are planning to restructure their server processor development team towards fully custom solutions, abandoning...
42 by Andrei Frumusanu on 8/28/2020Hot Chips 2020: Marvell Details ThunderX3 CPUs - Up to 60 Cores Per Die, 96 Dual-Die in 2021
Today as part of HotChips 2020 we saw Marvell finally reveal some details on the microarchitecture of their new ThunderX3 server CPUs and core microarchitectures. The company had announced...
27 by Andrei Frumusanu on 8/17/2020