Benchmarking Performance: CPU Office Tests

The office programs we use for benchmarking aren't specific programs per-se, but industry standard tests that hold weight with professionals. The goal of these tests is to use an array of software and techniques that a typical office user might encounter, such as video conferencing, document editing, architectural modelling, and so on and so forth.

All of our benchmark results can also be found in our benchmark engine, Bench.

Chromium Compile (v56)

Our new compilation test uses Windows 10 Pro, VS Community 2015.3 with the Win10 SDK to combile a nightly build of Chromium. We've fixed the test for a build in late March 2017, and we run a fresh full compile in our test. Compilation is the typical example given of a variable threaded workload - some of the compile and linking is linear, whereas other parts are multithreaded.

Office: Chromium Compile (v56)

Our popular Chrome Compile test gives a good showing for the Intel CPUs, however the higher-powered Core i9 processors perform a lot better here - up to 50% in fact. Part of this is down to memory; the DDR4-2666 C19 memory is slower than the DDR4-2666 C16 used in our Core i9 reviews. However, there might also be a case for power draw - the BIOS defaults for the Core i9 processors allow for a lot more power consumption, which the Xeon W processors might not be able to tap in to. It is worth noting that the W-2155 wins against the W-2195, showing that in this test frequency matters as much as cores.

SYSmark 2014 SE: link

SYSmark is developed by Bapco, a consortium of industry CPU companies. The goal of SYSmark is to take stripped down versions of popular software, such as Photoshop and Onenote, and measure how long it takes to process certain tasks within that software. The end result is a score for each of the three segments (Office, Media, Data) as well as an overall score. Here a reference system (Core i3-6100, 4GB DDR3, 256GB SSD, Integrated HD 530 graphics) is used to provide a baseline score of 1000 in each test.

A note on context for these numbers. AMD left Bapco in the last two years, due to differences of opinion on how the benchmarking suites were chosen and AMD believed the tests are angled towards Intel processors and had optimizations to show bigger differences than what AMD felt was present. The following benchmarks are provided as data, but the conflict of opinion between the two companies on the validity of the benchmark is provided as context for the following numbers.

Office: SYSMark 2014 SE (Overall)

PCMark 10: link

PCMark 10 is the latest all-in-one office-related performance tool that combines a number of tests for low-to-mid office workloads, including some gaming, but focusing on aspects like document manipulation, response, and video conferencing.

Office: PCMark10-1 Essential Set Score

Office: PCMark10-2 Productivity Set Score

Office: PCMark10-3 Creation Set Score

Office: PCMark10-4 Physics Score

In the Physics score, the W-2195 takes a commanding lead, however the W-2155 is not far behind, offering a better performance per dollar metric. Both are outclassed by the Threadripper 1950X in this test, however.  In fact, the only test where Xeon W truly wins is in the Creation test.

GeekBench4: link

GB4 is a popular tool in benchmarking, with most users liking its cross-platform functionality. Due to requests, we are including the data in our reviews. Our benchmark database has a more detailed breakdown of the sub-sections in the test.

Office: Geekbench 4 - Single Threaded Score (Overall)Office: Geekbench 4 - MultiThreaded Score (Overall)

GeekBench 4 is still a newer benchmark in our test suite, hence the lack of comparative results.

PCMark8: link

Despite originally coming out in 2008/2009, Futuremark has maintained PCMark8 to remain relevant in 2017. On the scale of complicated tasks, PCMark focuses more on the low-to-mid range of professional workloads, making it a good indicator for what people consider 'office' work. We run the benchmark from the commandline in 'conventional' mode, meaning C++ over OpenCL, to remove the graphics card from the equation and focus purely on the CPU. PCMark8 offers Home, Work and Creative workloads, with some software tests shared and others unique to each benchmark set.

Office: PCMark8 Work (non-OpenCL)Office: PCMark8 Home (non-OpenCL)Office: PCMark8 Creative (non-OpenCL)

[words]

 

Test Setup and Power Consumption Benchmarking Performance: CPU System Tests
Comments Locked

74 Comments

View All Comments

  • mode_13h - Monday, July 30, 2018 - link

    Just the fact that you need to map your VMs to stay on the same physical core, for best performance (i.e. so that the memory is local to it). If you do that, TR is actually a great VM solution.
  • Death666Angel - Monday, July 30, 2018 - link

    That doesn't sound so complicated as to be a "situation" for someone dealing with VMs. :) Seems like a general setup config thing that you just check off when you do it once.
  • mode_13h - Tuesday, July 31, 2018 - link

    Sorry, I meant "same physical die". Actually, best results are from setting affinity at the CCX (i.e. 4-core) granularity.
  • SanX - Tuesday, July 31, 2018 - link

    The day ARM announced it developed 8 and 16-core server and supercomputer chips at their usual price around $25 per 5 billion transistors, Intel Xeon prices would plunge 10-50x.
  • Infy2 - Monday, July 30, 2018 - link

    It would be helpful on those charts if there was an indicator how many cores/threads in CPU has.
  • Ian Cutress - Monday, July 30, 2018 - link

    We used to have that info in the graphs, however people found it redundant when it was elsewhere, and price/power was requested instead. It's hard to put all the info of every part into every graph!
  • Death666Angel - Monday, July 30, 2018 - link

    Can that not be coded as a tooltip/mouse-over text? That would be neat and not add clutter while adding information to those who want it. :)
  • Ian Cutress - Monday, July 30, 2018 - link

    Graphs are images generated locally from the data. I'm not au fait with how our back end works, but that's require more than a simple rewrite
  • Death666Angel - Tuesday, July 31, 2018 - link

    Alright. :) Shame though, would be a useful feature for some. Maybe add it to an overhaul list, if such a thing exists. :)
  • lkuzmanov - Tuesday, July 31, 2018 - link

    I'm with Infy2 on this one, not sure who protested, but I think something like (10/20) next to the model wouldn't be too distracting or cost too much screen space. I caught myself having to go back to the first page of the article to check the core count of the Xeon parts. That said - great content, you're one of my daily go-to sites.

Log in

Don't have an account? Sign up now