SPEC2017 Single And Multi-Threaded Results

Update 04/12/24: We are currently re-running SPEC2017 on the Intel Core i5-14600K, and we will update the results accordingly once we have them. Apologies for any inconvenience.

SPEC2017 is a series of standardized tests used to probe the overall performance between different systems, different architectures, different microarchitectures, and setups. The code has to be compiled, and then the results can be submitted to an online database for comparison. It covers a range of integer and floating point workloads, and can be very optimized for each CPU, so it is important to check how the benchmarks are being compiled and run.

We run the tests in a harness built through Windows Subsystem for Linux, developed by Andrei Frumusanu. WSL has some odd quirks, with one test not running due to a WSL fixed stack size, but for like-for-like testing it is good enough. Because our scores aren’t official submissions, as per SPEC guidelines we have to declare them as internal estimates on our part.

For compilers, we use LLVM both for C/C++ and Fortan tests, and for Fortran we’re using the Flang compiler. The rationale of using LLVM over GCC is better cross-platform comparisons to platforms that have only have LLVM support and future articles where we’ll investigate this aspect more. We’re not considering closed-source compilers such as MSVC or ICC.

clang version 10.0.0
clang version 7.0.1 (ssh://git@github.com/flang-compiler/flang-driver.git
 24bd54da5c41af04838bbe7b68f830840d47fc03)

-Ofast -fomit-frame-pointer
-march=x86-64
-mtune=core-avx2
-mfma -mavx -mavx2

Our compiler flags are straightforward, with basic –Ofast and relevant ISA switches to allow for AVX2 instructions.

To note, the requirements for the SPEC license state that any benchmark results from SPEC have to be labeled ‘estimated’ until they are verified on the SPEC website as a meaningful representation of the expected performance. This is most often done by the big companies and OEMs to showcase performance to customers, however is quite over the top for what we do as reviewers.

SPECint2017 Rate-1 Estimated Scores

Starting with the single-threaded results in SPECint2017 and comparing the Intel Core Ultra 7 155H directly to AMD's Ryzen 9 7940HS processor, we can see that both chips are relatively competitive for the most part. Since Intel's Core Ultra 7 155H is based on their Meteor Lake SoC with the compute tile built on the latest Intel 4 process, Intel has done a good job of ensuring parity with the competition. Even though the Core Ultra 7 155H is technically an SoC, it remains competitive in the SPECint2017 section of our single-thread testing against the Ryzen 9 7940HS. The AMD chip performs better in two of the tests (525.x264_r and 548.exchange2_r); on the whole, Intel is competitive.

In order to try to keep things a little more apples-to-apples in this architecture-centric benchmark set, we've capped the Intel Core i5-14600K to the same boost core frequencies as the Core Ultra 7 155H (4.8 GHz P-Core and 3.8 GHz E-Core), as well as explicitly enforcing Intel's stock power specifications to avoid motherboard boosting via Multi-Core Enhancement. Doing so, we see similar levels of single-threaded performance as the other chips.

SPECfp2017 Rate-1 Estimated Scores

In the second section of our single-threaded testing, we again see a very competitive showing in SPECfp2017 between the Intel Core Ultra 7 155H and the AMD Ryzen 9 7940HS. The only test we see a major gain for the Ryzen 9 7940HS is in the 503.bwaves_r test, which is a computational fluid dynamics (CFD) simulation.

SPECint2017 Rate-N Estimated Scores

Moving onto the multi-threaded section of our SPEC2017 testing, things get considerably different. First of all, the Intel Core Ultra 7 155H has more cores than the Ryzen 9 7940HS  (6P+8E+2LP vs. 8C), but ultimately, the Ryzen  9 7940HS uses more of the bigger cores. The Core Ultra 7 155H resembles the U-series Phoenix-based AMD chips like the Ryzen 7 7840U. Taking that into consideration, we can see that the Ryzen 9 7940HS performs considerably better than the Core Ultra 7 155H in the multi-threaded tests, with wins in all but two of the tests, which are 502.gcc_r and 505.mcf_r, where Intel gets modest wins. In this area, the Intel Core i5-14600K has superior multi-threaded performance, but as it is a chip built on a fully desktop architecture, this is expected.

Analyzing the Core i5-14600K in relation to the Core Ultra 7 155H, we see the desktop variant of Raptor Lake consistently outperforming the chips. Even with our frequency capping, the desktop chip's power and cooling advantage can't be completely nullified, so while it provides a useful baseline, Core Ultra isn't going to beat a 125 Watt desktop chip in multi-threaded workloads any time soon – especially when Core Ultra still has to worry about being energy efficient overall.

SPECfp2017 Rate-N Estimated Scores

In the second section of our SPEC2017 MT testing, the SPECfp2017 section also shows more wins for AMD than Intel. In the 503.bwaves_r (CFD) test, the Ryzen 9 7940HS is around 35% ahead of the Core Ultra 7 155H. Intel's Meteor Lake SoC does take wins in the 519.lbm_r and 526.blender_r tests and is competitive in a couple of the tests, but overall, the Ryzen 9 7940HS has more in terms of multi-threaded performance across the majority of the SPEC2017 MT suite.

It's also worth noting here that for our SPEC2017 testing, unlike desktop chips with motherboard vendors looking to outdo each other in performance, it inherently allows for more power to be given to the processor. We are at the whim of tighter power constraints in the case of mobile processors, including notebooks. In a light and thin notebook, such as the ASUS Zenbook 14 OLED UX3405MA, which we are using for our testing, there are both power and thermal constraints to deal with, and it does reflect somewhat in our testing. We can only test with what we have at hand within the range of capabilities the delivery vehicle offers us.

Core-to-Core Latency: Meteor Lake vs. Phoenix vs. Raptor Lake ASUS Zenbook 14 OLED UX3405MA: Power, System & Storage Performance
POST A COMMENT

69 Comments

View All Comments

  • jeenam - Friday, April 12, 2024 - link

    I've been an anandtech reader since 1998 or so and I'm not here to pick a bone. I'm a fan, and hope AT lives on. But did a quick search and the only two major websites with GPU reviews that referenced Returnal or Company of Heroes were Hot Hardware and Ars Technica. An expanded test suite of games might have been more appropriate because it's likely the ARC GPU would have been handily beaten across the board. Reply
  • sjkpublic@gmail.com - Thursday, April 11, 2024 - link

    Strange. Some of the tests list the 155H as 28W with test results. This is misleading as the SoC uses much more power doing the test. Reply
  • Gavin Bonshor - Friday, April 12, 2024 - link

    When we review CPUs, especially when highlighting them in the charts, we list the base TDP, as every motherboard has its own interpretation of what level of power it will push through the chip (Multi-core enhancement). Reply
  • Carmen00 - Friday, April 12, 2024 - link

    Yet in another comment, we have Ryan Smith saying "With these integrated devices, we're reviewing the notebook as much as we're reviewing the chip inside."

    So if you're doing what he says—post the right numbers, because that's what you're doing. And if you're NOT doing what he says, then don't post useless stuff that seems, to my (perhaps overly-critical eye) to exist so that the article can claim that Intel is scoring SOME kind of a win, when the graphs really don't seem to show a heck of a lot of CPU-related win.

    I'm fine with either, let me be honest. But I want to see some consistency, that is all.
    Reply
  • Ryan Smith - Friday, April 12, 2024 - link

    I'm all for trying to make sure you guys get the data that you want to see. But not sure I follow here. We are being consistent in our testing methodology, and taking care to be explicit in that our test systems don't have identical TDPs.

    https://images.anandtech.com/doci/21282/Core%20Ult...

    In a laptop, sustained TDPs are our primary concern, as these devices cannot turbo multiple cores for more than a few seconds. So this is what we're noting in an article like this, to illustrate how we aren't testing devices with matching TDPs.
    Reply
  • ballsystemlord - Friday, April 12, 2024 - link

    I agree with Ryan here, sustained performance is what you should be looking at. Anything can turbo to infinity.
    The only real use case for turbo, would be application start-up. But even then, you'd have to be waking the PC from idle and selecting the application in record time for it to matter at all.
    Reply
  • lmcd - Wednesday, April 17, 2024 - link

    The problem I'm seeing is that this article takes the format of previous laptop reviews but not the depth (in part due to the declining access this publication), and the headline could better fit the contents. It could even be something silly like "The Intel Core Ultra 7 155H Review: Meteor Lake starts with a Moment of Zen(Book)" and be more valuable to the reader.

    It also did not feel like we really got (even a rehash of) an overview of Meteor Lake as a platform. So to me, this was an ASUS Zenbook review. Framing this as "ASUS ZenBook 14 OLED: A Meteor Lake Thin&Light Review" also better captures its content.
    Reply
  • eastcoast_pete - Friday, April 12, 2024 - link

    I am not surprised that the Core 7 Meteor Lake isn't beating the Ryzen 7840HS in compute or graphics - that particular Ryzen 4 monolith is (IMHO) currently AMD's best foot forward, and a great APU. However, Intel did do its homework when it comes to the intended use of Meteor Lake SoCs: mobile, especially light and ultralight laptops and 2-in-1s. I don't expect a ~ 1 kg notebook to do that much higher level gaming or compute. I do expect long runtime on battery, fluid use of office and other productivity apps, and otherwise decent performance (speed). Again, AMD's Phoenix/Hawk APUs are, right now, the most performant solutions in that class, but it's good news for all of us that Intel has closed the gap. It'll mean that AMD will have to keep evolving its APUs, and maybe do a better job making them broadly available with good drivers within a few months of announcing them. Because that was not the case with Phoenix, which just took too long to be ready for prime time, and left the opening for Intel to move back into.
    Lastly, I find that one of the most remarkable things about Meteor Lake is that Intel got its tile design and packaging working quite well. Being able to combine different chips from different fabs (Intel and TSMC) and nodes into a cohesive unit without incurring large hits on performance and efficiency is big step forward.
    Reply
  • nandnandnand - Saturday, April 13, 2024 - link

    Lunar Lake will be the one to watch. It's Meteor Lake-U evolved (4+4 instead of 2+8, on-package memory by default, decent graphics). Low power mobile chips are more interesting than the 45W+ ones. Reply
  • mode_13h - Monday, April 15, 2024 - link

    > Being able to combine different chips from different fabs (Intel and TSMC)
    > and nodes into a cohesive unit without incurring large hits on performance
    > and efficiency is big step forward.

    AMD combined chiplets from both TSMC and Global Foundries in the same CPU, all the way back in Zen 2! If you count HBM, they combined chiplets from different foundries as far back as their HD Fury GPUs.

    As for performance and efficiency, I find Meteor Lake underwhelming on both fronts. Idle performance and things like video playback gain a benefit from the new SoC architecture, but when it comes to compute-intensive tasks, we see why Intel kept around Raptor Lake for the performance-oriented segment.
    Reply

Log in

Don't have an account? Sign up now