Delisted: Futuremark cracks down on Samsung and HTC’s benchmark cheating

A total of six devices have been removed from Futuremark’s device database for rigging benchmark tests.3DMark Delisted: Futuremark cracks down on Samsung and HTCs benchmark cheating

The makers behind the 3DMark benchmark tool have delisted four Samsung devices and two HTC mobile devices after having found that they were rigging benchmark scores.

It was discovered that these devices had a line of code that automatically clocked the CPU and GPU to maximum whenever a known benchmark utility was initialized. This allowed manufacturers to post a 20 percent higher benchmark score than what a device would actually get in real-world usage.

Also read: “The most honest company in the benchmarking business?”

The incident was brought to the fore a few months ago, as it was discovered that a few devices running the same hardware were posting wildly different benchmark results. HTC, Samsung and LG were all believed to be gaming benchmarks to a certain extent, with Samsung taking the most measures to eke out a better score. It has been found that the Galaxy Note 3 not only boosts CPU clocks when a benchmark is detected, but also GPU clocks. These settings are usually throttled to prevent overheating.

Benchmarks 1024x474 Delisted: Futuremark cracks down on Samsung and HTCs benchmark cheating

The list of devices includes: Samsung Galaxy Note 10.1 2014 (MSM8974), Samsung Galaxy Note 10.1 2014 (Exynos 5 Octa), Samsung Galaxy Note III (Exynos 5 Octa), Samsung Galaxy Note III (MSM8974), HTC One and HTC One Mini.

“People rely on Futuremark benchmarks to produce accurate and unbiased results. That’s why we have clear rules for hardware manufacturers and software developers that specify how a platform can interact with our benchmark software,” Futuremark President Oliver Baltuch said in a statement. “In simple terms, a device must run our benchmarks without modification as if they were any other application.”

Source: Futuremark

 

Harish Jonnalagadda is an avid reader of science-fiction novels. A long-time Arsenal fan, his other interests include gaming, basketball and making music. He also likes tinkering with hardware in his free time.