Delisted: Futuremark cracks down on Samsung and HTC’s benchmark cheating
The makers behind the 3DMark benchmark tool have delisted four Samsung devices and two HTC mobile devices after having found that they were rigging benchmark scores.
It was discovered that these devices had a line of code that automatically clocked the CPU and GPU to maximum whenever a known benchmark utility was initialized. This allowed manufacturers to post a 20 percent higher benchmark score than what a device would actually get in real-world usage.
The incident was brought to the fore a few months ago, as it was discovered that a few devices running the same hardware were posting wildly different benchmark results. HTC, Samsung and LG were all believed to be gaming benchmarks to a certain extent, with Samsung taking the most measures to eke out a better score. It has been found that the Galaxy Note 3 not only boosts CPU clocks when a benchmark is detected, but also GPU clocks. These settings are usually throttled to prevent overheating.
The list of devices includes: Samsung Galaxy Note 10.1 2014 (MSM8974), Samsung Galaxy Note 10.1 2014 (Exynos 5 Octa), Samsung Galaxy Note III (Exynos 5 Octa), Samsung Galaxy Note III (MSM8974), HTC One and HTC One Mini.
“People rely on Futuremark benchmarks to produce accurate and unbiased results. That’s why we have clear rules for hardware manufacturers and software developers that specify how a platform can interact with our benchmark software,” Futuremark President Oliver Baltuch said in a statement. “In simple terms, a device must run our benchmarks without modification as if they were any other application.”