We must start giving less importance to benchmarks and more importance to the phone’s actual user experience.
The process isn’t fool proof and now you know that the results aren’t either. Because, getting this figure involves the app running a few resource intensive tasks to get a final score. Benchmarks give us a figure which we can compare to determine which one’s better than the other. It’s really hard to quantify the performance of a smartphone in any other way. The answer directly points to our needless obsession with benchmarks. Given the number of companies that have tried tweaking their scores for benchmark, the fundamental question is why they are doing this, even now. So, the only reason why this was made such a big deal is because Huawei didn’t seem to get the memo that this was unacceptable, even in 2018. This list includes the big names such as Samsung, LG, Asus, HTC, Meizu, and even OnePlus. History has shown us that almost every manufacturer has been found tweaking their smartphones for better benchmark scores. That being said, I can’t personally crucify Huawei for trying to score high on benchmarks. That’s not really a good enough reason to push your smartphones beyond its limits. The big reason why companies like to optimise their smartphones for benchmark is to score higher than the competition. Apart from issues like overheating, such a level of performance decreases efficiency significantly, making the whole experience impractical for daily usage.Īnother issue with this type of performance optimisation is the motive. However, what’s really the big issue here is that Huawei had tweaked its newer flagships to detect specific benchmarking apps (3DMark in this case) to run the phone at an unrealistic performance level. For example, new age phones can often detect gaming apps and switch to peak performance mode for the best user experience.
In this age of AI, it’s not uncommon for smartphones to identify specific type of apps to boost performance. We have already talked about this here but the story in short is that Huawei P20 and a few other top flagships from the company were identifying benchmarking apps to extensively increase their performance with the primary goal of scoring way higher than in a traditional use case scenario. Huawei was recently caught by AnandTech optimising some of their smartphones like Huawei P20 to over perform in a specific benchmarking app, 3DMark. Things like false advertisements, false specs by even established companies are not unheard of, but today let’s talk about something that Huawei was caught doing - benchmark cheating aka benchmark optimisation. We have seen plenty of cases where a company was busted doing something really stupid just to get an edge over its competitor. The site also put out several graphs depicting difference in multi-core and single-core performance while using regular build and secret builds of Geekbench 4.More often than not, companies have to play dirty in the race to the top. According to the earlier report, OnePlus has targeted the same set of benchmark apps as last time. OnePlus allegedly tried to manipulate benchmark results previously as well, where it altered behaviour in ROM when it detected a benchmark app was open. For instance, 3DMark didn’t see any of these problems, according to XDA’s report. The report also says not all benchmark apps are targeted. The difference in multi-core performance results obtained from Geekbench 4 Play Store version, and that used by the site is around 6.5 per cent. We are not overclocking the device, rather we are displaying the performance potential of the OnePlus 5.” Additionally, when launching apps the OnePlus 5 runs at a similar state in order to increase the speed in which apps open. OnePlus’ statement reads, “ Therefore, we have allowed benchmark apps to run in a state similar to daily usage, including the running of resource intensive apps and games.
0 kommentar(er)
