UL Solutions removes Redmagic 11 Pro phones from its graphics benchmark rankings

UL Solutions, publisher of benchmarking apps like 3DMark and PCMark, has delisted the Redmagic 11 Pro and Redmagic 11 Pro+ gaming smartphones from its 3DMark graphics benchmark rankings.

In its press statement, UL Solutions said that both Redmagic phones were found to be optimising their processing performance via benchmark detection of its public 3DMark benchmarking app. 

In our testing, scores from the public 3DMark app were up to 24% higher than scores from the internal version, even though the tests are identical. The differences in scores tell us that the devices are simply recognising the 3DMark app by name rather than adapting to the type of work in the test. This kind of detection and optimisation is forbidden by our rules for manufacturers.

UL Solutions press statement

The benchmark results on its public app do not align with the scores on UL Solution’s internal version of 3DMark, which reports up to 24% higher scores on the public version of its app.

UL Solution said that benchmarking on optional performance modes is only allowed if they are disabled by default, and the phone user has to manually enable them. Also, the 3DMark Usage Notice explicitly states that the platform must run benchmarks as if it were any other application on the device.

As the optimisation is benchmark-specific and relies on app detection, UL Solutions has decided to remove the two phones from its Best Smartphone rankings.

Too hot to handle?

Additionally, UL Solutions warned Redmagic 11 Pro and Pro+ users against enabling the phones’ “Diablo” mode for stress-testing (extended benchmark tests). It quoted Redmagic’s own disclaimer, where the phone brand cautioned that the mode generates substantially more heat during extended periods. 

In its own findings, UL Solutions recorded surface temperatures of above 50°C. For reference, water at 50°C is considered high enough for scalding, per HealthHub’s burns and scalds prevention guidelines.

We’ve reached out to the Redmagic team. The brand’s response to the benchmark delisting is below:

Redmagic devices are designed to deliver high-performance experiences, particularly for intensive gaming and power-user scenarios. To support this, our devices offer multiple performance modes that allow users to adjust CPU, GPU, and thermal settings based on their needs. For example, “Diablo Mode” is designed to maximise performance under demanding conditions.

Balancing performance, power consumption, and thermal management is a key focus of our system design. The device dynamically assesses application load in real time and allocates resources accordingly. When running high-demand applications, such as graphically intensive 3D games, the system applies higher performance scheduling to ensure a smooth and stable experience.

Regarding benchmarking, we view it as an indicator of a device’s performance potential under controlled, high-load conditions. As such, performance outcomes may vary depending on system settings, usage scenarios, and environmental factors.

We remain committed to delivering transparent, high-performance products that meet the expectations of gamers and advanced users alike.

Redmagic spokesperson

Source: UL Solutions