Tencent is one vendor that attempted to cheat
From the article:
As part of our research, we found that all the tools we're using for the performance benchmark were "whitelisted" using their name (Eg "AcroRd32.exe"), so the Tencent scan engine won't check them anymore," Marx said.
This only applied to exactly the programs we're using (some are well know, like Acrobat Reader, but some are less commonly used).
"The "whitelist" was even extended from month to month by exactly the tools we used for the next benchmark, so this optimisation was clearly focusing on our tests only."
Once the tools were renamed, Tencent product performance decreased significantly, confirming the test-specific optimisations.
Follow the link below for more details
No comments:
Post a Comment