Goto

Collaborating Authors

Kentucky Sees Progress in ACT Benchmarks

U.S. News

The Kentucky Department of Education announced Wednesday 57 percent of 2018 graduates met the benchmark in English compared with 56 percent in 2017. It said 44 percent met the benchmark in math compared with 42 percent the year before. For reading, 53 percent met the benchmark in reading compared with 51 percent the previous year.


Oppo is the latest to be caught cheating on phone benchmarks

Engadget

You can add another big name to the list of phone makers found cheating on benchmarks. UL Benchmarks has delisted Oppo's Find X and F7 phones from its 3DMark charts after testing from itself and Tech2 revealed that both devices were artificially ramping up processor performance when they detected the test by name. Oppo acknowledged that it always stepped things up when it detected "games or 3D Benchmarks that required high performance," but claimed that any app would run full bore if you tapped on the screen every few seconds to signal your actions. UL, however, rejected the justifications. It was clear that Oppo was looking for the benchmark by name and not the extra processing load involved, according to the outfit.


OnePlus 5 Release Date Tainted By Benchmark Cheating?

International Business Times

The OnePlus 5 was announced Tuesday and positive reviews for the device are already coming in. However, XDA Developers warns that benchmark results being reported are inaccurate due to OnePlus providing reviewers with overclocked handsets. OnePlus has reportedly tampered with the OnePlus 5 results in benchmarks including AnTuTu, Androbench, Geekbench 4, GFXBench, Quadrant, Nenamark 2, and Vellamo. Those testing the device may find it indicating that the OnePlus 5 outperforms other flagships, such as the Galaxy S8 Plus and Pixel XL; however, those results may not be accurate. The cheating mechanism causes the OnePlus 5 to report benchmark results to report at the maximum potential ability for OnePlus 5.


Uber shareholders ask Benchmark to leave board

USATODAY - Tech Top Stories

His comments were made during a meeting focused on diversity and moving on from the company's troubled past. Sherpa Capital's Shervin Pishevar was one of Uber's shareholders to request Benchmark's removal from the board of directors. Investors at Uber asked Benchmark Capital on Friday to step down from the company's board of directors, according to a news report. In an email-petition signed by Shervin Pishevar of Sherpa Capital, Ron Burkle of Yucaipa Companies and Adam Leber of Maverick Technologies, shareholders said Benchmark's lawsuit "impede[s] the critical search for a new, world-class Chief Executive Officer," according to news site Axios, which obtained a copy of the letter. The shareholders also asked Benchmark to sell its shares so it didn't have board appointment rights.


SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems

Neural Information Processing Systems

In the last year, new models and methods for pretraining and transfer learning have driven striking performance improvements across a range of language understanding tasks. The GLUE benchmark, introduced a little over one year ago, offers a single-number metric that summarizes progress on a diverse set of such tasks, but performance on the benchmark has recently surpassed the level of non-expert humans, suggesting limited headroom for further research. In this paper we present SuperGLUE, a new benchmark styled after GLUE with a new set of more difficult language understanding tasks, a software toolkit, and a public leaderboard. SuperGLUE is available at https://super.gluebenchmark.com. Papers published at the Neural Information Processing Systems Conference.