Primate Labs, creator of the popular Geekbench benchmark, has officially launched Geekbench AI 1.0, its new performance measurement tool dedicated to artificial intelligence. Available on a wide range of platforms such as iOS, macOS, Windows, Android, and Linux, Geekbench AI aims to evaluate hardware performance for a variety of tasks related to machine learning, deep learning, and AI in general. After several months of beta, this version 1.0 marks an important milestone and signals the end of Geekbench ML.
Three accuracy scores to reflect diversity of AI tasks
Unlike the classic Geekbench which provides a single-core score and a multi-core score, Geekbench AI offers three summary scores to reflect different levels of accuracy: single precision, half-precision, and quantized data. The goal is to cover the variety of hardware and software approaches used by developers for AI systems.
In addition to these performance scores, Geekbench AI also includes a per-test accuracy metric. This allows developers to improve the efficiency and reliability of their models, while evaluating the pros and cons of different engineering approaches.
New frameworks and datasets to get closer to real cases
Geekbench AI version 1.0 brings support for new AI frameworks, such as OpenVINO on Linux and Windows, or manufacturer-specific TensorFlow Lite delegates on Android (Samsung ENN, ArmNN, Qualcomm QNN…). The goal is to better reflect the most recent tools available to engineers.
The datasets used have also been expanded to be closer to real-world inputs. This helps improve the relevance of accuracy assessments. All Geekbench AI 1.0 tests now run for at least a full second, increasing the importance of manufacturer-specific optimization on the scores.
AI, a rapidly evolving field
Primate Labs is proud of the work we’ve done with Geekbench AI, which has been in development for 5 years. But in the rapidly evolving field of AI, new updates will be needed to reflect the way developers and engineers build their products.
If you are a developer with specific AI needs that are not yet addressed, Primate Labs invites you to contact them to make Geekbench AI the best tool possible. You can already download Geekbench AI 1.0 on, iOS, macOSand iPadOS.
Download the free app Geekbench AI on iOS
