AAP Recommendation

F.748.18: Metric and evaluation methods for AI-enabled multimedia application computing power benchmark

Study Group
16

Study Period
2022-2024

Consent Date
2022-10-28

Approval Date
2022-12-14

Provisional Name
F.AI-DLEMT

Input used for Consent
SG16-TD83-R1/PLEN (2022-10)

Status
A

IPR
Site

Facing more and more diverse AI computing systems, users hope to have a unified evaluation metric for the system that provides AI computing power. The establishment of relevant real application performance evaluation benchmarks can objectively reflect the current state of the AI computing ability by providing objective metrics and comparison dimensions. This Recommendation provides an AI computing power benchmark framework, evaluation metrics and methods, and a guideline for technical testing for AI clusters.

AAP Current Status
Step # Action
Start / End
Status Announcement Related documents Comments / Resolution logs