Summary

Recommendation ITU-T F.748.18 provides an artificial intelligence (AI) computing power benchmark framework, evaluation metrics and methods, and a guideline for technical testing for AI clusters. Facing more diverse AI computing systems, users hope to have a unified evaluation metric for the system that provides AI computing power. The establishment of relevant real application performance evaluation benchmarks can objectively reflect the current state of the AI computing ability by providing objective metrics and comparison dimensions.