AAP Recommendation

F.748.26: Technical specification for artificial intelligence cloud platforms: Performance evaluation

Study Group
16

Study Period
2022-2024

Consent Date
2023-12-14

Approval Date
2024-02-13

Provisional Name
F.AI-CPP

Input used for Consent
SG16-TD193-R2/WP3 (2023-12)

Status
A

IPR
Site

This Recommendation provides a comprehensive performance evaluation framework for artificial intelligence cloud platform. It covers the overview of the evaluation framework, configuration specification, workloads, metrics, requirements on evaluation results and evaluation suggestions. It can be a unified guideline for developers, users, third-party test agency, and researchers to analyse and access the performance of AI cloud platforms.

Title adjusted, SCN 2024-02-13

AAP Current Status
Step # Action
Start / End
Status Announcement Related documents Comments / Resolution logs