AAP Recommendation

F.748.44: Assessment criteria for foundation models: Benchmark

Study Group
21

Study Period
2025-2028

Consent Date
2025-01-24

Approval Date
2025-03-16

Provisional Name
F.FDM-AC-BK

Input used for Consent
SG21-TD59/PLEN (2025-01)

Status
A

IPR
Site

This Recommendation focuses on the requirements and the evaluation methods of foundation models. It covers the overview of benchmark for foundation models and identifies the requirements and evaluation methods of foundation models. It is important for ensuring consistency, transparency, and comparability across different foundation models, enabling fair evaluations and informed decision-making. It can assist industry participants to analyze and optimize foundation models, as well as help users to build and select products that align with these requirements.

AAP Current Status
Step # Action
Start / End
Status Announcement Related documents Comments / Resolution logs