|
Work item:
|
F.748.44 (ex F.FDM-AC-BK)
|
|
Subject/title:
|
Assessment criteria for foundation models: Benchmark
|
|
Status:
|
Approved on 2025-03-16 [Issued from previous study period]
|
|
Approval process:
|
AAP
|
|
Type of work item:
|
Recommendation
|
|
Version:
|
New
|
|
Equivalent number:
|
-
|
|
Timing:
|
-
|
|
Liaison:
|
-
|
|
Supporting members:
|
-
|
|
Summary:
|
This Recommendation focuses on the requirements and the evaluation methods of foundation models. It covers the overview of benchmark for foundation models and identifies the requirements and evaluation methods of foundation models. It is important for ensuring consistency, transparency, and comparability across different foundation models, enabling fair evaluations and informed decision-making. It can assist industry participants to analyze and optimize foundation models, as well as help users to build and select products that align with these requirements.
|
|
Comment:
|
-
|
|
Reference(s):
|
|
|
Historic references:
|
|
Contact(s):
|
|
| ITU-T A.5 justification(s): |
|
|
|
|
First registration in the WP:
2024-06-19 12:02:53
|
|
Last update:
2025-02-06 14:40:36
|
