|
Work item:
|
F.748.77 (ex H.FDM-AC-Gen)
|
|
Subject/title:
|
Assessment criteria for foundation models: General
|
|
Status:
|
Consented on 2025-10-17 [Issued from previous study period]
|
|
Approval process:
|
AAP
|
|
Type of work item:
|
Recommendation
|
|
Version:
|
New
|
|
Equivalent number:
|
-
|
|
Timing:
|
2025-10 (Medium priority)
|
|
Liaison:
|
ITU-T SG13, ISO/IEC JTC1 SC 42, IEEE AISC
|
|
Supporting members:
|
-
|
|
Summary:
|
A foundation model is any model that is trained on broad data that can be adapted to a wide range of downstream tasks. In order to make the capabilities and related performance measurable and evaluable, the assessment criteria need to be specified. In this Recommendation the overall workflow of assessment is specified and it describes the framework for assessment for foundation models with specific domains along with the assessment dimensions.
|
|
Comment:
|
-
|
|
Reference(s):
|
|
|
Historic references:
|
|
Contact(s):
|
|
| ITU-T A.5 justification(s): |
|
|
|
|
First registration in the WP:
2023-08-22 16:53:18
|
|
Last update:
2025-11-11 10:42:03
|