| Assessment criteria for foundation models – Benchmark |
 |
Recommendation ITU-T F.748.44 focuses on the requirements and evaluation methods of foundation models. It covers the overview of the benchmark for foundation models and identifies the requirements and evaluation methods of foundation models. It is important for ensuring consistency, transparency, and comparability across different foundation models, enabling fair evaluations and informed decision-making. It can assist industry participants in analysing and optimizing foundation models, as well as help users build and select products that align with these requirements.
|
|
|
|
|
| Ed. |
ITU-T Recommendation |
Status |
Summary |
Table of Contents |
Download |
|
1
|
F.748.44 (03/2025)
|
In force
|
here
|
here
|
here
|
| Title |
Approved on |
Download |
|
Guideline on web-based remote sign language interpretation or video remote interpretation (VRI) system
|
2022
|
here
|
|
Application of software-defined cameras in the surveillance industry
|
2022
|
here
|
|
Conformance test specification for ITU-T F.780.1
|
2022
|
|
|
Overview of assistive listening systems
|
2020
|
here
|
|
Overview of remote captioning services
|
2019
|
here
|
|
Telecommunications Accessibility Checklist
|
2006
|
here
|
|