F.748.44: Assessment criteria for foundation models: Benchmark
This Recommendation focuses on the requirements and the evaluation methods of foundation models. It covers the overview of benchmark for foundation models and identifies the requirements and evaluation methods of foundation models. It is important for ensuring consistency, transparency, and comparability across different foundation models, enabling fair evaluations and informed decision-making. It can assist industry participants to analyze and optimize foundation models, as well as help users to build and select products that align with these requirements.
AAP Current Status
| Step # | Action |
Start / End |
Status | Announcement | Related documents | Comments / Resolution logs |
|---|