|
Work item:
|
Y.Benchframe-GenAI
|
|
Subject/title:
|
Benchmarking Framework for Generative AI in telecommunication networks
|
|
Status:
|
Under study
|
|
Approval process:
|
AAP
|
|
Type of work item:
|
Recommendation
|
|
Version:
|
New
|
|
Equivalent number:
|
-
|
|
Timing:
|
2026-Q4 (Medium priority)
|
|
Liaison:
|
ITU-T SG21, SG17, ISO/IEC JTC1, GSMA, ETSI ENI, ATIS ANA, 3GPP SA1, (FG-AINN)
|
|
Supporting members:
|
India (Member State), TRAI, Brazil, Zambia, Zimbabwe, Huawei, China Telecom, China Unicom
|
|
Summary:
|
Generative AI has emerged as a transformative technology in networks as well as enabling various intelligent applications in areas such as education, healthcare, agriculture etc. Connectivity provided by IMT-2020, or envisioned by IMT-2030, will enable Generative AI to serve various verticals by creating new possibilities through automated content generation, decision-making support, and innovative solutions. As Generative AI technologies continue to develop and operators integrate related services and applications into verticals, it would be appropriate to establish standard benchmarks to evaluate Generative AI performance, reliability, accuracy and interoperability, as well as applicability of Generative AI, and their overall impact, in telecommunication networks. These benchmarks can help stakeholders assess the efficacy of Generative AI technologies in addressing real-world challenges and ensure they meet industry-specific requirements.
In summary, this Recommendation addresses:
standard evaluation benchmarks for Generative AI for telecommunication networks including integrated services and applications.
interoperability and compliance guidelines for Generative AI integration in telecommunication networks.
risks related to Generative AI bias and security for telecommunication networks.
This Recommendation will enhance the Generative AI adoption in telecommunication networks.
NOTE - Content generation for the verticals is out of scope of this Recommendation.
|
|
Comment:
|
-
|
|
Reference(s):
|
|
|
Historic references:
|
|
Contact(s):
|
|
| ITU-T A.5 justification(s): |
|
|
|
|
First registration in the WP:
2025-03-19 10:20:42
|
|
Last update:
2025-04-23 18:31:35
|
|
