|
Work item:
|
F.748.68 (ex F.EDS)
|
|
Subject/title:
|
Requirements of edge domain inference systems for foundation models
|
|
Status:
|
Approved on 2026-06-13
|
|
Approval process:
|
AAP
|
|
Type of work item:
|
Recommendation
|
|
Version:
|
New
|
|
Equivalent number:
|
-
|
|
Timing:
|
-
|
|
Liaison:
|
-
|
|
Supporting members:
|
China Academy of Information and Communications Technology, Institute of Computing Technology Chinese Academy of Sciences (ICTCAS), China Telecommunications Corporation ,China Electric Power Research Institute
|
|
Summary:
|
Foundation models are increasingly deployed at the edge to deliver low-latency, privacy-preserving AI services. However, edge environments impose strict constraints on compute, memory, energy and network resources, making model deployment, inference acceleration and system evaluation challenging. This Recommendation defines the differentiated needs for edge domain inference systems, providing standard for the evaluation of functionality and performance metrics for foundational models’ inference engines, to address the challenges of model deployment in edge domain applications.
|
|
Comment:
|
-
|
|
Reference(s):
|
|
|
Historic references:
|
|
Contact(s):
|
|
| ITU-T A.5 justification(s): |
|
|
|
|
First registration in the WP:
2025-02-18 17:52:13
|
|
Last update:
2026-05-11 16:44:12
|
