|
Work item:
|
E.AIQ
|
|
Subject/title:
|
Framework for quality evaluation of conversational AI (C-AI) system
|
|
Status:
|
Under study [Issued from previous study period]
|
|
Approval process:
|
AAP
|
|
Type of work item:
|
Recommendation
|
|
Version:
|
New
|
|
Equivalent number:
|
-
|
|
Timing:
|
2025 (No priority specified)
|
|
Liaison:
|
-
|
|
Supporting members:
|
India,
Orange
|
|
Summary:
|
Artificial Intelligence (AI) is advanced computing that enables a machine to interact with its environment in an intelligent way. With perpetual advancements in technologies pertaining to Neural Networks, Natural Language Processing, Facial Recognition and Sentiments and Gesture Analysis, AI is going to have potential uses of serving as front desk support for consumer interfaces. AI assisted applications / virtual assistants can be used as conversational AI for customer service management, public grievance management, service optimization and quality of service management and can add tremendous value in customer service relations, quality of service and overall quality of experiences.
AI systems will be used to better serve the human and their intelligence is mainly reflected in the process of serving. The higher the intelligence level is, the better service to the consumer will be offered by such system. Before putting such AI based systems in the network, if capabilities of AI algorithms are adjudged based on some predefined Key Performance Indicators (KPIs), it will help network managers in doing cost benefit analysis.
The proposed Recommendation defines these Key Performance Indicators (KPIs) serving as basis for an A-IQ (Artificial Intelligence Quotient), which can be used for indexing and rating AI algorithms for their capabilities in quality of service and quality of experience improvement, as part of service quality assessment methodologies.
This will be under mandate of SG12 for operational aspects of performance, QoS and QoE of such services and development of quality assessment methodologies, both subjective and objective.
|
|
Comment:
|
-
|
|
Reference(s):
|
|
|
Historic references:
|
|
Contact(s):
|
|
| ITU-T A.5 justification(s): |
|
|
|
|
First registration in the WP:
2020-09-25 10:26:54
|
|
Last update:
2024-04-25 15:23:18
|
