|
Work item:
|
P.CrowdCon
|
|
Subject/title:
|
Subjective evaluation of conversational quality with a crowdsourcing approach
|
|
Status:
|
Discontinued [Issued from previous study period]
|
|
Approval process:
|
AAP
|
|
Type of work item:
|
Recommendation
|
|
Version:
|
New
|
|
Equivalent number:
|
-
|
|
Timing:
|
-
|
|
Liaison:
|
SG16, 3GPP
|
|
Supporting members:
|
TU Berlin; Orange; AT&T
|
|
Summary:
|
This Recommendation describes methods and procedures for conducting conversation tests to evaluate communication quality via the crowdsourcing approach. Conversation tests allow the simulation of more realistic situations close to the actual service conditions experienced by telephone customers and are designed to assess the effects of impairments that can cause difficulty in conversation (such as delay, packet loss, and echo). In comparison to the laboratory test described in [ITU-T Rec. P.805], using the crowdsourcing approach relies on participants who are connected via an online platform, use their own devices, and perform their tasks in their environment. The current Recommendation gives guidance on properties of the real-time communication platform needs for conducting the experiment, the design of the experiment, test procedure, participants and their environmental conditions, and data analyses and reporting of results. The method is to be seen as complementary to laboratory-based evaluations, which are described in [ITU-T Rec. P.805]. It is also described in which circumstances it is recommended to conduct crowdsourcing or laboratory-based evaluation.
|
|
Comment:
|
-
|
|
Reference(s):
|
|
|
Historic references:
|
|
Contact(s):
|
|
| ITU-T A.5 justification(s): |
|
|
|
|
First registration in the WP:
2021-11-03 12:40:44
|
|
Last update:
2023-09-29 05:05:36
|
