Committed to connecting the world


Executive Summary, SG12, April 2020

​​Executive summary: e-Meeting of ITU-T Study Group 12 (Performance, Quality of Service, Quality of Experience), 15-24 April 2020 ​​​​

​Note: This is not an official record and is subject to correction or modification ​


​ITU-T Study Group 12 held its seventh meeting of the study period as an e​​lectronic meeting, 15-24 April 20​20The meeting was attended by ​159 participants from 50 countriesDelegates exclusively used the MyMeetings web conferencing system to participate in the meeting​.

The meeting received 
4Contributions​ and handled 121 TDs​. Delegates reviewed 28 incoming Liaison statements and adopted outgoing Liaison statements.

 Recommendations were consented (2 new1 revised, 1 Amendment) by the meeting (see below for details). The meeting also agreed on one Amendment of an Appendix to a Recommendation, one Supplement, and one Technical Paper. ​

Major accomplishments

Recommendations consented during closing plenary (AAP, Recommendation ITU-T A.8) 

See last call in AAP​-80​​​​

ITU-T Rec. No. Question Reference New/Rev​ ​Title​
(ex E.CrowdESFB)

12/12 TD1167R1
NewCrowdsourcing approach for the assessment of end-to-end QoS in fixed and mobile broadband networks 
(ex G.QoE-VR) 
13/12 TD1207R2
Influencing factors on quality of experience (QoE) for virtual reality (VR) services 
6/12 TD1198R1​

Test signals for use in telephony and other speech-based applications 
P.1203.3 Amd.1 
14/12 TD1216R1
Parametric bitstream-based quality assessment of progressive download and adaptive audiovisual streaming services over reliable transport - Quality integration module - Amendment 1: Adjustment of the audiovisual quality 

Texts agreed during closing plenary

​​ITU-T Rec. No. Question Reference New/Rev​ ​Title​
13/12 TD1203R1
NewTechnical Paper: Performance metrics for end-to-end IPTV video quality 
P.863 Amd.1
9/12 TD1149
Perceptual objective listening quality prediction - Amendment 1: Revised Appendix III – Prediction of acoustically recorded narrowband speech 
Y Suppl.60​
17/12 TD1213​

Interpreting Y.1540 Maximum IP-Layer Capacity Measurements  

New work items

​​Work item​ Title Question Editor​​
Subjective evaluation of video and audiovisual quality with the crowdsourcing approach 
Babak Naderi (TU Berlin) 
Appendices for Recommendation ITU-T E.812 "Crowdsourcing approach for the assessment of end-to-end QoS in fixed and mobile broadband networks" 
​Isis De Andrade Lima (Brazil) 
Yeow Hong Teo (Singapore) 
Tania Villa (Mexico) 

QoS metrics for the assessment of the impact of fixed geographic structures on telephony quality and call stability 
​Wolfgang Balzer (Focus Infocom) 
Joachim Pomy (Opticom)
Parametric bitstream-based quality assessment of cloud gaming services 
14/12 Sebastian Möller (TU Berlin) 

Diagnostic assessment of QoS and QoE for adaptive video streaming sessions 
​Jörgen Gustafsson (Ericsson) 
Yoichi Matsuo (NTT) 
Alexander Raake (TU Ilmenau) 
Quality integration module for adaptive video streaming QoE in the context of P.120X-Recommendation series 
​Jörgen Gustafsson (Ericsson) 
Alexander Raake (TU Ilmenau) 

Conversational quality prediction based on simulation of conversations 
​Sebastian Möller (TU Berlin) 
A first predictor of speech quality by machine learning based on P.565 framework 
​Irina Cotanis (Infovista) 
Latency measurement and interactivity scoring under real application data traffic patterns 
​Jens Berger (Rohde & Schwarz) 
Al Morton (AT&T) 

Framework for capacity assessment of packet data services in mobile networks 
​Wolfgang Balzer (Focus Infocom) 
Joachim Pomy (Opticom) 
Home network performance parameters 
​Janusz Jezowicz (Speedchecker) 
Al Morton (AT&T) 
QoS metrics for continuity-of-performance of packet data based services 
Wolfgang Balzer (Focus Infocom) 
Joachim Pomy (Opticom) 
Y Suppl.60 updates 
Interpreting Y.1540 Maximum IP-Layer Capacity Measurements 
​Len Ciavattone (AT&T) 
Al Morton (AT&T) 

WTSA matters

Implementation of WTSA-16 Resolution 95 (ITU-T initiatives to raise awareness on best practices and policies related to service quality) is progressing. 

The web page containing information on a questionnaire released by SG12 on the status of national quality regulatory frameworks, as well as country case studies and SG12 activities to implement the Resolution was updated, see

SG12's operational plan on the implementation of this Resolution was updated. Work on Res.95-related draft Recommendations progressed, in particular in Question 12/12. Some discussion took place about quality of service aspects of alternative calling procedures (ACP), in response to WTSA-16 Resolution 29.  

In the context of WTSA-16 Resolution 89 on the use of ICTs to bridge the financial inclusion gap, and taking into account the progress made by SG12 in this domain (see Recommendations ITU-T G.1033 and P.1505), SG12 is proposing a new Question on “Perceptual and field assessment principles for quality of service (QoS) and quality of experience (QoE) of digital financial services (DFS)," for study in the next study period. 

Finally, SG12 adopted its proposal for Res.2 and ToRs for 18 Questions for study in the next study period. ​

Results by group directly reporting to Plenary

Results by working party​

Working Party 1/12

Working Party 2/12

Working Party 3/12

​Future meetings and workshops

Meetings of Study Group 12

shorter additional virtual SG12 meeting with limited scope to take decisions on selected open work items scheduled for 7-11 September 2020

Work items potentially ready for a decision in September, as identified by Questions and in WP plenaries: Supp.CDR; P.381, P.382, P.DHIP; P.57, P.58; P.STBN; P.QXM, G.TeleMeTax; E.QosMgtMod, E.804.1, E.RQST, E.crowdesfbApp; P.360-VR; P.1204.1, P.1204.2; P.VSQMTF-1; Y Supp.60-updates. ​

Meetings of Rapporteur groups

Please see ​​
here for updated information​. Additional conference calls of Questions will be announced on the respective mailing lists.​

Meeting of Quality of Service Development Group (QSDG​)

SG12 Workshops

Meetings of Intersector Rapporteur Group Audiovisual Quality Assessment​​ (IRG AVQA)