Executive summary: e-Meeting of ITU-T Study Group 12 (Performance, Quality of Service, Quality of Experience), 15-24 April 2020
Note: This is not an official record and is subject to correction or modification
Overview
ITU-T Study Group 12 held its seventh meeting of the study period as an electronic meeting, 15-24 April 2020. The meeting was attended by 159 participants from 50 countries. Delegates exclusively used the MyMeetings web conferencing system to participate in the meeting.
The meeting received 42 Contributions and handled 121 TDs. Delegates reviewed 28 incoming Liaison statements and adopted 9 outgoing Liaison statements.
4 Recommendations were consented (2 new, 1 revised, 1 Amendment) by the meeting (see below for details). The meeting also agreed on one Amendment of an Appendix to a Recommendation, one Supplement, and one Technical Paper.
Major accomplishments
Recommendations consented during closing plenary (AAP, Recommendation ITU-T A.8)
See last call in AAP-80
|
ITU-T Rec. No. |
Question |
Reference |
New/Rev |
Title |
E.812
(ex E.CrowdESFB)
| 12/12 |
TD1167R1
| New | Crowdsourcing approach for the assessment of end-to-end QoS in fixed and mobile broadband networks
|
G.1035
(ex G.QoE-VR)
| 13/12 |
TD1207R2
| New
| Influencing factors on quality of experience (QoE) for virtual reality (VR) services
|
P.501
| 6/12 |
TD1198R1
| Rev
| Test signals for use in telephony and other speech-based applications
|
P.1203.3 Amd.1
| 14/12 |
TD1216R1
| New
| Parametric bitstream-based quality assessment of progressive download and adaptive audiovisual streaming services over reliable transport - Quality integration module - Amendment 1: Adjustment of the audiovisual quality
|
Texts agreed during closing plenary
|
ITU-T Rec. No. |
Question |
Reference |
New/Rev |
Title |
GSTP-IPTV-QoS
| 13/12 |
TD1203R1
| New | Technical Paper: Performance metrics for end-to-end IPTV video quality
|
P.863 Amd.1
| 9/12 |
TD1149
| New
| Perceptual objective listening quality prediction - Amendment 1: Revised Appendix III – Prediction of acoustically recorded narrowband speech
|
Y Suppl.60
| 17/12 |
TD1213
| New
| Interpreting Y.1540 Maximum IP-Layer Capacity Measurements
|
New work items
|
Work item |
Title |
Question |
Editor |
P.CROWDV
|
Subjective evaluation of video and audiovisual quality with the crowdsourcing approach
|
7/12
|
Babak Naderi (TU Berlin)
|
E.CrowdESFB-app
|
Appendices for Recommendation ITU-T E.812 "Crowdsourcing approach for the assessment of end-to-end QoS in fixed and mobile broadband networks"
|
12/12
| Isis De Andrade Lima (Brazil)
Yeow Hong Teo (Singapore)
Tania Villa (Mexico)
|
G.ODP
| QoS metrics for the assessment of the impact of fixed geographic structures on telephony quality and call stability
| 13/12
| Wolfgang Balzer (Focus Infocom)
Joachim Pomy (Opticom)
|
P.BBQCG
| Parametric bitstream-based quality assessment of cloud gaming services
|
14/12 | Sebastian Möller (TU Berlin)
|
P.DiAQoSE
| Diagnostic assessment of QoS and QoE for adaptive video streaming sessions
| 14/12
| Jörgen Gustafsson (Ericsson)
Yoichi Matsuo (NTT)
Alexander Raake (TU Ilmenau)
|
P.NATS-ph3
| Quality integration module for adaptive video streaming QoE in the context of P.120X-Recommendation series
| 14/12
| Jörgen Gustafsson (Ericsson)
Alexander Raake (TU Ilmenau)
|
P.CONVSIM
| Conversational quality prediction based on simulation of conversations
| 15/12
| Sebastian Möller (TU Berlin)
|
P.VSQMTF-1
| A first predictor of speech quality by machine learning based on P.565 framework
| 15/12
| Irina Cotanis (Infovista)
|
G.IntAct
| Latency measurement and interactivity scoring under real application data traffic patterns
| 17/12
| Jens Berger (Rohde & Schwarz)
Al Morton (AT&T)
|
G.NCAP
| Framework for capacity assessment of packet data services in mobile networks
| 17/12
| Wolfgang Balzer (Focus Infocom)
Joachim Pomy (Opticom)
|
Y.1565-rev
| Home network performance parameters
| 17/12
| Janusz Jezowicz (Speedchecker)
Al Morton (AT&T)
|
Y.COPI
| QoS metrics for continuity-of-performance of packet data based services
| 17/12
|
Wolfgang Balzer (Focus Infocom)
Joachim Pomy (Opticom)
|
WTSA matters
Implementation of
WTSA-16 Resolution 95 (ITU-T initiatives to raise awareness on best practices and policies related to service quality) is progressing.
SG12's operational plan on the implementation of this Resolution
was updated. Work on Res.95-related draft Recommendations progressed, in particular in Question 12/12.
Some discussion took place about quality of service aspects of alternative calling procedures (ACP), in response to
WTSA-16 Resolution 29.
In the context of
WTSA-16 Resolution 89 on the use of ICTs to bridge the financial inclusion gap, and taking into account the progress made by SG12 in this domain (see Recommendations ITU-T G.1033 and P.1505), SG12 is proposing a new Question on “Perceptual and field assessment principles for quality of service (QoS) and quality of experience (QoE) of digital financial services (DFS)," for study in the next study period.
Finally, SG12 adopted its proposal for Res.2 and ToRs for 18 Questions for study in the next study period.
Results by group directly reporting to Plenary
- Adopted a proposal concerning SG12 for ITU World Telecommunication Standardization Assembly (WTSA-20, Hyderabad, November 2020);
- Progressed work on the development of a roadmap
for QoS and QoE in the ITU-T Study Group 12 context.
Results by working party
Working Party 1/12
- Produced the following text for consent in plenary:
- Revised Recommendation ITU-T P.501: Test signals for use in telephony and
other speech-based applications.
- Established work item P.CROWDV.
Working Party 2/12
- Produced the following texts for consent or agreement in plenary:
- Amendment 1 to Recommendation P.863: Perceptual objective
listening quality prediction - Amendment 1: Revised Appendix III – Prediction
of acoustically recorded narrowband speech;
- Amendment 1 to Recommendation P.1203.3: Parametric bitstream-based quality assessment of progressive download and adaptive audiovisual streaming services over reliable transport - Quality integration module - Amendment 1: Adjustment of the audiovisual quality.
- Established work items P.BBQCG, P.ConvSim, P.DiAQoSE, P.NATS Phase 3 and P.VTQMF-1.
Working Party 3/12
- Produced the following texts for consent in plenary:
- New Recommendation ITU-T E.812: Crowdsourcing approach for the assessment of
end-to-end QoS in fixed and mobile broadband networks;
- New Recommendation ITU-T G.1035: Influencing factors on quality of experience (QoE) for virtual reality (VR) services;
- Produced the following texts for agreement in plenary:
- New Technical Paper GSTP-IPTV-QoS: Technical Paper: Performance metrics for end-to-end IPTV video quality;
- New Supplement Y.Sup60: Interpreting Y.1540 Maximum IP-Layer Capacity Measurements;
- Established work items E.CrowdESFB-app, G.ODP, G.IntAct, G.NCAP, Y.1565-rev,Y.COPI and Y Suppl.60 updates.
Future meetings and workshops
Meetings of Study Group 12
A shorter additional virtual SG12
meeting with limited scope to take decisions on selected open work items scheduled for 7-11 September 2020.
Work items potentially ready for a decision in September, as identified by Questions and in WP plenaries: Supp.CDR; P.381, P.382, P.DHIP; P.57, P.58; P.STBN; P.QXM, G.TeleMeTax; E.QosMgtMod, E.804.1, E.RQST, E.crowdesfbApp; P.360-VR; P.1204.1, P.1204.2; P.VSQMTF-1; Y Supp.60-updates.
Meetings of Rapporteur groups
Please see here for updated information. Additional conference calls of Questions will be announced on the respective mailing lists.
- Q12/12: Bi-weekly e-meetings, April - September 2020
- TBC: Q14/12: E-meeting, June/July
2020
-
Q5/12: E-meeting, 6 July 2020
- Q3/12: E-meeting, 7 July 2020
- TBC: Q19/12: Torino, Italy or e-meeting, Autumn 2020
Meeting of Quality of Service Development Group (QSDG)
- Details TBC: Amman, Jordan, 17-19 August 2020 (jointly with workshop)
SG12 Workshops
-
Details TBC: Amman, Jordan, 17-19 August 2020 (jointly with QSDG)
Meetings of Intersector Rapporteur Group Audiovisual Quality Assessment (IRG AVQA)
-
Details TBC: Torino, Italy or e-meeting, Autumn 2020 (jointly with Q19/12 and VQEG)