Committed to connecting the world

SDG

Executive Summary, SG12, December 2019

​Executive summary: Meeting of ITU-T Study Group 12 (Performance, Quality of Service, Quality of Experience), Geneva, 26 Nov – 5 Dec 2019

Note: This is not an official record and is subject to correction or modification

Overview

ITU-T Study Group 12 held its sixth meeting of the study period in Geneva, 26 November - 5 December 2019.

The meeting was attended by ​137 participants from 51 countries. 24 delegates exclusively used the remote participation facilities.

The meeting received 52 Contributions​ and handled 162 TDs. Delegates reviewed 42 incoming Liaison statements and adopted 12 outgoing Liaison statements.

Two Recommendations were approved (1 AAP, 1 TAP) with no opposition, and 14 Recommendations were consented (11 new, 1 revised, 1 Amendment, 1 Corrigendum) by the meeting (see below for details).

The meeting also agreed on one new Technical Report and one Implementers’ Guide.

A webinar (Announcement | Recording | Slides) was held on 5 December 2019​ following the closing plenary, summarizing key meeting results.​​

Major accomplishments

Recommendations approved during closing plenary (TAP, Resolution 1)

See TSB Circular 217

Rec.​

Title​​

Status

Question

Document

E.805 (ex E.RQUAL)

Strategies to Establish Quality Regulatory Frameworks

New

12

TD 891R2-GEN


Recommendations approved during closing plenary (AAP, Recommendation ITU-T A.8)

See TSB Circular 218

Rec.

Title​

Status

Question

Document

Y.1540

Internet protocol data communication service - IP packet transfer and availability performance parameters

Rev.

17

TD 997-GEN


Recommendations consented during closing plenary (AAP, Recommendation ITU-T A.8)

See last call in AAP-72

Re​​c.

Title​​​​

Status

Question

Document

E.475 (ex E.FINAD)

Guidelines for Intelligent Network Analytics and Diagnostics

New

16

TD 1086R1-GEN

G.107.1 (2019) Cor.1

Wideband E-model - Corrigendum 1

New

15

TD 1058-GEN

G.1034 (ex G.RTM)

QoE metrics for mobile telephony communication during rail travel

New

13

TD 1016R3-GEN

G.1072 (ex G.OMG)

Opinion Model Predicting Gaming QoE for Cloud Gaming Services

New

13

TD 1063R2-GEN

P.565 (ex P.VSQMTF)

Framework for creation and performance testing of machine learning based models for the assessment of transmission network impact on speech quality for mobile packet-switched voice services

New

15

TD 1020R2-GEN, TD 1035-GEN (A5 TD)

P.918 (ex P.VQD)

Dimension-based Subjective Quality Evaluation for Video Content

New

7

TD 1061R2-GEN

P.1150 (ex P.ICC)

In-Car Communication Audio Specification

New

4

TD 1021R1-GEN, TD 1077-GEN (A5 TD)

P.1204 (ex P.NATS-ph2)

Video quality assessment of streaming services over reliable transport for resolutions up to 4K

New

14

TD 1069R4-GEN

P.1204.3 (ex P.NATS-ph2)

Video quality assessment of streaming services over reliable transport for resolutions up to 4K with access to full bitstream information

New

14

TD 1066R5-GEN

P.1204.4 (ex P.NATS-ph2)

Video quality assessment of streaming services over reliable transport for resolutions up to 4K with access to full and reduced reference pixel information

New

14

TD 1067R5-GEN

P.1204.5 (ex P.NATS-ph2)

Video quality assessment of streaming services over reliable transport for resolutions up to 4K with access to transport and received pixel information

New

14

TD 1068R4-GEN

P.1401

Methods, metrics and procedures for statistical evaluation, qualification and comparison of objective quality prediction models

Rev.

9

TD 1085-GEN

P.1502 (ex P.DFSm)

Methodology for QoE testing of digital financial services

New

13

TD 1015R1-GEN

Y.1540 Amd.1

Internet protocol data communication service - IP packet transfer and availability performance parameters - Amendment 1

New

17

TD 1079R1-GEN


Texts agreed during closing plenary

Text

​​Title​

Status

Question

Document

P.863Imp

P.863 Implementers' Guide 2

New

9

TD 1075-GEN

PSTR-PXNR

No-reference pixel-based video quality estimation algorithm

New

14

TD 1078-GEN


New work items

SG12 establi​shed work items for new Recommendations on the following topics: 

  1. Subjective evaluation of gaming qual​ity with a crowdsourcing approach (P.CROWDG);
  2. Taxonomy of telemeeting systems from a QoE/QoS perspective (G.TeleMeTax);
  3. Opinion Model for Mobile Online Gaming applications (G.OMMOG);
  4. Video quality assessment of streaming services over reliable transport for resolutions up to 4K with access to transport information (P.1204.1); and
  5. Video quality assessment of streaming services over reliable transport for resolutions up to 4K with access to video frame information (P.1204.2).

WTSA matters

Implementation of WTSA Resolution 95 (ITU-T initiatives to raise awareness on best practices and policies related to service quality) is progressing.

The web page containing information on a questionnaire released by SG12 on the status of national quality regulatory frameworks, as well as country case studies and SG12 activities to implement the Resolution was updated, see https://www.itu.int/en/ITU-T/studygroups/2017-2020/12/Pages/resolution95.aspx.

In response to WTSA-16 Resolution 95, SG12 approved new Recommendation ITU-T E.805 – Strategies to establish quality regulatory frameworks (ex E.RQUAL). Work on Res.95-related draft Recommendations progressed, in particular in Question 12/12.

Approved in October, ITU-T G.1033, a new ITU standard introduces QoS and QoE aspects of digital financial services. The document is accompanied by a new specification (consented in December 2019) describing how to test the QoE of digital financial services. Both standards are catered to meet the requirements established by WTSA-16 Resolution 89 on the use of ICTs to bridge the financial inclusion gap.

The meeting also saw the continuation of the preparations for WTSA-2020. The initial SG12 proposal for Res.2 and Questions texts was adopted for submission to TSAG.

Other activities

Approximately 15 delegates from 12 countries attended the SG12 newcomers’ session.

Two tutorials were held during the meeting, discussing

​​

SG12 in the news

Results by group directly reporting to Plenary

SG12 Regional Group on QoS for the Africa Region (SG12RG-AFR)

Quality of Service Development Group (QSDG)

Results by working party

Working Party 1/12

Working Party 2/12

Working Party 3/12

Future meetings and workshops

Meetings of Study Group 12

Meetings of Rapporteur groups

Please see ​​here for​ updated information​. Additional conference calls of Questions will be announced on the respective mailing lists.​

Meetings of SG12 Regional for QoS for the Africa Region (SG12RG-AFR)

Meetings of Quality of Service Development Group (QSDG)

SG12 Workshops​

Meetings of Intersector Rapporteur Group Audiovisual Quality Assessment​ (IRG AVQA)