Committed to connecting the world


Question 14

Development of models and tools for multimedia quality assessment of packet-based video services

(Continuation of Question 14/12 - Development of parametric models and tools for multimedia quality assessment)

A major challenge for emerging IP-based networks is to provide adequate Quality of Experience (QoE) and Quality of Service (QoS) for new multimedia services and applications such as IPTV, internet media including over-the-top (OTT) video, and immersive video. In previous study periods, new Recommendations have been developed by Q.14/12: Since TCP based and OTT video services are very popular, methods like P.1201 and P.1202 were addressed to include TCP and OTT video, considering both adaptive and non-adaptive streaming.

This is reflected in the standardization activity P.NATS Phase 1 (the ITU-T P.1203 series of standards) on non-intrusive assessment of TCP-based streaming. The P.NATS Phase 1 development activity, targeting integral quality estimates for videos between 1min and 5min duration, was started in Study Period 2013-2016, and finalization is planned for 2016, focusing on the integral model including the short-term audio and video quality modules (Pa, Pv), as well as the long-term integration module (Pq).

P.NATS Phase 2 will focus on improved and extended short-term video quality modules Pv, including aspects such as 4k/UHD and additional codecs such as HEVC and VP9. The topic of 4k/UHD and the related increased spatial resolution and colour gamut are topics of increasing relevance for the market. Hence, upcoming standards on monitoring solutions should include such new technology. For P.NATS Phase 2, the Question collaborates with the AVHD project of the Video Quality Experts Group (VQEG). In this project, various types of video quality models will be validated on the same dataset: Signal-based (Full Reference, No Reference, Reduced Reference), bitstream-based (Modes 0, 1, 2 and 3 according to the P.NATS Phase 1 work) and hybrid models.

Since today’s over-the-top services increasingly involve encrypted transport, mid-network quality monitoring becomes more and more challenging. Bitstream or media-related information may not be readily available, and respective monitoring algorithms may need to apply heuristics. If network operators wish to assess the quality of the media services offered over their networks, they often need to rely on proprietary solutions that are not using current, standardized approaches. Here, it will be needed to provide the market with means to validate certain proprietary tools in terms of their predictions of Key Performance Indicators such as buffer behaviour and/or MOS predictions. To address this aspect, the Question will work on the newly created work item P.ENATS (Encrypted non-intrusive assessment of TCP-based streaming), in collaboration with Q17/12.

Further work items may be addressing extensions of the P.NATS framework towards High Dynamic Range and Wide Color Gamut, as well as work on IP-based 360° video quality assessment.

The following major Recommendations, in force at the time of approval of this Question, fall under its responsibility:

Study items to be considered include, but are not limited to:
Tasks include, but are not limited to:
An up-to-date status of work under this Question is contained in the SG12 work programme


Recommendations Questions Study Groups Standardization bodies