The meeting ran paperless as announced in the above-mentioned Collective letter. Preparation of the next study period: revision of all Questions
As this was the last meeting of this study period, the future of all Questions was discussed. It was agreed to split Question 1/12 into 2 Questions, clearly separating the coordination part from the terminology part. With that, SG12 will propose 17 Questions for approval to WTSA‑12.
New chapters in the P-series Recommendations
In order to logically number several new recommendations, it was agreed to open new chapters in the P-series Recommendations, as follows:
- P.1200-series: Models and tools for quality assessment of streamed media
- P.1300-series: Telemeeting assessment
- P.1400-series: Statistical analysis, evaluation and reporting guidelines of quality measurements
Future meetings
Rapporteur’s meetings
Five Questions (Qs 5, 9, 13, 14 and 17/12) requested interim Rapporteur’s meetings, these requests were agreed.
Interim meeting of Working Party 2/12
In order to consent draft new Recommendations prepared by Q14/12, a one-day WP2/12 meeting will be held on 7 September 2012 in Kista, Stockholm (Sweden) at the kind invitation of Ericsson (see TSB Collective letter 8/12).
Next meeting of SG12
The next meeting of SG12, which will be the first meeting of the 2013-2016 study period, is planned to be held in Geneva from 19 to 28 March 2013.
Results of the meeting of Working Party 1/12 – Terminals and multimedia subjective assessment
The foreseen evolution of activities is to consider bandwidth extension and binaural perception and this is reflected in the work plans of Q3, 4, 5 and 6. Q5 will have an interim meeting (beginning of January next year) to progress P.TBN and work on loudness. The next meeting of FG CarCOM is planned for 16-17 July 2012, in Detroit.
The next meeting of FG Driver Distraction is planned for 27-28 June 2012 in Munich.
Q7 takes action to work on new testing methodology for subjective assessment of Text-To-Speech which will help populating P.SUSE. Q18 created a new work item “Subjective method for simulated conversation tests addressing audio and audiovisual call quality”
Results related to Recommendations
Consent was reached on one revised Recommendation and two new Recommendations:
- P. 501 "Test signals for use in telephonometry"
- P.1301 "Subjective quality evaluation of audio and audiovisual multiparty telemeetings "
- P.381 "Technical requirements and test methods for universal wired headset or headphone interface of digital wireless terminals”
Other results
Corrigendum to the Handbook “Practical procedures for subjective testing” was agreed. A new supplement to the P-series was approved “ Scenarios for the subjective evaluation of audio and audiovisual multiparty telemeetings quality”. An appendix was approved to be included in P.505 “One-view visualization of speech quality measurement results”.
Results of the meeting of Working Party 2/12 - Objective models and tools for multimedia quality
It is the purpose of WP 2/12 to cover the end-to-end transmission performance of networks, terminals and their interactions, in relation to the perceived quality and its objective assessment as well as guidance and modelling in the field of transmission planning. This includes beside perceptual-based objective methods also parametric models and a framework for diagnostic functions.
Results related to Recommendations
Consent was reached on
- New Recommendation P.1401, “Methods, metrics and procedures for statistical evaluation, qualifying and comparison of objective quality prediction models”
Agreement was reached on
- New Appendix IV of Rec. G.107, “Use of the E-model in conjunction with noise reduction or echo canceller systems in the network or the terminal equipment”
Other results
The new Recommendations for P.NAMS and P.NBAMS (where the winning groups of models have been determined and have successfully been validated) will be in the new P.1200-series of Recommendations, and the general structure of these Recommendations has been agreed.
To reach consent on these new Recommendations, an additional Working Party 2/12 meeting was agreed to be held on 7 September 2012 in Stockholm, Sweden following the Q14/12 Rapporteur meeting on 6 September at the same venue.
Related activities
SG12 is regularly informed by VQEG and SG9 about their progress in video and multimedia testing. Main topics related to SG12 are at the moment the VQEG Hybrid project, where a visual quality model is developed that makes use of image analysis and IP stream information. The submission for the final candidates of the four contributing parties has been June 6th. Next step is the independent evaluation of the candidate models by VQEG. Another topic in VQEG is 3DTV testing, where SG12 received Liaison Statements about the progress.
Results of the meeting of Working Party 3/12 – Multimedia QoS and QoE
WP3/12 is responsible for conducting studies leading to new Recommendations related to multimedia Quality of Service (QoS) and Quality of Experience (QoE) in emerging networks. This includes operational aspects of QoS/QoE, end to end interworking and traffic management, identification of KPIs and QoS metrics for different services, multimedia performance assessment methods and models, and fundamental performance criteria for packet-based networks.
Results related to Recommendations
Consent was reached on the revision of Recommendation:
- G.1070 “Opinion model for video-telephony applications” - this now includes a speech quality estimation function for wideband speech based on Recommendation G.107.1. In addition, revised Appendix I provides new sets of model coefficients for MPEG4/VGA and H.264/VGA codecs, extending the application of this Recommendation.
and on two new Recommendations:
- Y.1566 (Y.QoSmap) “QoS mapping and inter-connection between Ethernet, IP and MPLS networks” - this simplifies technical Ethernet, MPLS and IP QoS interconnection negotiations. Four ordinary classes and four auxiliary classes have been defined. This set of classes covers a wide range of transport service offerings.
- G.1021 (G.102buff) “Buffer Models for Development of Client Performance Metrics” - this defines buffer models that describe the behaviour of the client buffers used at the receiver side of audio/video applications.
Other results
- A new work item, G.QoEMC, has been created to study the Quality of Experience aspects of services an end user may be participating in, using a device that may change it access network connection technology during an active session.
- Good progress was made on the revision of Recommendation P.800.1 to define terminologies for MOS in different contexts. Furthermore, the scope of this Recommendation is being extended from speech to video and audio.
- A new guideline Recommendation has been initiated to interpret and report MOS values, P.MOS “Mean Opinion Score (MOS) Interpretation and Reporting.”
- Baseline text was agreed for new draft Recommendation G.QRTP “QoE Requirements for Telepresence Services”
Past Executive Summaries:
