ITU Home Page International Telecommunication Union Franšais | Espa˝ol 
Print Version 
ITU Home Page
Home : ITU-T Home : Workshops and Seminars : Conformance and Interoperability Testing
 Second Informal Workshop on Conformance and Interoperability Testing

Speaker: Os Monkewich,  PQM Consultants, Vice-chair TC-MTS
Title of Presentation: Interoperability Testing in ETSI

Currently, ITU-T Recommendations include 7 Recommendations, numbered X.290 through X.296, that define a methodology for conformance testing of implementations of protocol Recommendations and another 7 Recommendations, Z.140 through Z.146, that define a notation for writing test specifications. In addition, SG 17 is standardizing a similar set of Recommendations to define a testing methodology and framework for interoperability testing. There is very little awareness of the existence and content of these Recommendations although some Study Groups are now addressing NGN testing. This tutorial is an overview of the testing methodology as it is defined in these Recommendations. The tutorial presents key methodology concepts and identifies what additional Recommendations may be needed to facilitate conformance and interoperability testing.
Speaker: Ina Schieferdecker
Title of Presentation: The TTCN Test Notation

The Testing and Test Control Notation is a standardized alternative to proprietary test systems that has been developed by a large group of testing experts, is used by a growing community with proven by tools. It is both a test specification and test implementation language. Its multipart standard covers e.g. the textual TTCN-3 core, the graphical TTCN-3 presentation format, the execution interfaces TRI and TCI, and language mappings to TTCN-3 such as for ASN.1. It is continuously maintained at ETSI.

TTCN-3 is dedicated for conformance, interoperability and performance testing.
It is the choice for technical testing and automated test execution. It supports the development of telecommunication, Internet and IT standards via well-defined test suites.

This presentation gives an overview on TTCN-3, its standard series, its history; it reviews the main concepts and gives a small handy example. The presentation discusses different aspects of TTCN-3 based test systems and presents finally new results in applying TTCN-3 for IMS Benchmarking.
Speaker: Ultan Mulligan, Protocol & Testing Competence Centre (PTCC) - ETSI
Title of Presentation: ETSI white paper on Interoperability

This White Paper presents an overview of the approach of ETSI (The EuropeanTelecommunications Standards Institute) to ensure interoperable standards. It provides a short description of the meaning of Technical Interoperability followed by an analysis of the implications that this has on standardization. Of special interest is the growing impact that multi-organizational standardization has on interoperability.

The goal of ETSI is to ensure that instances of non-interoperability are not caused by poor or insufficient standardization. This White Paper describes the various processes and engineering principles applied by the ETSI membership in the development of Information and Communication Technologies (ICT). Attention is given to the importance of sound project management, good specification techniques, validation and testing. A short introduction to various types of testing is given, culminating in an insight into how combinations of these methods may be applied to address interoperability issues in complex ICT systems.

ETSI initiatives on interoperability such as the appointment of an Interoperability Champion, and the work of its Technical Committees (TC) such as TC MTS are also presented. The White Paper describes the significant effort the ETSI membership puts into testing and validation activities supported by the ETSI Protocol and Testing Competence Centre (PTCC) and the ETSI Plugtests™ Service.

Speaker: Steve Randall,  PQM Consultants, Vice-chair TC-MTS
Title of Presentation: Interoperability Testing in ETSI

Although standards bodies have traditionally concentrated upon the development of conformance test specifications for their base protocols, pressure has been growing for guidance on writing interoperability tests. ETSI's response is an interoperability testing methodology which draws heavily on ISO9646 and which should be seen as complementary to conformance testing rather than a replacement. This methodology is only one part of ETSI's overall to assuring interoperability.
The interoperability methodology identifies a number of fundamental components which include:
  • The Equipment Under Test (EUT)

  • Not previously tested
  • Qualified Equipment (QE)
    Already tested successfully
  • Test Driver
    Human or machine test operative
  • Test Coordinator
    Human or machine test controller and synchronizer
The test specification process involves the following steps, manu of which are recognizable as ISO9646 derivatives:
  • Specifying abstract architectures
  • Writing an Interoperable Functions Statement (IFS) which is the interoperability testing equivalent of a PICS
  • Specifying a Test Suite Structure (TSS)
  • Writing Test Purposes (TPs)
  • Writing Test Cases
  • Validating Test Cases
ETSI's interoperability testing methodology has already been used in a number of projects and has been revised to reflect practical experience. Although the testing aspects of interoperability are considered to be important, it is "Design for Interoperability" that is the cornerstone of ETSI approach to this issue.
Speaker: Steve Randall,  PQM Consultants, Vice-chair TC-MTS
Title of Presentation: IPv6 Test Activities within ETSI

ETSI TC-MTS has been developing both interoperability and conformance test specifications for IPv6 since the beginning of 2005 when it was awarded funds by the European Commission for this activity.
As this is the first major testing project within ETSI where it has no influence on the base protocol specifications, a different approach to the overall process had to be considered. It is this approach which is summarized here.
The ETSI IPv6 Testing Framework comprises 4 major elements which are, the requirements extraction process, the specification of interoperability tests (based on TS 102 237 1), the specification of conformance tests (based on ISO 9646) and the compilation of an open testing library.
IPv6 requirements are extracted from the multitude of IETF RFCs into a single catalogue (database) where they are categorized by type, target and functional grouping. From these requirements, test purposes for both interoperability and conformance are written using ETSI's new TP notation, TPLan. Interoperability tests have been specified as tabulated plain text whereas the conformance test cases have been written in TTCN-3. Test purposes, test cases and TTCN-3 libraries will all be made available for browsing and download on an open web site at the end of the project.
Currently, test specifications exist for the IPv6 Core requirements as well as for IPsec and MIPv6. Those for IPv4 to IPv6 transitioning are still under development.



Top -  Feedback -  Contact Us -  Copyright ę ITU 2007 All Rights Reserved
Contact for this page : TSB EDH
Updated : 2006-12-13