|
Speaker: |
Os Monkewich, PQM Consultants, Vice-chair TC-MTS |
Title of Presentation: Interoperability Testing in ETSI
Currently, ITU-T Recommendations include 7 Recommendations, numbered
X.290 through X.296, that define a methodology for conformance
testing of implementations of protocol Recommendations and another 7
Recommendations, Z.140 through Z.146, that define a notation for
writing test specifications. In addition, SG 17 is standardizing a
similar set of Recommendations to define a testing methodology and
framework for interoperability testing. There is very little
awareness of the existence and content of these Recommendations
although some Study Groups are now addressing NGN testing. This
tutorial is an overview of the testing methodology as it is defined
in these Recommendations. The tutorial presents key methodology
concepts and identifies what additional Recommendations may be
needed to facilitate conformance and interoperability testing. |
|
|
|
Speaker: |
Ina Schieferdecker |
Title of Presentation: The TTCN Test Notation
The Testing and Test Control Notation is a standardized alternative to
proprietary test systems that has been developed by a large group of
testing experts, is used by a growing community with proven by tools. It
is both a test specification and test implementation language. Its
multipart standard covers e.g. the textual TTCN-3 core, the graphical
TTCN-3 presentation format, the execution interfaces TRI and TCI, and
language mappings to TTCN-3 such as for ASN.1. It is continuously
maintained at ETSI.
TTCN-3 is dedicated for conformance, interoperability and performance
testing.
It is the choice for technical testing and automated test execution. It
supports the development of telecommunication, Internet and IT standards
via well-defined test suites.
This presentation gives an overview on TTCN-3, its standard series, its
history; it reviews the main concepts and gives a small handy example.
The presentation discusses different aspects of TTCN-3 based test
systems and presents finally new results in applying TTCN-3 for IMS
Benchmarking.
|
|
|
|
Speaker: |
Ultan Mulligan, Protocol & Testing
Competence Centre (PTCC) - ETSI |
Title of Presentation: ETSI white paper on Interoperability
This White Paper presents an overview of the approach of ETSI (The
EuropeanTelecommunications Standards Institute) to ensure
interoperable standards. It provides a short description of the
meaning of Technical Interoperability followed by an analysis of the
implications that this has on standardization. Of special interest
is the growing impact that multi-organizational standardization has
on interoperability.
The goal of ETSI is to ensure that instances of non-interoperability
are not caused by poor or insufficient standardization. This White
Paper describes the various processes and engineering principles
applied by the ETSI membership in the development of Information and
Communication Technologies (ICT). Attention is given to the
importance of sound project management, good specification
techniques, validation and testing. A short introduction to various
types of testing is given, culminating in an insight into how
combinations of these methods may be applied to address
interoperability issues in complex ICT systems.
ETSI initiatives on interoperability such as the appointment of an
Interoperability Champion, and the work of its Technical Committees
(TC) such as TC MTS are also presented. The White Paper describes
the significant effort the ETSI membership puts into testing and
validation activities supported by the ETSI Protocol and Testing
Competence Centre (PTCC) and the ETSI Plugtests™ Service.
|
|
|
|
Speaker: |
Steve Randall, PQM Consultants, Vice-chair TC-MTS |
Title of Presentation: Interoperability Testing in ETSI
Although standards bodies have traditionally concentrated upon the
development of conformance test specifications for their base
protocols, pressure has been growing for guidance on writing
interoperability tests. ETSI's response is an interoperability
testing methodology which draws heavily on ISO9646 and which should
be seen as complementary to conformance testing rather than a
replacement. This methodology is only one part of ETSI's overall to
assuring interoperability.
The interoperability methodology identifies a number of fundamental
components which include:
- The Equipment Under Test (EUT)
Not previously tested- Qualified Equipment (QE)
Already tested successfully - Test Driver
Human or machine test operative - Test Coordinator
Human or machine test controller and synchronizer
The test specification process involves the following steps, manu of
which are recognizable as ISO9646 derivatives:
- Specifying abstract architectures
- Writing an Interoperable Functions Statement (IFS) which is the
interoperability testing equivalent of a PICS
- Specifying a Test Suite Structure (TSS)
- Writing Test Purposes (TPs)
- Writing Test Cases
- Validating Test Cases
ETSI's interoperability testing methodology has already been used in
a number of projects and has been revised to reflect practical
experience. Although the testing aspects of interoperability are
considered to be important, it is "Design for Interoperability" that
is the cornerstone of ETSI approach to this issue.
|
|
|
|
Speaker: |
Steve Randall, PQM Consultants, Vice-chair TC-MTS |
Title of Presentation: IPv6 Test Activities within ETSI
ETSI TC-MTS has been developing both interoperability and
conformance test specifications for IPv6 since the beginning of 2005
when it was awarded funds by the European Commission for this
activity.
As this is the first major testing project within ETSI where it has
no influence on the base protocol specifications, a different
approach to the overall process had to be considered. It is this
approach which is summarized here.
The ETSI IPv6 Testing Framework comprises 4 major elements which
are, the requirements extraction process, the specification of
interoperability tests (based on TS 102 237 1), the specification of
conformance tests (based on ISO 9646) and the compilation of an open
testing library.
IPv6 requirements are extracted from the multitude of IETF RFCs into
a single catalogue (database) where they are categorized by type,
target and functional grouping. From these requirements, test
purposes for both interoperability and conformance are written using
ETSI's new TP notation, TPLan. Interoperability tests have been
specified as tabulated plain text whereas the conformance test cases
have been written in TTCN-3. Test purposes, test cases and TTCN-3
libraries will all be made available for browsing and download on an
open web site at the end of the project.
Currently, test specifications exist for the IPv6 Core requirements
as well as for IPsec and MIPv6. Those for IPv4 to IPv6 transitioning
are still under development.
|
|
|
|
|
|
