ITU Forum on Conformance & Interoperability For the Arab & African ...

ITU Forum on Conformance & Interoperability For the Arab & African Regions, 5-7 November 2012 Tunisia Session 5: Building Test Labs

S5-5: Testing Laboratory Experience in the ARB Region

AlaaAlDin (Aladdin) Al-Radhi ICT / Telecom / Internet: Strategist & Consultant [email protected] , [email protected] 6 November 2012

1

Agenda

1

Quick C & I Background

2

Arab Cases & Practices

3

Arab Conclusions & Recommendations

4 6 November 2012

Annex:

ITU Reference Works

Main Talk

Quick Wrap -Up Recall 2

Agenda

1

6 November 2012


3

1


Conformity Assessments & Conformance Testing

• The processes used to demonstrate that a product (tangible) or a service or a management system or body meets specified requirements. • These requirements are developed by the International Organization for Standardization (ISO) & the International Electrotechnical Commission (IEC). The processes that need to be followed to be able to demonstrate that they meet the requirements are also developed by ISO/IEC. • The ISO committee on Conformity Assessment (CASCO), develops standards & guides for conformity assessment and these documents are referred to the CASCO toolbox 6 November 2012

www.iso.org/iso/casco_toolbox

4

CASCO toolbox standards & guides for telecommunication sector 1 / 2 ISO/IEC 17000:2004 : Conformity assessment –Vocabulary and general principles ISO/IEC 17011:2004 : Conformity assessment – General requirements for accreditation bodies accrediting conformity assessment bodies ISO/IEC 17020:1998: General criteria for the operation of various types of bodies performing inspection ISO/IEC 17021:2011: Conformity assessment – Requirements for bodies providing audit and certification of management systems ISO/IEC 17024:2003: Conformity assessment – General requirements for bodies operating certification of persons ISO/IEC 17025:2005/Cor 1:2006: General requirements for the competence of testing and calibration laboratories ISO/IEC 17030:2003: Conformity assessment – General requirements for third-party marks of conformity

1

• • • • • • •


6 November 2012


5

CASCO toolbox standards & guides for telecommunication sector 2 / 2 ISO/IEC 17040:2005: Conformity assessment – General requirements for peer assessment of conformity assessment bodies and accreditation ISO/IEC 17043:2009: Conformity assessment – General requirements for proficiency testing ISO/IEC 17050:2004: Conformity assessment – Supplier’s declaration of conformity ISO/IEC Guide 65:1996: General requirements for bodies operating product certification systems ISO/IEC Guide 67:2004: Conformity assessment – Fundamentals of product certification ISO/IEC Guide 68:2002: Arrangements for the recognition and acceptance of conformity assessment results

1

•

• • • • •


6 November 2012


6

1


Interoperability Testing Operator Side

Customer Side

• Network capabilities for support of services including number format, identification, authentication; • Network architecture and functional requirements of network elements; • Access network and terminal types; • Scenarios for service assignment; • Traffic flow characteristics; • Protocol and interface types; • Interworking with non-NGN networks; • Interworking with other services 6 November 2012

7

The ECO System

SDO SDO SDO

I t e r o p

Regulator Performance, Conformance, Interoperability

Operator/ Service Provider

Service Delivery

Consumer

Equipment Type Approval

Vendor 6 November 2012

Source: Dr. Roman Kužnar, Sintesio, (Matej Žontar, SIQ) ITU CIS/EU CIT Forum

8

1 • • • • • • • • • • • •


Technologies Testing Focus

NGN Architecture & Services Fixed-Mobile Convergence Mobile Multimedia Broadcast/Multicast Optical Networks Multimedia and IPTV QoS, Security and Identity Management Emergency Communications Smart Grid Cloud Computing IPv6 …etc

6 November 2012

9

1


Testing Specifications: Who is Who

ITU-T test Specifications : Conformity Database Project & Recommendations • NGN Architecture & Services • Fixed-Mobile Convergence • Optical Networks • Broadband Cable • Multimedia, IPTV • ISDN • QoS OMA (Open Mobile Alliance) • Security www.openmobilealliance.org 6 November 2012

www.arib.or.jp

Alliance for Telecomm Industry Solutions www.atis.org Telecomm Industry Association www.tiaonline.org/ European Telecomm Standards Institute www.etsi.org

IETF (Internet Engineering Task Force) www.ietf.org 10

1


Test Centers

Types Purpose 1. Private: Belong to OEMs & Testing laboratories  Conformance testing of 2. International / Regional: Tests equipment to meet equipment to meet Standards specific standards & (ISO) & ITU Recommendations. specifications as specified e.g. by vendors, SPs, & • ETSI Plugtests network operators.  Interoperability testing of • ZNIIS: Russian Central Scientific Research equipment on networks. Institute www.zniis.ru  Testing & evaluation of equipment which employs • University of Hampshire IOL (Interoperability Lab) new technologies before www.iol.unh.edu deployment in networks 6 November 2012

www.etsi.org/Website/OurServices/Plugtests/home.aspx

11

1


MRA: Mutual Recognition Agreements / Arrangements

• Help avoid the cost of duplicative testing: Once in the exporting country & again in the importing country • Test once, Use any where! Will reduce testing costs

6 November 2012

12

1


Accreditation Bodies

International Laboratory Accreditation Cooperation (ILAC) www.ilac.org • To develop a global network of accredited testing Labs • Has 3 Regional Cooperation Bodies & MRAs: 1. Asia Pacific Lab Accreditation Cooperation (APLAC) 2. EU co-operation for Accreditation (EA) 3. Inter-American Accreditation Cooperation (IAAC) www.european-accreditation.org 6 November 2012

www.aplac.org

International Accreditation Forum (IAF) www.iaf.nu • To establish Multilateral Recognition Arrangements (MLA), between its members. • Has 3 regional groups: 1. The EU co-operation for Accreditation (EA) 2. The Pacific Accreditation Cooperation (PAC) 3. The Inter-American Accreditation Cooperation (IAAC).

www.iaac.org.mx

13

Agenda

2

6 November 2012


14

2


NTRA Egypt

www.tra.gov.eg/english/main.asp?

Compliance with International Standards Standards

Organization

Telecom / Radio

ITU, ETSI, ASA, FCC

EMC / EMI

CENELEC, IEC, ASA

Safety / Health

CENELEC, IEC, ASA, UL, FCC

6 November 2012

15

2


NTRA Egypt www.tra.gov.eg/english/main.asp?

• Light Regime: Declaration of Conformity certificate “DoC” or “FCC ID”, (USA, Canada, EU, Japan, South Korea, Australia), • Tight Regime: Test reports from accredited international test labs over the 5 continents, (Other countries not including China), • Special Regime: Verification of Conformity certificate (VoC) & Preshipment verification from NTRA accredited labs in China, 6 November 2012

Source: dr. Roman Kužnar, Sintesio, (Matej Žontar, SIQ) ITU CIS/EU CIT Forum

16

2


NTRA Egypt

NTRA Accredited Test Labs in China

1. China Telecommunication Technology Labs www.chinattl.com 2. Intertek China www.intertek.com 3. SGS-CSTC Standards Technical Services Co., Ltd. www.sgs.com 4. Bureau Veritas ADT www.cn.bureauveritas.com 5. TÜV Rheinland Group Greater China www.chn.tuv.com 6 November 2012

www.tra.gov.eg/english/main.asp?

17

2


NTRA Egypt

NTRA ICT TE Test Lab 

Wireless TE Test Set (3 MHz to 6 GHZ) Signalling test Mobile GSM 2G/3G,CDMA 2000 FWT, Cordless Phones .9/2.4/5.8 GHz, HF/VHF/UHF Transceivers);



1.88-1.9Ghz phones;



Analogue wired phones;



EMC Test system (Immunity/Emission, Semi-anechoic

chamber) (RFP – Jan 2012); 6 November 2012


18


2

Central DB solution NTRA ‘Master’ EIR “NTRA database”

NTRA Egypt

Develop National Black list Management of all EIR data

Developed International White List ranges

System LVL

GSMA Global Database (GSMA Agreement)

Lists & configuration data

Master/Slave relationship (download-reporting)

Vodafone ‘Slave’ EIR

Etisalat ‘Slave’ EIR

MobiNil ‘Slave’ EIR

Network LVL Operation / Authentication

Check IMEI requests with Black, White responses

SS7

SS7

MSC

MSC

Vodafone network 6 November 2012

Etisalat network

SS7 MSC

MobiNil network


19

2


UAE Telecom Lab

• ADSL (Asymmetric Digital Subscriber Line) • Cable Modems • FAX Machine • GSM (Global System for Mobiles) and In order to obtain the 3G Handsets Type Approval and Site • Hybrid Systems (Large Key System) Approval Application • Key Telephone Systems Documents, you need to • Leased Line Backup & ISDN Audio contact UAE Conferencing Telecommunications • Modems Regulatory Authority • PABX (Private Automatic Branch (TRA) www.tra.ae Exchange) 6 November 2012

www.uaelab.ae/Products/Products.htm

20

2


• • • • •

UAE Telecom Lab

Pagers POS (Point of Sale Terminals) Telephones Telex Machine Terminal Adapter & Network Terminal • VCS (Video Conferencing Systems) • WLAN (Wireless Local Area Network) 6 November 2012

In order to obtain the Type Approval and Site Approval Application Documents, you need to contact UAE Telecommunications Regulatory Authority (TRA) www.tra.ae

www.uaelab.ae/Products/Products.htm

21

2


Public Networks

CERT Tunisia Technical Acceptance Profile

• Switching and data processing systems:  Switching systems (AXE, EWSD, OCB ,HC3,C&C08, etc.)  Data switching systems (X25, ATM, FR,…)  Mobile networks (UMTS, GSM, GPRS)  ISDN (Integrated Services Digital Network )  IN (Intelligent Network) and NGN networks  UMTS core network • Transmission systems:  Digital TX systems SDH/PDH on optical fibers & microwaves,  Mobile networks GSM/GPRS and TETRA (Radio Sub system)  Optical fiber civil work 6 November 2012

www.cert.nat.tn/?cont_id=00168&lang=EN

22

2


Public Networks

CERT Tunisia

Technical Acceptance Profile

• Access Networks: Distribution networks (copper, optical…) WLL (Wireless Local Loop ) • Telecommunication Environment: Power supply and Air Condition equipments Fire detection and extinction systems 6 November 2012

Private Networks • Communication Systems:  PABXs  Call centers  LAN Buildings Cabling  WAN Sites Interconnection  WIFI networks • Information Systems:  Server  ATM  System security.

www.cert.nat.tn/?cont_id=00168&lang=EN

23

2


Go Global Compliance USA

• Middle East and North Africa Certifications:  Algeria  Bahrain  Egypt  Jordan  Kuwait  Lebanon  Morocco  Oman  Qatar  Saudi Arabia  Tunisia  United Arab Emirates (UAE) • Services Covered:  Safety/EMC Certifications, Certificates of Compliance (CoC)  Wireless and Telecom Type Approvals • Partnerships Certificates 6 November 2012

www.goglobalcompliance.com/services

24

2


www.citc.gov.sa 6 November 2012

CITC, KSA IPv6 Test Lab

www.ipv6.org.sa/testlab

25

Agenda

Arab Conclusions 3

& Recommendations

6 November 2012

26

Current Arab 3 Region Image • Reliance on TA (Type Approval) process. • Mostly relay on globally recognized Standards & accredited Labs. • Some have testing facilities but generally NOT accredited. • NO interoperability requirements or testing by regulators towards operators • Counterfeit equipment (mainly China-Made) is a problem, specially in the mobile sets • Regional Test Labs have difficulties to finance. • Some regulators are reluctant about MRAs because of revenues reduction i.e. loss of TA fees. Arab Conclusions & recommendations

6 November 2012

27

3

Arab Conclusions & recommendations

The Way Forward

• Advise ITU of interoperability problems • Regulators to establish market access requirements & prioritize areas • Regulators to simplify related C & I regulations • Establishment of Accreditation Bodies & MRAs setup • Technical Skills build-up • Establishment of local / regional Test Centers • Network-like test centers (common infrastructures) to reduce costs & share experiences • Develop an inventory & mapping of available resources • Partnerships with industry, vendors, operators, etc • Local & regional interactive sessions: Challenges, Possible bi-lateral collaborations, Best practices, Action Steps, International aid, Strategies, etc 6 November 2012

28

3


The Way Forward Interactive Sessions

Courtesy Use f ITU Forms Pillar 1: Conformity Assessment

Pillar 2: Interoperability Events

Pillar 3: Capacity Building

Pillar 4: Regional test centers

Main obstacles ? Strategies / Action Steps ? International Aid ? Others ? 6 November 2012

29

3


WORLDWIDE TEST LABS 1

• USA NIST http://ts.nist.gov/standards/scopes/programs.htm http://ts.nist.gov/standards/scopes/ect.htm • AUSTRALIA www.austest.com.au/about_us.php • European http://start.europadev.com/Home/consultancy-1 • A4Labs www.at4wireless.com/testing-certificationservices/accreditations.html • TUNISIA www.cert.nat.tn 6 November 2012

30

3


WORLDWIDE TEST LABS 2

• MIDDLE EAST www.uaelab.ae/UAELAB/about_UAELAB.htm www.goglobalcompliance.com/ www.ntra.gov.eg/arabic/main.asp www.contractlaboratory.com/labclass/telecommunications.cfm • RUSSIAN FEDERATION http://zniis.ru/ITTC.html • CANADA – INDUSTRY CANADA www.ic.gc.ca/eic/site/smt-gst.nsf/eng/home • AFRICA, CHINA, ASEAN, CIS, LATIN AMERICA TEST LABS (Link to ITU webpage) www.itu.int/dms_pub/itut/oth/06/24/T06240000010009MSWE.doc 6 November 2012

31

Agenda

Annex: 4

6 November 2012

ITU Reference Works

Quick Wrap -Up Recall

32

ITU Conformity & Interoperability Portal http://www.itu.int/net/ITU-T/C-I/ • The ITU Conformity and Interoperability (C&I) Programme Concepts and Guidance • ITU Conformity Database

• Interoperability and “ITU Interop Events” • Capacity Building & Guidelines for establishing test centers • Vendors, Industry, Testing • Laboratories • Standards Developing Organizations & International Organizations 6 November 2012

Contact on conformity: [email protected] Contact on interoperability: [email protected]

33

The ITU 4 “Pillars” Standards Side:  Conformity Assessment  Interoperability Events Developments Side:  Capacity building  Establishment of test centres in developing countries.

6 November 2012

34

The ITU Conformity Database DB http://www.itu.int/net/ITU-T/conformity/cdb.aspx

• Informative & voluntary database open both to members & non-members • Adoption of international ISO/IEC standards & guidelines or self-assessment approach • On-line entries directly made by Companies • ITU is not participating in any Testing / Certification activities 6 November 2012

35

Populating the ITU-T conformity DB 1. Companies can populate the DB via registering online & Choose among 4 routes: http://www.itu.int/net/itut/cdb/secured/Register.aspx

6 November 2012

http://www.itu.int/net/ITU-T/conformity/cdb.aspx

36

Populating the ITU-T conformity DB 2. Companies can populate the DB via registering online & Choose among 4 routes: http://www.itu.int/net/itut/cdb/secured/Register.aspx 2. PRODUCT

2.1 Name of product:

2.2 Enter a Category:

(e.g. DSLAM, modem, ADSL, optical fiber, home networking, WDM, multimedia, IPTV etc.)

2.3 Comments/Re marks: (e.g. main functionalities implemented, etc.) 6 November 2012


37

Populating the ITU-T conformity DB 3. Companies can populate the DB via registering online & Choose among 4 routes: http://www.itu.int/net/itut/cdb/secured/Register.aspx 3. ITU-T RECOMMENDATION(S) IMPLEMENTED IN THE PRODUCT

3.1 Please select from the list below ITU-T Recommendations that are implemented in your product.

Select Series:

3.2 Comments/Remarks:

6 November 2012

Select Number:

(Insert here edition of Recommendations if different from the one in force at the moment of submission of the form and/or number/series of national/regional standards adopted as equivalent to ITU-T Recommendation(s), e.g. NMR 234/G.992.2; XYZ123/H.264)


38

Populating the ITU-T conformity DB 4. Companies can populate the DB via registering online & Choose among 4 routes: http://www.itu.int/net/itut/cdb/secured/Register.aspx

Drop Menu to Choose From

6 November 2012


39

Populating the ITU-T conformity DB 5. Companies can populate the DB via registering online & Choose among 4 routes: http://www.itu.int/net/itut/cdb/secured/Register.aspx Route 1: Testing performed by a laboratory accredited as per ISO/IEC 17025 (Rec. ITU-T X.290 applies). A Supplier’s Declaration of Conformity (SDoC) prepared according to ISO/IEC 17050 standard has to be submitted to ITU to populate the ITU conformity database;

Route 2: Testing performed according to procedures adopted by a Certification Body accredited as per ISO/IEC Guide 65 (Rec. ITU-T X.290 applies) which issues a Certificate of Conformity. The Certification Body is fully responsible for the certification process that may include tests performed in a non accredited Lab. An SDoC (ISO/IEC 17050) is submitted to ITU to populate the ITU database.

6 November 2012


40

Populating the ITU-T conformity DB 5. Companies can populate the DB via registering online & Choose among 4 routes: http://www.itu.int/net/itut/cdb/secured/Register.aspx Route 3: Testing performed in laboratories recognized by an SDO or Forum or Consortium qualified as per Recommendation ITU-T A.5 or by an Organization signatory of an MoU with the ITU. (Rec. ITU-T X.290 applies). A Conformity Statement is issued by the Laboratory and an SDoC is submitted to ITU to populate the ITU database. Route 4: For ITU members only. Self-assessment procedure directly performed by the vendor. A Conformity Declaration is submitted by the vendor to populate the ITU database. Please note that criteria to populate the database under Route 4 are under review. Should the criteria be changed, entries already posted in the database introduced using Route 4 would be tagged as such and all future entries would be required to comply with the revised criteria.

6 November 2012


41

ITU Approach: ISO/IEC assessment & self-assessment procedures. Route 1: Accredited Testing Laboratories Route 2: Accredited Certification Bodies Route 3: Laboratories recognized by ITU-T A.5 qualified organizations or MoUs signatories Route 4: for ITU members only 6 November 2012

42

4 routes to populate conformity DB ISO/IEC Assessment Procedures

Conformity Assessment & Certification

Route 1

Tests performed by an accredited lab (ISO/IEC 17025) (Rec. ITU-T X.290)

Recommendation(s) compliant test results

Self-assessment Procedures

Route 2

Route 3

Route 4

Tests performed in a lab agreed by an Accredited Certification Body (ISO/IEC 17065) (Rec. ITU-T X.290)

Tests performed in a lab selected by an ITU-T A.5 agreed SDO/Forum/MoUs (Rec. ITU-T X.290)

ITU Members Only

Conformity Certificate issued by the Certification Body

Recommendation(s) compliant test results

Tests performed in any lab

Self-Declaration of Compliance issued by the Supplier

ITU C&I services

Supplier’s Declaration of Conformity (SDoC) (ISO/IEC 17050)

6 November 2012

ITU Conformity Database 43

ITU virtual Laboratory for remote tests of equipment, new technologies & services http://www.itu.int/ITU-D/projects/display.asp?ProjectNo=CALL-06

• Currently being developed in ITU-T : A powerful testing & training tool for regional test centers. • The objective is to provide remote access to an NGN model network for testing new technology equipment & services • Benefits: Reduced test preparation time Availability & use of expensive test equipment via a remote interface; Testing Procedures & automation Reduced testing costs compared with on-site tests 6 November 2012

44

6 November 2012

45

ITU virtual Laboratory Status • ITU & FSUE ZNIIS Russia start collaboration in the field of Virtual laboratory creation on the basis of the ITU – FSUE ZNIIS International Telecommunication Testing Center ITTC project • The project currently; – Seeking Funds – Call for Partners • Interested to have information? Write to : [email protected] Subject Title: Request Information about Project CALL-06 6 November 2012

http://www.itu.int/ITU-D/projects/display.asp?ProjectNo=CALL-06

46

“Handbook on Testing”, ITU-T, November 2011

6 November 2012

www.itu.int/ITUD/tech/events/2011/CI_Moscow_November11/Presentations/Session2/SeminarCI_20 11_CIS_Presentation_JPieczerak_S2_3.pdf

47

ITU Guidelines for developing countries on establishing conformity assessments test labs in different regions May 2012

www.itu.int/ITU-D/tech/ConformanceInteroperability/ConformanceInterop/Guidelines/Test_lab_guidelines_EV8.pdf 6 November 2012

48

ITU Conclusions & Recommendations • Members to advise the ITU of interoperability problems, their mitigation, & successful procedures that were helpful in the process: http://groups.itu.int/itut/StandardsQA.aspx • Members to establish market access requirements for telecom equipment to avoid interference, and safety of life issues in their marketplace. • Members to examine their existing legislation and regulations to ensure that they enable participation in MRAs on Conformity • Assessment and testing with foreign partners 6 November 2012

49

ITU Conclusions & Recommendations • Members to prioritize areas of concern related to telecommunication products and systems • Accreditation bodies in member states should become signatories of the ILAC MRA or the IAF MLA. • Test centers should be established on a regional basis to take advantage of the similar networks in a region with common infrastructures • Make use of ITU training: http://academy.itu.int • Focus on the Test Centers as a Centre of Excellence CoE • Interoperability testing should utilize the model network concept under development in ITU-T 6 November 2012

50

6 November 2012

51