This work was performed under the following financial assistance award 70NANB20H005 from U.S. Department of Commerce, National Institute of Standards and Technology, PSCR MCS TaaSTing 1
Mission Critical Services (MCS) Certification • MCS certification Chicken or the Egg issue • No MCS Testing equipment ó no certification programs ó jeopardized customers confidence ó demand for testing equipment in a “niche market” • Meanwhile… • “MCPTT aligned” • 3GPP ready…. • “Certified in the Plugtest” • Avalailable in –your MCS network- app store • 1st in the certification • Public Safety Grade • How am I supposed to write my RFI/RFQ? • How am I supposed to write my tender response? 2/20
MCS Certification: Why it’s More Important Than Ever • First flagship projects deploying MCS solutions • Std. compliance & interop ó innovation and competition • Avoid vendor lock-in from the very beginning X • More certification needs • Much quicker release cycles than in PMR world • More stakeholders and relationships MCS UE vendor A + All-in-one COTS LTE MCS Client from vendor device to be certified B/C/D SERVICE MCS MCS MCS CLIENT IP OS vs. IP OS CERTIFICATION LTE SCOPE? LTE RF RF CERTIFICATION 3/20 SCOPE
Background: different kind of Testing and Certification • Interoperability • Conformance • Performance • Field test 4/20
Interop and Conformance MESSAGE X: Header1 PASS Header2 x …. Header n Body MESSAGE Y: OK VENDOR A VENDOR B MESSAGE X: MESSAGE X: FAILED Header1 Header1 Header2 Wrong Header2 x Missing Header x …. …. Conformance & Interop Header n Header n Vs Body Body Interop & conformance 5/20
How does conformance certification usually work ? 3GPP RAN5 3GPP Core Test Cases Test Specs RAN5_SIG MCC TF160 Test Equipment TC TTCN3 implementation TC prose specification Certification Program Test Equipment Certified Lab 6/20
MCS Conformance testing: status (2019) • No certified MCS test equipment • RAN5 TS (MCPTT/MCData/MCVideo Rel 14) ongoing • Full TTCN3 completion & verification pending • Users’ demand pushing…. • ….but economy of scale and 5G activity delaying the availability • Early initiatives in certification programs • GCF-TTCA-JTF => MCS WI 7/20
MCS Conformance testing: status (2019) 3GPP RAN5 3GPP RAN5 3GPP Core 3GPP Core Testing Testing MCS TS MCS TS RAN5_SIG RAN5_SIG MCC MCC TF160 TF160 Test Test Equipment Equipment TC TTCN3 implementation TC prose specification TC TTCN3 implementation TC prose specification Certification Certification Program Program Test Test Equipment Equipment Certified Certified Lab Lab NIST funding opportunity came to help ! 8/20
Project description FUNDING OPPORTUNITY (NOFO) - NIST Public Safety Innovation Accelerator Program - Mission Critical Voice Test Equipment Ref: https://www.nist.gov/news-events/news/2020/01/pscr-awards-over-6m-rd-supporting-mission-critical-voice-test-equipment 9/20
Project Description KEY FACTS Project lifetime: Dec 2019-Dec 2021 7 Partners led by UPV/EHU 3.6 MUSD Targeting two commercial solutions Ref: https://www.nist.gov/news-events/news/2020/01/pscr-awards-over-6m-rd-supporting-mission-critical-voice-test-equipment 10/20
Definition and development of MCS TaaS platform O3 Objectives TaaS Platform O5 Stable TTCN3 Deployment and rules evaluation of a sample testing lab TTCN3 RAN5 TS troubleshooting analysis TTCN3 tester Client TTCN3 Building a Server UE RF test New rules comprehensive O1 equipment /Upgrades MCS TTCN3 suite MCS experts O4 O2 Development of an e2e RF MCS Definition of flexible testing equipment => eMBMS/MC MCS (re)certification programs 11/20
Expected outcomes at the end of the Project • Enhanced / troubleshooted RAN5 TC • Complete TTCN3 code • TTCN3 tester capable of validating the test cases • TaaS commercial service providing remote access to the tester • RF capable commercial product • Global Certification programs • Testing Lab procedures and experience 12/20
3GPP Test Models • 3GPP RAN5 defines the testing procedures and reference pints to be tested (1) º MCPTT Client MCPTT Server under test simulation System Simulator UE under test Test Point • Also the so called testing models 13/20
MTC Ut PTC_Ut PTC_Ut PTC_Ut 3GPP Test Models Create, Start Done Create, Start Done Create, Start Create, Start Done UT MMI MMI IPCanEmu: EUTRA MCPTT HTTP PTC IPCAN IPCAN MCPTT IMS PTC HTTP IMS IMS S/C IMS_CTRL HTTPCTRL HTTPDATA FloorCtrl TTCN-3 domain Done Uu model vs IP model IMS S/C HTTPCTRL HTTPDATA IMS_CTRL EUTRA_CTRL IP IP PTC ICMPv6 Server- DHCP Server- DNS Server- Simulation Simulation Simulation SYS SYSIND SRB NASCTRL IPsec_CTRL IP_CTRL IP_SOCK SRB NASCTRL NAS EMU Traditional telco equipment SYS_SRB System Interface SRTP IP_SOCK Ut E_SYS E_SYSIND E_SRB IPsec_CTRL IP_CTRL From LTE Phy to MCS (S)RTP/RTCP Complex/Expensive TCP/UDP/ICMP IPsec Traditional testers manufacturers System EUTRA Economy of scale Simulator RF cable RAN5 MCS UE vendor A IUT + (MCPTT UE) MCS Client vendor X MCS MCS CLIENT IP IP OS LTE LTE Uu Reference Point RF RF Test Equipment CERTIFICATION SCOPE 14/20
MTC Ut PTC_Ut PTC_Ut PTC_Ut 3GPP Test Models Create, Start Create, Start Create, Start Done Done Create, Start Done UT MMI MMI IPCanEmu : DUMMY_EUTRA MCPTT HTTP PTC IPCAN IPCAN MCPTT IMS PTC HTTP IMS TTCN-3 IMS S/C IMS_CTRL HTTPCTRL HTTPDATA FloorCtrl domain Done Uu model vs IP model IMS S/C HTTPCTRL HTTPDATA IMS_CTRL EUTRA_CTRL IP IP PTC DHCP Server- DNS Server- ICMPv6 Server- Simulation Simulation Simulation IPsec_CTRL IP_CTRL IP_SOCK OTT testing System Interface Can not guarantee LTE MC features SRTP IP_SOCK Ut IPsec_CTRL IP_CTRL (S)RTP/RTCP eMBMS/MC QCI? TCP/UDP/ICMP System IPsec Simulator KPIS/Integration with UE? IP connection MCS UE vendor A IUT (MCPTT client application) RAN5 + CERTIFICATION MCS Client vendor X SCOPE MCS MCS CLIENT IP IP OS LTE RF Test Any IP Equipment network 15/20
Test Execution Control Testcase Management IP Model and TaaS User Interface ● Version Management ● Configuration ● Upgrades ● Parameterisation ● Review / Feedback Loop ● Status Overview ● Testing as a Service TaaS (pre)certification purposes TTCN3 tester Platform Foster continuous SW integration/testing Test Result Test Execution Management Execute TTCN-3 ● INTERNET Store Test Results MCS UE vendor A ● Testcases Create Reports ● Execute Tools, + ● Wireshark Traces, etc. ● Simulators MCS Client vendor X MCS CLIENT IP OS Client – Server Interface LTE MCS Signalling and media certification RF 16/20
Create, Start DNSServer- MTC MMI_SYS MTC Done Simulation Ut PTC_Ut PTC_Ut Create, Start PTC_Ut Done DHCPServer- DnsServer Create, Start Create, Start MCS TaaSting 1.5 Model Simulation Create, Start Done Create, Start Done Create, Start Create, Start Done UT MMI MMI eIPCanEmu : Create, Start D Done o NOT_THAT_ n MCPTT HTTP PTC IPCAN MCPTT IMS PTC e DhcpServer IPCanCrtl- IPCAN HTTP IMS Create, Start Done DUMMY_EUTRA Component HTTP TTCN -3 IMS S/C IMS_CTRL HTTPCTRL HTTPDATA FloorCtrl domain XCAP PTC IPCAN IPCAN XCAP Done IMS PTC IMS XCAP XCAP IMS S/C HTTPCTRL HTTPDATA IMS_CTRL IMS IPCAN-like model Done IP EUTRA_CTRL (SS implementation) IP PTC ICMPv6 Server - DHCP Server - DNS Server - HTTPCTRL HTTPDATA TaaSting Simulation Simulation Simulation IPCAN_CTRL IMS_Server IMS_Client IMS_CTRL connector XCAP Server IPsec_CTRL IP_CTRL IP_SOCK IMS_Server IMS_Client IMS_CTRL Intermediate Uu ó IP model IP ADAPTOR PTC System Interface SRTP IP_SOCK Ut IPsec_CTRL IP_CTRL IpConf SigComp UnsecClient UnsecServer SecClient SecServer (S)RTP/RTCP MCS testing + RF capable TCP/UDP/ICMP System MMI_SYS Simulator IPCAN_CTRL IPConf SigComp UnsecClient UnsecServer SecClient SecServer IPsec HTTPCTRL HTTPDATA DhcpServer DnsServer MC features SigComp EUTRA TCP/UDP/ICMP RF cable MC QCIs IPsec (MCPTT client application) IUT eMBMS bearer handling System (MCPTT UE) EUTRA / UTRAN / GERAN MCS UE vendor A Adaptor RAN5 + TS 34229-4 TESTING MCS Client vendor X SCOPE MCS MCS CLIENT IP IP OS LTE LTE RF RF Test Equipment MC LTE 17/20
Testcase Management Test Execution Control Version Management ● User Interface ● RF Capable Tester Upgrades ● Configuration ● Review / Feedback ● Parameterisation ● Loop Status Overview ● 1.5 Model TTCN3 MCS tester + MC LTE features TaaS TTCN3 tester Remote controlling / synching Platform Test Result Test Execution Management Execute TTCN-3 ● Store Test Results ● Testcases MCS UE vendor A Create Reports ● Execute Tools, ● Wireshark Traces, etc. ● + Simulators TESTING MCS Client vendor X Synching SCOPE Off-loading MCS INTERNET MCS CLIENT Remote Control IP IP OS LTE LTE Test Execution Control Testcase Management ● ● User Interface Version Management RF ● ● Configuration RF Upgrades ● ● Parameterisation Review / Feedback Loop ● Status Overview Test Equipment MC LTE TTCN3 tester Test Execution Test Result Management ● Execute TTCN-3 ● Store Test Results Testcases ● Create Reports ● Execute Tools, Simulators ● Wireshark Traces, etc. 18/20
Recommend
More recommend