Assessing compliance of 5G device (implementations) to ...
Transcript of Assessing compliance of 5G device (implementations) to ...
Presented by: For:
© ETSI 2018
13.12.2018
Assessing complianceof 5G device (implementations)
to 3GPP standards
Olivier Genoud (ETSI CTI) Joint ETSI - OSA Workshop
© ETSI 2018 2
Agenda
3GPP RAN5 for UE conformance testing,
The TF160 Project,
Our 5G test suites,
Interworking with OAI.
Agenda
© ETSI 2018
RAN5 & conformance
testing
© ETSI 2018 4
3GPP: Organization structure
TSG = Technical Specification Group
WG = Working Group
TSG RANRadio Access Network
RAN WG1Radio Layer 1 spec
RAN WG2Radio Layer 2 spec
Radio Layer 3 RR spec
RAN WG3lub spec, lur spec, lu spec
UTRAN O&M requirements
RAN WG4Radio Performance
Protocol aspects
RAN WG5Mobile Terminal
Conformance Testing
RAN WG6GSM EDGE
Radio Access Network
TSG SAService & Systems
Aspects
SA WG1Services
SA WG2Architecture
SA WG3Security
SA WG4Codec
SA WG5Telecom Management
SA WG6Mission-critical
applications
TSG CTCore Network & Terminals
CT WG1MM/CC/SM (lu)
CT WG3Interworking with external
networks
CT WG4MAP/GTP/BCH/SS
CT WG6Smart Card Application
Aspects
Project Co-ordination Group (PCG)
© ETSI 2018 5
3GPP RAN WG5 (RAN5) – Scope
RAN5Develops conformance test specifications for the UE
(User Equipment)
Technology scope: 2G, 3G, 4G, 5G
RAN5_SIG sub-group RAN5_RF sub-groupProtocol & signalling tests Radio Frequency (RF) tests
Uu radio interface (including NAS) for NR, E-UTRA, UTRA, GERAN
Radio Resource Management (RRM) tests
Gm interface for IMS, including profiles (e.g. GSMA IR.92/IR.94)
Radio performance tests
Inter-RAT between 3GPP & non-3GPP radio technologies (CDMA2000, WLAN)
RAN-CNInterface
RAN-CNInterface
RAN-CNInterface
(e)LTE
eNBgNBgNB
Inter-BSInterface
Core
The Network
Uu, Gm i/f
The UE
Conformance testing: involves connecting a device to a test system and operating a set of stringently defined tests. This ensures that a (single) product correctly implements the requirements laid down in a standard.
© ETSI 2018 6
RAN5 – Scope
TSG = Technical Specification Group
WG = Working Group
TSG RANRadio Access Network
RAN WG1Radio Layer 1 spec
RAN WG2Radio Layer 2 spec
Radio Layer 3 RR spec
RAN WG3lub spec, lur spec, lu spec
UTRAN O&M requirements
RAN WG4Radio Performance
Protocol aspects
RAN WG5Mobile Terminal
Conformance Testing
RAN WG6GSM EDGE
Radio Access Network
TSG SAService & Systems
Aspects
SA WG1Services
SA WG2Architecture
SA WG3Security
SA WG4Codec
SA WG5Telecom Management
SA WG6Mission-critical
applications
TSG CTCore Network & Terminals
CT WG1MM/CC/SM (lu)
CT WG3Interworking with external
networks
CT WG4MAP/GTP/BCH/SS
CT WG6Smart Card Application
Aspects
Project Co-ordination Group (PCG)
RAN5_SIG
RAN5_RF
Core requirements being subject to conformance tests:
© ETSI 2018 7
RAN5 – DeliverablesSeries of technical specifications in prose specifying the conformance test cases in great details.
But not only…
© ETSI 2018
The TF160 Project
© ETSI 2018 9
RAN5_SIG – Reference implementation of test cases
RAN5 provides also to the industry a formal & standardised implementation of the (RAN5_SIG) protocol/signalling test cases (TC).
Reference implementation developed in TTCN-3 language.
TTCN-3: advanced language for testing, standardized at ETSI.
RAN5 delegated the task of transferring RAN5_SIG test cases from prose to TTCN-3 code to Task Force 160 (TF160).
RAN5 coordinates & provides guidelines to TF160 on the priorities in the implementation of test cases in TTCN-3.
RAN5_SIG
TC prose specification
TF160
TC TTCN implementation
e.g. TS 38.523-1,TS 38.523-2 TTCN files
3GPP core specse.g. TS 38.331
© ETSI 2018 10
3GPP Task Force 160 – Project Tasks1. Specify the test architecture(s) and test model(s) required to be able to implement the RAN5 protocol
conformance test cases of different technologies.
2. Specify a 3GPP standardized system interface, used to control the System Simulator, and built around a modelling of the 3GPP protocol stacks and test cases needs.
3. Develop and maintain:
a reference implementation of the protocol signalling test cases,
in TTCN-3 language.
4. Deliver the test cases TTCN-3 source code to the community
via regular (2-/3-monthly) deliveries,
accessible/downloadable as a 3GPP deliverable.
1
1
2
2
3
3
4
© ETSI 2018 11
3GPP Task Force 160 – Project structure (2018)
Funders Project members
UE/Chipset Vendors TE Vendors Alliance / Institute
20 protocol/testing experts from 3GPP member companies:
Logisticsprovides:
Project management services: an ETSI CTI staff appointed as TF160 leader,
Hosting services: IT, administrative matters, offices.
© ETSI 2018 12
3GPP Task Force 160 – Technical scope
Develops and maintains a set of 20 test suites (over 4000 test cases), for:
3G UTRA/NAS: R99, HSPA, HSPA Evolution, …
4G E-UTRA/EPC: LTE, LTE-Advanced, LTE-A-Pro, LAA, V2X, …
4G IMS: VoLTE, ViLTE, SRVCC, VoWiFi, …
3G/4G Positioning: GPS, Galileo, Beidou, GLONASS, …
4G IoT: NB-IoT, LTE-M(CatM1/M2),
4G Mission Critical: MCPTT (New!),
5G NR/5GC (New!).
Current baseline: 3GPP Rel-15 September 2018.
© ETSI 2018
TF1605G test suites
© ETSI 2018 14
5G – Deployment options
Deployment scenarios supported in 3GPP Rel-15:
Standalone (SA) – Single Connectivity options:
Option2(NR/5GC): NR connected to 5G-CN
Option5(E-UTRA/5GC): LTE connected to 5G-CN
Non-standalone (NSA) – Dual Connectivity options:
Option3(EN-DC): LTE-NR DC via EPC where LTE is master
Option7(NGEN-DC): LTE-NR DC via 5G-CN where LTE is master
Option4(NE-DC): NR-LTE DC via 5G-CN where NR is master.
LTE eNB
MME
gNB LTE eNB
S-GW
gNB
S1
-U
Xx-U
S1-U
EN-DCC-Plane U-Plane
Ref.: 3GPP TR 38.801
gNB
NG-RAN
5GC
AMF/UPF
gNB
NR/5GC
© ETSI 2018 15
NR/5GC (SA Option2) – Component architecture
MTC
SystemAdaptor
IP PTC
IP_SOCKIPsec_CTRLIP_CTRL
IP_SOCKIPsec_CTRLIP_CTRL
IMS PTC
IMS_CTRL
IMS_CTRLIMS_Server IMS_Client
IMS_Server IMS_Client
IP stack
DRB MUX
NR5G_PTC
IPC
ANIP
CA
N
NR
5G
_CTR
L
IP
UT
PTC
_Ut
NAS EMU NR5G
NR
PDCP
RLC
MAC
PHY
PDCP
RLC
MAC
PHY
SDAPuser plane control plane
system interface
TTCN-3 code: RRC / NAS / IMS NW emulation (SW)
gNB emulator (HW)
Ut
Ut
© ETSI 2018 16
EN-DC (NSA Option3) – Component architecture
IP PTC
NAS EMU EUTRA
SystemAdaptor
EUTRA_PTC
IP_SOCKUt IPsec_CTRLIP_CTRL
IP_SOCKIPsec_CTRLIP_CTRL
IMS PTC
IMS_CTRL
IMS_CTRLIMS_Server IMS_Client
IMS_Server IMS_Client
EUTRA
IP stack
DRB MUX
MTC
IPC
AN
IPC
AN
E_SRB
SYS_SRB
NASCTRL
NASCTRL
SRB
SRB
SYSIND
E_SYSIND
SYS
E_SYS
Ut
EUTR
A_C
TRL
IP
UT
PTC_Ut
DRB
E_DRB
NR5G_PTC
NR
5G
_CTR
L
IP
EUTR
ANR
5G
e/nPDCPRLC
MACPHY NR
e/nPDCPRLC
MACPHY
nPDCPRLC
MACPHY
nPDCPRLC
MACPHY
user plane user plane control planecontrol plane
“XX-Interface”
system interface
© ETSI 2018 17
5G – TTCN-3 test case verificationTTCN executed on a System Simulator (SS) hardware platform, against a real physical device implementation (e.g. smartphone).
RAN5_SIG
TC prose specification
MCC TF160
TC TTCN implementation
e.g. TS 38.523-1,TS 38.523-2
Draft TTCN files(iWD)
3GPP core specse.g. TS 38.331
TC TTCN verification
MCC TF160+
RAN5_SIG
Formal TTCN filese.g. TS 38.523-3
Test EnvironmentTest System
Draft TTCN files(iWD)
TTCNexecutable
System Simulator
TTCN compilation
+
PA
SS TTCN Change Request
+SSPassLog
Prose Change Request
+
3GPP device under test3GPP device under test
FR1: RF cable,FR2: OTA chamber
© ETSI 2018 18
5G – TTCN-3 test cases status – implementation & verification
Implementation: latest delivery iwd-18wk49 on 7th Dec’18.
EN-DC: 69 test cases ;
NR/5GC: 22 test cases.
Verification: 1st successful PASS of a 5G TTCN-3 conformance test case submitted to 3GPP on Saturday
8th December 2018.
Under review period in 3GPP RAN5.
Test case (TS 38.523-1) EN-DC NAS test case 10.2.1.2 (Dedicated EPS Bearer addition on SCG)
UE under test Qualcomm SDM855+SDX50 5G NR EN-DC UE
Network Simulator Keysight 5G Protocol Conformance Toolset
TF160 TTCN-3 delivery iwd-18wk44 + critical changes
Technical details Full stack ; EN-DC band combination DC_5A_n261A
- E-UTRA: FDD freq. DL881.5MHz / UL836.5MHz, 5MHz BW- NR: TDD freq. 27.56GHz, SCS120KHz, 100MHz BW
© ETSI 2018
Interworking with OAI
© ETSI 2018 20
OAI – TTCN-3 Integration: Idea (food for thoughts)
MTC
SystemAdaptor
IP PTC
IP_SOCKIPsec_CTRLIP_CTRL
IP_SOCKIPsec_CTRLIP_CTRL
IMS PTC
IMS_CTRL
IMS_CTRLIMS_Server IMS_Client
IMS_Server IMS_Client
IP stack
DRB MUX
NR5G_PTCIPC
ANIP
CA
N
NR
5G
_CTR
L
IP
UT
PTC
_Ut
NAS EMU NR5G
OAI gNBPDCP
RLC
MAC
PHY
PDCP
RLC
MAC
PHY
SDAPuser plane control plane
systeminterface
TTCN-3 code: RRC / NAS / IMS NW emulation (SW)
Ut
Ut
OAI UEAT/MMI cmds
© ETSI 2018 21Agenda
THE END
ETSI CTI (Centre for Testing and Interoperability)