Magma AGW Release V1.8-5G-SA. .Validation - Report
Magma AGW Release V1.8-5G-SA. .Validation - Report
TABLE OF CONTENT
1. INTRODUCTION .............................................................................................................................. 5
1.1 Purpose of the Document.......................................................................................................... 5
2. ABBREVATIONS ............................................................................................................................... 5
3. SETUP ............................................................................................................................................. 6
3.1 Access Gateway Hardware ........................................................................................................ 6
3.1.1 Physical Gateways ................................................................................................................ 6
3.2 Test tools and Traffic Emulator .................................................................................................. 6
3.2.1 Test Setup Architecture ........................................................................................................ 6
3.2.2 Test Activity .......................................................................................................................... 7
9. REFERENCES ................................................................................................................................. 37
LIST OF FIGURES
Figure 1: Magma 5G SA – Test Topology ............................................................................................................................. 7
Figure 2: Basic Call Flow with SUCI ....................................................................................................................................... 9
Figure 3: Call Flow with Network Initiated Session-Modification .......................................................................10
Figure 4: Curl-API showing 5G Flag Disabled .................................................................................................................12
Figure 5: Showing only 4G is UP ............................................................................................................................................12
Figure 6: Curl-API After enabling 5G ...................................................................................................................................12
Figure 7: Showing both 4G & 5G up .....................................................................................................................................12
Figure 8: Adding User .................................................................................................................................................................13
Figure 9: Subscribers Overview Page .................................................................................................................................14
Figure 10: Adding Subscribers ...............................................................................................................................................14
Figure 11: Gateway Check-Ins ................................................................................................................................................15
Figure 12: Alert Rules .................................................................................................................................................................15
Figure 13: Metrics Grafana Dashboard View ..................................................................................................................16
Figure 14: Test Activity on Abot ............................................................................................................................................19
Figure 15: SUCI Based call flow .............................................................................................................................................20
Figure 16: Curl API(Put Command) to add SUCI Profiles..........................................................................................20
Figure 17: Curl API(GET Command) to fetch SUCI Profiles .....................................................................................21
Figure 18: APN Configuration .................................................................................................................................................25
Figure 19: QoS Policy Configuration....................................................................................................................................26
Figure 20: QoS Profile Configuration ..................................................................................................................................26
Figure 21: Adding Policies to subscriber ..........................................................................................................................27
Figure 22: Output of the Policies stored in PolicyDB ..................................................................................................27
Figure 23: Grafana Usage reporting (UE Data Usage IN/OUT) for 1UE .............................................................29
Figure 24: Grafana Usage reporting (Total throughput UP/DOWN) for 1UE .................................................29
Figure 25: Grafana Usage reporting (Total throughput UP/DOWN) for Multi UE .......................................29
Figure 26: Grafana Usage reporting (Total throughput UP/DOWN) for Multi UE ........................................30
Figure 27: Commands for enabling Stateless feature .................................................................................................30
Figure 28: Different between Statefull and Stateless Mode .....................................................................................31
Figure 29: Programmable GTP Header Call Flow .........................................................................................................32
Figure 30: High level block diagram for the emulated setup for a NAT setup ................................................33
Figure 31: High level block diagram for the emulated setup for a DHCP setup .............................................34
Figure 32: Test Activity on Spirent ......................................................................................................................................35
Figure 33: Spirent GUI 400Mbps traffic Graph...............................................................................................................36
Figure 34: Test Activity on Real Device .............................................................................................................................38
Figure 35: UE in Aeroplan mode ...........................................................................................................................................38
Figure 36: UE with 5G Signal Detected...............................................................................................................................39
Figure 37: Traffic sent by UE after PDU Establishment .............................................................................................39
LIST OF TABLES
Table 1: Physical Gateway Specifications ........................................................................................................................... 6
Table 2: AGW Upgrade actions and Commands ............................................................................................................11
Table 3: Access Gateway upgrade ........................................................................................................................................11
Table 4: NMS Validation ............................................................................................................................................................18
Table 5: Software Build info - 1.8.0-1663094999-49ed2e69 .................................................................................22
Version Information
Title Magma Access Gateway
Document Ver. No. V 1.8_5G-SA
Approved By
Drafted by
Doc. Classification
Version History
Version # Date Author(s) Approved by Description
Parthiban
1.0 4-July-2022 Nalliamudali Initial Report
/ Neelima K
Parthiban
2.0 15-Sep-2022 Nalliamudali Final Report
/ Neelima K
1. INTRODUCTION
The purpose of this document is to enable 5G in the magma 5G Core and validate 5G Extended
Features in magma-core using different testing tools (Rebaca ABot, Spirent, etc.,). It also has the test
reports from each tool.
2. ABBREVATIONS
# Abbreviations Expansions
1 AGW Access Gateway
2 UE User Equipment
3 BW Bandwidth
4 SUCI Subscription Concealed Identifier
5 GUTI Globally Unique Temporary ID
6 SCTP Stream Control Transmission Protocol
7 NGAP NG Application Protocol
8 NMS Network Management Station
9 NAS Non-access stratum
110 AMF Access and Mobility Management Function
12 AN Access Network
13 RRC Radio Resource Control
14 3GPP 3rd Generation Partnership Project
15 CM Centimeter wave
16 RAN Radio Access Network
17 NG-RAN NG Radio Access Network
18 5GMM 5G Mobility Management
19 PDU Protocol Data Unit
20 TC Test Cases
21 SMF Session Management Function
22 APN Access Point Name
23 DNN Data Network Name
24 QOS Quality of Service
25 NAT Network Address Translation
3. SETUP
Here it shows the Test SETUP for Access Gateway where the main services/procedures are
validated are done.
➢ Abot UE and gNb simulators along with automation framework to test functional/features of
Magma 5GC.
➢ Spirent is used for functional and non-functional testing.
➢ UPF takes care of all data plane and allows packet processing & traffic aggregation which is to be
performed closer to the network edge, increasing bandwidth efficiencies while reducing
network load.
➢ AMF receives all connection and session related information from the UE, but is responsible only
for handling connection and mobility management tasks.
➢ Once the registration is completed, PDU establishment request comes in and internally AMF
sends the request to SMF and SMF fetches the APN or Policy information.
➢ SMF also performs the Session-Modification Trigger whenever there is update in the Qos-
Policies configured. As of now, this is tested using CLI command.
➢ Once the sessions are up or it is successful, SMF sends the session related information to UPF
and traffic is triggered over the session.
Note: ryu patch must be installed after the installation of v1.8 magma AGW.
https://artifactory.magmacore.org/artifactory/debian-test/pool/focal-1.8.0/python3-
ryu_4.34_all.deb
➢ Below is the sctp port output where it shows only 4G, i.e., only 4G port (36412) is up.
➢ To enable 5G features, user must enable 5G feature flag as “True”, which gets reflected in the
config file of AGW via orchestrator (5G AGW comes up with 5G ports).
➢ In below screen shot the Curl API shows enable 5G feature flag as “True” and in this API the
5G features are enabled.
➢ Below is the sctp ports output which shows both 4G and 5G ports are up. (36412 for 4G and
38412 for 5G)
➢ Magma's Orchestrator is a centralized controller for a set of networks. Orchestrator handles the
control plane for various types of gateways in Magma. Orchestrator functionality is composed of
two primary components.
• A standardized, vendor-agnostic northbound REST API which exposes configuration
and metrics for network devices
• A southbound interface which applies device configuration and reports device status
➢ Click here to know more about Orchestrator.
➢ Click here for orchestrator installation guide.
➢ Magma NMS provides an enterprise grade GUI for provisioning and operating magma based
networks. It enables operators to create and manage:
• Organizations
• Networks
• Gateways and eNodeBs
• Subscribers
• Policies and APNs
Step.1 Add Users.
✓ New users to NMS can be added or edited through the admin page.
✓ Users can be configured as a superuser/user/readonly user.
5. FEATURE TESTING
➢ Feature Testing is to explain all procedures and sub procedures that are tested as part of Magma
5G SA- V1.8 release.
➢ After installing Abot core, user must configure the Gnb, AGW IP ports and Abot Analytic IP.
➢ Have Access Gateway installed with V1.7 or upgrade it from the older version to V1.8 (Refer
section 4.2 for AGW Upgrade)
➢ Rebaca’s Abot is integrated with the magma CICD which automatically triggers the test run for
every single built that coming in and V1.8 is exclusively tested using the Abot test tool.
➢ The feature files are executed as per below steps.
Step.1 Test bed comes up.
Step.2 Feature file execution is started
Step.3 Test bed comes down
Step.4 Feature file execution is completed. (All the feature files execution are completed)
➢ After executing the feature file, in few seconds logs and PCAPS are generated in the artefacts.
➢ User can download PCAPS and the Logs from the Artefacts.
Note1: The configured Profiles are not persistent. When AGW get rebooted , user must save the profiles
again in the Subscriber-db.
Note2: All the above test cases are automated: Currently test tool supports Profile-A and Profile-B
configurations manually.
5.1.2 IPV6-SUPPORT
Magma 5G System supports following three PDU Session types to cover different potential use
cases:
Note1: IPV6 support is given only in the user-plane . Still control plane and GTP packets are carried
over IPV4
Note2: Magma doesn’t support Ethernet PDU Session and Unstructured PDU Session
TC14_Multi_Session_IPV4_IPV6_IPV4_IPV6_Traffic_ Automated
TC14 Dereg Fail
Table 6: List of IPV6 Testcases
TC_NW_INIT_S Verify_NW_Init_SessModif_with_SingleSession_SUCI
es_Mod_01 _Based Automated Pass
TC_NW_INIT_S Verify_NW_Init_SessModif_with_SingleSession_GUT
es_Mod_02 I_Based Manual Pass
QOS-SUPPORT
➢ Qos in Magma supports different Policy enforcement on the user traffic.
➢ AMF exchanges the various policy parameters to UE and gNb during PDU-Establishment.
➢ Below are the various Qos-Parameters that supported in Magma.
• QFI and 5QI values
• Priority
• UL/DL Session AMBRs
• ARP – Allocation and Retention Priorities.
• Pre-emption Capability and Pre-emption Vulnerability Parameters
➢ By default when PDU-Session is up, if there is no Qos-Policy applied for a given subscriber,
Sessiond will pick the above specified parameters from the APN that a UE gets subscribed.
➢ If there is any policy applied for a given subscriber, Sessiond will apply respective policies on the
session and the information is shared to UE in PDU-Establishment-Accept message and the same
is shared to gNB as part of PDUSessionResourceSetupRequestTransfer Message
➢ And Pipelined use to tune the traffic flow according to the policies and APN AMBRs that are
subscribed by a given subscriber.
➢ And Qos Policies configurations also supports flow match criteria as per 3GPP.
➢ If there is a flow restriction , in a particular Qos-Policy , fast path enforce the same and transfers
the traffic as per the flow controls.
➢ Below are different flow controls supported in Magma.
• Match Criteria – Allow/Deny
• Traffic types – IP, UDP ,TCP and ICMP
• With Specific Source and Destination IP and Port.
➢ Below are the configurations from NMS for Qos Policies and Profiles.
• Configure the APN from the NMS Traffic Page
Figure 23: Grafana Usage reporting (UE Data Usage IN/OUT) for 1UE
Figure 24: Grafana Usage reporting (Total throughput UP/DOWN) for 1UE
Figure 25: Grafana Usage reporting (Total throughput UP/DOWN) for Multi UE
Figure 26: Grafana Usage reporting (Total throughput UP/DOWN) for Multi UE
Call Flows:
Note: QFI value validation as part of GTP extension header is done as part of QoS testing.
Note: Click here to find the test results and the debug logs of the above test cases for all features.
➢ Stability Testing is a type of Software Testing to check the quality and behavior of the software
in different environmental parameters. It is defined as the ability of the product to continue to
function over time without failure. Here, the test runs with maximum number of UEs, with
maximum session and supported throughput for long duration.
Figure 30: High level block diagram for the emulated setup for a NAT setup
Figure 31: High level block diagram for the emulated setup for a DHCP setup
6.2 PERFORMANCE
➢ Performance Testing is done on Spirent test setup to verify and confirm the stability of AGW
with increasing load and for longer duration.
SOFTWARE BUILD INFO - 1.8.0-1663094999-49ED2E69
Scaling and Performance testing
Test Case Test Scenario Status
WLC_Scale_Test_1 200UE_5Rate_Registartion _DeRegistration Pass
WLC_Scale_Test_2 200UE_5Rate_1mbps_1Pdu_Registration and Pass
DeRegistration
WLC_Scale_Test_3 200UE_5Rate_2Mbps_Registration_DeRegistr Pass
ation
WLC_Scale_Test_4 200UE_5Rate_5Mbps_Registration_DeRegistr Pass
ation
WLC_Scale_Test_5 200UE_5Rate_50Mbps_Registration_DeRegis Pass
tration
WLC_Scale_Test_6 600UE_5Rate_Registration_DeRegistration Pass
WLC_Scale_Test_7 600UE_5Rate_1Mbps_1Pdu_Registration_De Pass
Registration
WLC_Scale_Test_8 600UE_5Rate_2Mbps_Registration_DeRegistr Pass
ation
Table 12: Performance
Note: Click here to find the test results and the debug logs of the above test cases.
➢ Testing is done through Spirent tool. Below is the screen shot of traffic graph from Spirent.
➢ Wavelabs CI/CD pipeline trigger happens on every build generated from CI-Master.
➢ Below are the steps involved in Pipeline trigger.
Step.1 Check for checkout from repo.
Step.2 Deploy and upgrade AGW.
Step.3 Trigger TC from Abot framework.
Step.4 Get test results information and download it.
Step.5 Sync of Abot test reports into test agent.
➢ The purpose of running the test case in CI pipeline is to show that the test cases are Pass. It also
shows whether all the systems are working correctly or not and no issues found.
➢ WL CI/CD pipeline is designed to trigger test on every single build that occurs in gitrepo.
➢ Below is the link for CI/CD dash board.
Magma CI (magma-ci.web.app).
➢ Here is the CI/CD test summary report.
Total # of TC 109
Pass (Count) 109
Pass (%) 100.00%
Fail (Count) 0
Fail (%) 0.00%
Table 14: CI/CD Test summary report
➢ Test activity is done on real device UE-SIT (Huawei, iPhone) and T&W gNB and magma 5G
SA AGW.
➢ Switch-on the mobile (Huawei mate UE) and turn-on Wi-Fi or Mobile data.
➢ Check for the 5G symbol in the network selection.
➢ Check whether the NGAP setup is established between the devices and all the 5G calls are
triggered from the device.
➢ To validate all the above steps, enable the PCAPs from AGW.
➢ In below screen shot user could find the UE in Aeroplan mode, where the mobile data is turned-
off.
➢ Once the mobile data is turned-on in UE, 5G signal is detected and it registers with the network
(AGW) and the PDU session is successfully established.
➢ Once the PDU session is established, UE sends the traffic over the session.
➢ Below are the list of test cases that are executed on the real mobile device.
Software Build info 1.8.0-1662060734-
83622a9e
Real Equipment Testing
Test Case Test Scenario Result
ID
TC4 Initial Registration and PDU session establishment - GUTI Based Pass
Note:
➢ Click here to find the test results and the debug logs of the above test cases in T&W lab.
9. REFERENCES
• 3GPP TS 33.501 version 15.4.0 Release 15||Requirements on the UDM: Section # 5.8
• 3GPP TS 33.501 version 15.4.0 Release 15||Subscription identifier privacy: Section # 6.12
• 3GPP TS 33.501 version 15.4.0 Release 15||Subscription identifier de-concealing function
(SIDF): Section # 6.12.5
• 3GPP TS 33.501 version 15.4.0 Release 15||Elliptic Curve Integrated Encryption Scheme
(ECIES): Section # C.3
• 3GPP TS 24.501 version 15.6.0 Release 15||5GS mobility management messages: Section # 8.2
• 3GPP TS 24.501 version 15.6.0 Release 15||5GS session management messages: Section # 8.3
• 3GPP TS 24.501 version 15.6.0 Release 15||Timers of 5GS mobility management: Section # 10.2
• 3GPP TS 24.501 version 15.6.0 Release 15||Timers of 5GS session management: Section # 10.3
• 3GPP TS 29.281 version 15.7.0 Release 15||Echo Request: Section # 7.2.1
• 3GPP TS 29.281 version 15.7.0 Release 15||Echo Response: Section # 7.2.2
• 3GPP TS 29.281 version 15.7.0 Release 15||End Marker: Section # 7.3.2
• 3GPP TS 38.413 version 16.2.0 Release 16||PDU Session Management Messages: Section # 9.2.1
• 3GPP TS 38.413 version 16.2.0 Release 16||UE Context Management Messages: Section # 9.2.2
• 3GPP TS 38.413 version 16.2.0 Release 16||Paging Messages: Section # 9.2.4
• 3GPP TS 38.413 version 16.2.0 Release 16||NAS Transport Messages: Section # 9.2.5
• 3GPP TS 38.413 version 16.2.0 Release 16||Interface Management Messages: Section # 9.2.6
• TS 124 501 - V15.3.0 - 5G; Non-Access-Stratum (NAS) protocol for 5G System (5GS); Stage 3
(3GPP TS 24.501 version 15.3.0 Release 15) (etsi.org)
• MM-Cause.xlsx (sharepoint.com)
• AGW installation Guide