Robert Schmidt
f21b5d2ef4
CI: Add basic unittest for cls_cmd
2024-09-28 12:45:33 +02:00
Robert Schmidt
606e2c749a
cls_cmd: execute commands through bash
...
The next commit will use "echo -e". The problem with that is that bash
and sh differ:
- in bash: this results in "a\nb" (a+newline+b)
- in sh: this results in -e a\nb (-e a+newline+b)
The problem is that by default, commands are executed through sh, which
nobody expects. Change to bash, which is likely more aligned with what
people want to use.
2024-09-28 12:45:33 +02:00
Robert Schmidt
5d5ade1697
Remove superfluous cleanup/terminate/teardown XMLs
...
After the previous commit, the CI will always do an undeployment step
even if the CI failed. Hence, these XMLs are not necessary anymore. Some
XMLs are updated to do what their "cleanup XML" counterparts did, such
as removing additional images.
2024-09-28 12:45:07 +02:00
Robert Schmidt
8bdc399b27
Remove AutoTerminateUEeNB() functions, use auto_exec to make CI always undeploy
2024-09-28 12:45:07 +02:00
Robert Schmidt
041b2b2d7a
Remove prematureExit/exitStatus, and implement in task main loop
...
Use the previous commit on returning success from each task execution
function, and implement handling of errors in the main loop. Add a
script with which this is visible using Custom_Commands.
2024-09-28 12:45:07 +02:00
Robert Schmidt
7b89548867
Consistently return success true/false from task steps
2024-09-28 12:45:07 +02:00
Robert Schmidt
e969ddb897
IdleSleep(): no need for class members
2024-09-28 12:45:07 +02:00
Robert Schmidt
71807db4ab
Custom_Command(): no need for class members
2024-09-28 12:45:07 +02:00
Robert Schmidt
61ea76e7af
Remove CI repeatCount XML property
...
The repeatCount property is useless: it would be enough to specify the
same XML multiple times to achieve the same thing.
2024-09-28 12:45:07 +02:00
Robert Schmidt
77a8f5fa99
Basic test runner script
2024-09-28 12:45:07 +02:00
Robert Schmidt
d108648312
Handle parameter reading and test case execution together
...
For reasons I don't understand, the XML option reading and actual test
case execution are at different places in the code. This is problematic,
because what this led to is that options are not passed as function
arguments, but indirectly through class members. This led to a lot of
"indirect code"; it's a total mess
To improve this, move them together, so that parameters can be passed
directly as function arguments later on.
Because we reference the globals, mark them inside
ExecuteActionWithParam(). That is a Python antipattern, but necessary at
this moment. I believe that we can remove the following globals over
time:
- SSH (with new cls_cmd, which we don't need to pass)
- EPC (replaced through a class similar to ue_module, i.e., refer to
core networks on specific hosts through an ID, instead of a global)
- HTML (should use templating, where individual functions give back a
dictionary of what they want to print, and a final pass assembles the
entire HTML file)
- RAN/SCA/PHYSIM/CLUSTER/ldpc (can be replaced with stateless scripts
build/run eNB/gNB on a specific node)
2024-09-28 12:45:07 +02:00
Jaroslava Fiedlerova
e9f9718f63
CI: add more unit tests for UDP iperf3 analysis function
2024-09-28 12:45:07 +02:00
Jaroslava Fiedlerova
5fd5ed43c7
CI: Adjust regex patterns for Iperf3 UDP log parsing
...
Update the regex for both sender and receiver data to allow optional
bitrate unit prefixes - accepts also no prefix. Modify the patterns for
lost and total packets to accept negative values (`-?\d+`).
2024-09-28 12:45:07 +02:00
Jaroslava Fiedlerova
9d92c0e477
CI: add unit test for UDP iperf3 analysis function
2024-09-28 12:45:07 +02:00
Jaroslava Fiedlerova
1ba5677056
CI: get UDP iperf3 results even if packet count is negative
2024-09-28 12:45:07 +02:00
Robert Schmidt
0da2f27fa7
CI Ping/Iperf: add tests, print without lock, reduce code lines
...
Add some basic unit tests to verify that Iperf/Ping work. Harmonize the
logging by only print in the "main" iperf/ping function, to avoid that
if we test with multiple UEs, the output intermixes. Also, do one common
mkdir before starting multiple pings/iperfs. Finally, harmonize the
paths so that Iperf and Ping log their files in the same place.
2024-09-28 12:45:07 +02:00
Robert Schmidt
02d5f953a8
Add simple unit test cases for Deployment, including instructions
2024-09-27 19:59:54 +02:00
Robert Schmidt
25f7f61d73
Simplify GetContainerHealth(): we never use unhealthy count
2024-09-27 19:59:54 +02:00
Robert Schmidt
4bf7c45be1
SSHConnection class: don't exit, raise Exception to have main loop handle
2024-09-27 19:59:54 +02:00
Robert Schmidt
1620994f0a
DeployObject: EPC not needed
2024-09-27 19:59:54 +02:00
Robert Schmidt
7c1920aea9
Fixup: no HTML in create_workspace, so can't print to HTML
2024-09-27 19:59:54 +02:00
Robert Schmidt
6f868b038f
Remove more unused CI files
2024-09-27 19:59:54 +02:00
Robert Schmidt
cded721189
Remove unused CI XML and Python code
2024-09-27 19:50:41 +02:00
Robert Schmidt
28e30d24f7
Remove unused CI StatsFromGenObject()
2024-09-26 16:53:04 +02:00
Robert Schmidt
de2bf7ad8b
Remove unused CI CaptureOnDockerNetworks()
2024-09-26 16:53:04 +02:00
Robert Schmidt
b9e56104d8
Remove unused CI code
2024-09-26 16:53:04 +02:00
Robert Schmidt
29383373de
Remove unused code
2024-09-26 16:53:04 +02:00
Robert Schmidt
c5f090c23d
Remove useless rm log
2024-09-26 16:53:04 +02:00
Robert Schmidt
87d28848dd
Remove useless log: we see it in iperf call, and the XML
2024-09-26 16:53:04 +02:00
Jaroslava Fiedlerova
0dae0551eb
Merge remote-tracking branch 'origin/ci-remove-unused-code' into integration_2024_w38b
2024-09-23 17:26:14 +02:00
Jaroslava Fiedlerova
11aeba0699
Merge remote-tracking branch 'origin/up2_on_Aerial' into integration_2024_w38b
2024-09-23 16:37:56 +02:00
Jaroslava Fiedlerova
015257856d
Merge remote-tracking branch 'origin/ci-fix-multi-ue' into integration_2024_w38b
2024-09-23 12:44:48 +02:00
Robert Schmidt
ec2afa22b1
Fix: egrep is obsolescent, use grep -E
...
See e.g., egrep(1) [https://linux.die.net/man/1/egrep ]:
> two variant programs egrep and fgrep are available. egrep is the same
> as grep -E. fgrep is the same as grep -F. Direct invocation as either
> egrep or fgrep is deprecated
See also the rationale of the POSIX description of grep
(https://pubs.opengroup.org/onlinepubs/9699919799/utilities/grep.html ):
> This grep has been enhanced in an upwards-compatible way to provide
> the exact functionality of the historical egrep and fgrep commands as
> well. It was the clear intention of the standard developers to
> consolidate the three greps into a single command.
Closes : #839
2024-09-23 12:19:49 +02:00
Robert Schmidt
40bde2ae75
Jenkinsfiles: Print if an XML file is not present
2024-09-23 12:19:49 +02:00
Robert Schmidt
de310c6e82
Remove unused CI Jenkinsfiles
...
As of now, these seem to be the Jenkinsfiles used on Jenkins
ci-scripts/Jenkinsfile-cluster
ci-scripts/Jenkinsfile-colosseum
ci-scripts/Jenkinsfile-GitLab-Container
ci-scripts/Jenkinsfile-GitLab-COTS-UE-Test
ci-scripts/Jenkinsfile-nrue
ci-scripts/Jenkinsfile-physim-deploy
ci-scripts/Jenkinsfile-push-registry
ci-scripts/Jenkinsfile-tmp-full-ran
ci-scripts/Jenkinsfile-tmp-multi-enb
ci-scripts/Jenkinsfile-tmp-multi-enb-nsa
ci-scripts/Jenkinsfile-tmp-ran
(gather all files in a file, then cat <file> | sort | uniq)
Remove all others.
2024-09-23 12:19:49 +02:00
Robert Schmidt
4a9944bf06
Remove unused OaiCiTest class members
2024-09-23 12:19:49 +02:00
Robert Schmidt
3e2ee3878e
Remove unused python files
2024-09-23 12:19:49 +02:00
Robert Schmidt
6147a83f0b
Remove unused Perform_X2_Handover XML step: no XML uses this
2024-09-23 12:19:49 +02:00
Robert Schmidt
ec64826fde
Remove unused Terminate_OAI_UE XML step: no XML uses this
...
- Fix Jenkinsfile-tmp-full-ran: python test stage TerminateOAIUE() has been removed
2024-09-23 12:19:38 +02:00
Reem Bahsoun
e96a7eed20
Replace UE on sphex with up2, improve throughput
...
- Change XML and YAML to use up2 in aerial pipeline
- Modify gNB config to improve throughput
- Reflect changes in documentation
2024-09-20 18:07:48 +02:00
Jaroslava Fiedlerova
b3d264f29a
Merge remote-tracking branch 'origin/nr-pdcp-nea1' into integration_2024_w38b
2024-09-20 13:57:59 +02:00
Robert Schmidt
99226fc66c
Remove unused Initialize_OAI_UE XML step: no XML uses this
2024-09-18 15:13:13 +02:00
Robert Schmidt
aeb6442f71
Remove unused Build_OAI_UE XML step: no XML uses this
2024-09-18 15:13:13 +02:00
Robert Schmidt
85efd54f3b
Remove unused CI Test XML files
...
As of now, these XMLs seem to be used:
xml_files/cluster_image_build.xml
xml_files/container_4g_l2sim_tdd_down.xml
xml_files/container_4g_l2sim_tdd.xml
xml_files/container_4g_rfsim_down.xml
xml_files/container_4g_rfsim_fdd_05MHz_down.xml
xml_files/container_4g_rfsim_fdd_05MHz_noS1_down.xml
xml_files/container_4g_rfsim_fdd_05MHz_noS1.xml
xml_files/container_4g_rfsim_fdd_05MHz.xml
xml_files/container_4g_rfsim_fdd_10MHz_down.xml
xml_files/container_4g_rfsim_fdd_10MHz.xml
xml_files/container_4g_rfsim_fdd_20MHz_down.xml
xml_files/container_4g_rfsim_fdd_20MHz.xml
xml_files/container_4g_rfsim_fembms_down.xml
xml_files/container_4g_rfsim_fembms.xml
xml_files/container_4g_rfsim_mbms_down.xml
xml_files/container_4g_rfsim_mbms.xml
xml_files/container_4g_rfsim.xml
xml_files/container_5g_e1_rfsim_down.xml
xml_files/container_5g_e1_rfsim.xml
xml_files/container_5g_f1_rfsim_down.xml
xml_files/container_5g_f1_rfsim.xml
xml_files/container_5g_fdd_rfsim_down.xml
xml_files/container_5g_fdd_rfsim.xml
xml_files/container_5g_flexric_rfsim_down.xml
xml_files/container_5g_flexric_rfsim.xml
xml_files/container_5g_l2sim_proxy.xml
xml_files/container_5g_l2sim_tdd_down.xml
xml_files/container_5g_l2sim_tdd.xml
xml_files/container_5g_rfsim_24prb_down.xml
xml_files/container_5g_rfsim_24prb.xml
xml_files/container_5g_rfsim_2x2_down.xml
xml_files/container_5g_rfsim_2x2.xml
xml_files/container_5g_rfsim_down.xml
xml_files/container_5g_rfsim_f1_accelleran_down.xml
xml_files/container_5g_rfsim_f1_accelleran.xml
xml_files/container_5g_rfsim_fdd_phytest_down.xml
xml_files/container_5g_rfsim_fdd_phytest.xml
xml_files/container_5g_rfsim_fr2_32prb_down.xml
xml_files/container_5g_rfsim_fr2_32prb.xml
xml_files/container_5g_rfsim_ntn_geo_down.xml
xml_files/container_5g_rfsim_ntn_geo.xml
xml_files/container_5g_rfsim_sidelink_down.xml
xml_files/container_5g_rfsim_sidelink.xml
xml_files/container_5g_rfsim_tdd_dora_down.xml
xml_files/container_5g_rfsim_tdd_dora.xml
xml_files/container_5g_rfsim_u0_25prb_down.xml
xml_files/container_5g_rfsim_u0_25prb.xml
xml_files/container_5g_rfsim.xml
xml_files/container_image_build_cross.xml
xml_files/container_image_build.xml
xml_files/container_l2sim_proxy.xml
xml_files/container_lte_b200_fdd_05Mhz_tm1_if4_5.xml
xml_files/container_lte_b200_fdd_05Mhz_tm1_no_rrc_activity.xml
xml_files/container_lte_b200_fdd_05Mhz_tm1.xml
xml_files/container_lte_b200_fdd_10Mhz_tm1_cdrx.xml
xml_files/container_lte_b200_fdd_10Mhz_tm1_oaiue_cleanup.xml
xml_files/container_lte_b200_fdd_10Mhz_tm1_oaiue.xml
xml_files/container_lte_b200_fdd_10Mhz_tm1.xml
xml_files/container_lte_b200_fdd_20Mhz_tm1.xml
xml_files/container_lte_b200_fdd_cleanup.xml
xml_files/container_lte_b200_tdd_05Mhz_tm1_if4_5.xml
xml_files/container_lte_b200_tdd_05Mhz_tm1.xml
xml_files/container_lte_b200_tdd_10Mhz_tm1.xml
xml_files/container_lte_b200_tdd_20Mhz_tm1_default_scheduler.xml
xml_files/container_lte_b200_tdd_20Mhz_tm1.xml
xml_files/container_lte_b200_tdd_cleanup.xml
xml_files/container_lte_n3xx_tdd_2x2_tm1.xml
xml_files/container_lte_n3xx_tdd_2x2_tm2.xml
xml_files/container_nsa_b200_quectel.xml
xml_files/container_nsa_b200_terminate.xml
xml_files/container_sa_aerial_quectel_cleanup.xml
xml_files/container_sa_aerial_quectel.xml
xml_files/container_sa_aw2s_2x2_asue.xml
xml_files/container_sa_aw2s_asue_cleanup.xml
xml_files/container_sa_aw2s_asue.xml
xml_files/container_sa_b200_quectel.xml
xml_files/container_sa_b200_terminate.xml
xml_files/container_sa_e1_b200_quectel.xml
xml_files/container_sa_e1_b200_terminate.xml
xml_files/container_sa_f1_b200_quectel.xml
xml_files/container_sa_f1_b200_terminate.xml
xml_files/container_sa_fhi72_benetel_asue_cleanup.xml
xml_files/container_sa_fhi72_benetel_asue.xml
xml_files/container_sa_fhi72_vvdn_up2_cleanup.xml
xml_files/container_sa_fhi72_vvdn_up2.xml
xml_files/container_sa_n310_2X2_100MHz_cleanup.xml
xml_files/container_sa_n310_2X2_100MHz_quectel.xml
xml_files/container_sa_n310_2X2_60MHz_cleanup.xml
xml_files/container_sa_n310_2X2_60MHz_quectel.xml
xml_files/container_sa_n310_nrue_cleanup.xml
xml_files/container_sa_n310_nrue.xml
xml_files/container_sa_sc_b200_quectel.xml
xml_files/container_sa_sc_b200_terminate.xml
xml_files/cppcheck.xml
xml_files/fr1_5gc_closure.xml
xml_files/fr1_5gc_start.xml
xml_files/fr1_cn5g_basic_deploy.xml
xml_files/fr1_cn5g_basic_undeploy.xml
xml_files/fr1_enb_build.xml
xml_files/fr1_epc_closure.xml
xml_files/fr1_epc_start.xml
xml_files/fr1_oai_cn_deploy.xml
xml_files/fr1_oai_cn_undeploy.xml
xml_files/gnb_phytest_usrp_run_100_2x2.xml
xml_files/gnb_phytest_usrp_run_60_2x2.xml
xml_files/gnb_phytest_usrp_run_60.xml
xml_files/gnb_phytest_usrp_run.xml
xml_files/gnb_usrp_build.xml
xml_files/ldpc_gpu_test.xml
xml_files/lte_2x2_tm1_quectel.xml
xml_files/lte_2x2_tm2_quectel.xml
xml_files/lte_oai_cn_deploy.xml
xml_files/lte_oai_cn_undeploy.xml
xml_files/physim_deploy_run.xml
xml_files/sa_cn5g_20897_closure.xml
xml_files/sa_cn5g_20897_start.xml
xml_files/sa_cn5g_closure.xml
xml_files/sa_cn5g_start.xml
xml_files/t1_offload_test.xml
xml_files/t2_offload_dec_nr_ulsim.xml
xml_files/t2_offload_enc_nr_dlsim.xml
Obtained by going through all RAN pipelines, copying out the XMLs of all
pipelines, then doing
cat xml.dump | sort | uniq
2024-09-18 15:13:13 +02:00
Jaroslava Fiedlerova
ad6e189f8d
Merge remote-tracking branch 'origin/issue_836' into integration_2024_w38
2024-09-17 08:40:57 +02:00
Jaroslava Fiedlerova
2eff246d64
ci: modification of SA-2x2, 60 MHz TDD testcase conf to use nea1/nia1
2024-09-11 16:25:07 +02:00
francescomani
e6e0602da0
removing ssb_PositionsInBurs_BitmapPR from config files
2024-09-08 11:40:47 +02:00
Raphael Defosseux
4c9c26a307
Merge remote-tracking branch 'origin/yaml-config' into integration_2024_w36
2024-09-06 14:27:06 +02:00
Raphael Defosseux
b86f157c6d
Merge remote-tracking branch 'origin/f1-ho-prep' into integration_2024_w36
2024-09-06 14:26:02 +02:00
Raphael Defosseux
99d2ad8e1a
chore(ci): entitlement folder should be created before copying
...
Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr >
2024-09-06 14:24:15 +02:00
Robert Schmidt