Commit Graph
31 Commits
Author SHA1 Message Date
Raphael Defosseux e6d35a81e4 CI: cosmetics changes to reporting
Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-10-18 14:21:32 +02:00
Raphael Defosseux d5cd9a31f9 CI: fixes and enhancements
-- fix for IF4p5 TDD scenario (missing build test-case)
  -- added automatic UE/eNB termination in main.py when iperf/ping fails
     It allows to have a eNB log analysis for HTML reporting
  -- added statistics on PDCP out-of-resource messages
  -- added statistics on ULSCH error messages

Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-10-17 16:19:31 +02:00
Raphael Defosseux 8bb295c098 CI: adding support for IF4p5 testing
Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-10-16 14:59:09 +02:00
Raphael Defosseux 04873a7ed0 CI: improvements
-- basic-simulator: added TDD 5MHz DL iperf test
  -- main.py script
     *  better HTML reporting when ping/iperf commands timed out
     *  at eNB terminate, more analysis on RRC commands

Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-10-16 13:32:56 +02:00
Raphael Defosseux f34e735edd CI: adding a tempo in between UP IP retrieves
Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-10-12 16:16:05 +02:00
Raphael Defosseux 307ac58a5a CI: enhancements on the main python script:
-- at the end of eNB run, eNB log file is retrieved and analyzed for SegFault / Assertions / Real Time issues
     if any found, added to the HTML report
  -- When script fails to retrieve UE IP address, try again and report in HTML report if failed
  -- Core is dumped during seg fault event and added to eNB run log zip artifact

Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-10-12 11:18:52 +02:00
Raphael Defosseux 4b0730f767 CI: enhancements with timeouts and build timestamps in HTML reports
Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-10-09 18:29:49 +02:00
Raphael Defosseux 798c37aa8d CI: Adding support for TCP iperf2
Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-10-05 13:23:20 +02:00
Raphael Defosseux 1bdc059f88 CI: adding UL iperf test in TDD
also at eNB init, no sync will result into an error

Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-10-02 17:56:31 +02:00
Raphael Defosseux 4aa5650cda CI: little tweak
Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-09-28 16:49:30 +02:00
Raphael Defosseux 5c45163dd1 CI: adding retry strategy when connecting to remote server
Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-09-28 16:29:10 +02:00
Raphael Defosseux afa64a0d90 CI: adding TDD setup to main CI on develop
-- Configuration files for a Band-40 test setup
  -- XML file test on band-40 for 5 and 10 MHz in DL only

Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-09-03 16:13:03 +02:00
Raphael Defosseux 24c1c6e18b CI: better reporting
-- URL of jenkins build included in top of HTML report
  -- when one of the needed processes not present, reported in HTML

Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-08-28 09:35:31 +02:00
Raphael Defosseux e469680d80 CI: fix in python
Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-08-24 14:37:40 +02:00
Raphael Defosseux 8b46aea34d CI: optimization on scripts
Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-08-24 11:57:13 +02:00
Raphael Defosseux 0c83df3ff9 CI: added support for extra options to start eNB
added more statistics on iperf server report analysis

Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-08-22 19:15:43 +02:00
Raphael Defosseux 4bf6f26d49 CI: inverted last iperf UL @20MHz
fix main.py help message

Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-08-22 10:19:14 +02:00
Raphael Defosseux dc9c27a330 CI: improvements
-- no more -x option at compilation time
 -- iperf server report crash better handled
   -- python executor retrieve iperf server files in case of failure to analyze
   -- comparison w/ requested bandwidth

Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-08-20 11:09:28 +02:00
Raphael Defosseux bd5b3b1ec7 CI:
- fix when FDD slave job fails, it still retrieves the HTML report
 - improvement in HTML report, stats per UE for attach, ping, iperf

Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-08-13 16:21:30 +02:00
Raphael Defosseux 35ff61118f CI: adding profiling option to iperf:
-- balanced (current version): all UE shares the same BW
 -- single-ue : one UE will use the whole requested BW
 -- unbalanced : all but one UE will use a residual 2% of the requested BW
                 the rest of requested BW will be used by one UE

Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-08-03 15:23:47 +02:00
Raphael Defosseux 4080cfd81f CI: adding UL iperf support
Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-08-03 13:08:48 +02:00
Raphael Defosseux 9766eaa1bf CI: Improvements
* adding merge request allow flag:
  -- if false no forced merge to develop
  -- if true and if branch is not develop, then forced merge to develop
 * lowered the ru gains in CI conf files
 * adding on-the-fly HTML summary within python main.py script
 * adding 20 MHz testcases to FDD band 7 scenario
 * adding GitLab status for
  -- centOS build
  -- FDD-band7 tests

Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-08-02 17:36:52 +02:00
Raphael Defosseux 75711a8b77 CI: hotfixes
-- log collection on enb log requires a sudo when removing log files
  -- added iperf log collection to jenkins file
  -- corrected iperf detection of packet loss ( added jitter also)
  -- increased iperf DL requested BW for 10 MHz

Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-08-01 11:48:09 +02:00
Raphael Defosseux 71978e71e3 CI: hotfix -- no waiting for got sync
Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-07-31 16:30:16 +02:00
Raphael Defosseux 621b73938d CI: hotfix for stability
-- stdbuf -o0 seems to be causing segmentation fault
  -- using daemon instead of nohup
  -- also repeating several time "got sync" message and flushing stdout/stderr

Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-07-31 14:41:19 +02:00
Raphael Defosseux c30a2fa607 CI: little fix in main python script
Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-07-30 14:17:34 +02:00
Raphael Defosseux ddcab3a6cf CI: fix in executing in python the eNB process
added slave job trigger for testing

Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-07-30 13:17:27 +02:00
Raphael Defosseux b04ef7e289 CI: Adding license banner to python script and xml testcases
Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-07-27 17:21:25 +02:00
Raphael Defosseux a2a00d2205 CI: Improvements on the COTS-UE bench script
* added banner to pipeline script
  * added parameters to Jenkins pipeline / python
    * xmlfile and test stage
  * eNB configuration files are located under ci-scripts/conf_files
    * no more correction of MNC
    * still correction of EPC / eNB IP addresses at runtime
    * Initialize_eNB_args is back using the proper "-O " syntax
  * Terminate stage is parallel as in FJU's original pipeline
  * Log collection stage is back fully parallel
  * Console as artifact an option
  * Check if terminate calls ended well, to be repeated at the end
  * Adding back iperf:
    * selection of iperf vs iperf3
    * adding some iperf testcases to test suite
  * Better enb launch

Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-07-27 15:55:40 +02:00
Raphael Defosseux af2877cf59 CI : Improvements to COTS-UE bench scripts
-- Jenkins Pipeline script:
     -- Moved the node to a proper subnetwork
     -- Added ansiColor option
  -- XML testsuite file can now be an option to the main.py python script
     -- Added some examples testsuite templates
  -- main.py python file
     -- Added an option when opening an SSH session: taking care of clients with copied SSH keys
        in that case, verifing that we are on the correct host
     -- BuildeNB method is closer from Fujitsu's original one
        improvement on flexibility for code source path naming
        better clean-up of workspace
     -- LTEBOX EPC (init / termination / logCollection) methods improvements w/ a /tmp path
     -- Checking of processes (EPC / eNB) is parallelized
        also handles LTEBOX EPX vs OAI CN
     -- UE methods added: attach, detach, reboot, ping
        With complete parallelism for multiple UEs
        iperf added but not tested

Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-07-27 15:55:40 +02:00
Raphael Defosseux 6b38334767 CI: integration of the "test with equipment" script
-- temporary into a separate jenkins job
  -- parameters are not in the pipeline script file
     they have to be set up manually in the Jenkins GUI configuration page
     they are then check if present in pipeline script
  -- call to python script
     -- build on a server with RF HW capabilities
        for the moment USRP B2x0
        also handles merge request process for gitlab
     -- since it is for CI, it is a clean build
     -- connect to an EPC (OAI or LTEBOX)
     -- terminates eNB / EPC
  -- log collection

Signed-off-by: Raphael Defosseux <raphael.defosseux@eurecom.fr>
2018-07-27 15:55:40 +02:00