feat(tests): Fix scaling of 6p3nic Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I84d9cf2892423e62b116b07982d3e87120b66271
feat(report): Add currently known issues Analysis is not finished yet, some updates may arrive next week. Change-Id: I7a51e279fbb2807ee4064affda8ad445bbd01b02 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
C-Dash: Add tooltips Change-Id: I00cf78e2e777fa96754f7b06aab02a8bf8682da5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
C-Dash: Add possiblity to remove outliers from comparison data - extreme outliers only for now Change-Id: I2be7c291dd207d5a557947415a960fa6d0067c64 Signed-off-by: Tibor Frank <tifrank@cisco.com>
feat(device): cx6 update of 1n-alt device jobspec Update the jobspec according to the current Arm policy: 1. Run most of the tests on cx6, crypto coverage being the most important, 2. Match the cx6 ipv4 crypto coverage with x710 with the DPDK driver, 3. Run basic ipv4 and l2 tests with x710 with borh DPDK and native (avf) drivers. The above is the policy used in performance testing where time is a major constraint. The same is true for functional testing to some extent, so it makes sense to apply the same logic for choosing the tests. There are 10 tests which are failing on cx6 without an identified reason. They are disabled until we find the root cause and address it. In the meantime, the tests are enabled for x710 with the DPDK driver: ethip4-l2xcbase-eth-2memif-1dcr ethip4-l2bdbasemaclrn-eth-2memif-1dcr ethip4-l2bdbasemaclrn-eth-2tap ethip4-l2bdbasemaclrn ethip4-l2bdbasemaclrn-iacl1sf ethip4-l2bdbasemaclrn-iacl1sl ethip4-l2bdbasemaclrn-oacl1sf ethip4-l2bdbasemaclrn-oacl1sl ethip4-l2patch ethip4-l2xcbase When the cx6 issue has been resolved, these should be enabled for cx6 and disabled for x710, with the exception of ethip4-l2bdbasemaclrn, which should be running on both. Change-Id: Id48f450063e405b1faca57431676f91d62e829b9 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
C-Dash: Add search in tests Change-Id: Ia250c4b4e299d48bc68cf01e65fe37a281047060 Signed-off-by: Tibor Frank <tifrank@cisco.com>
job-spec: add more ip4scale tests to 2n-spr and 3na-spr Change-Id: I9c9a6ecd6698cb58e7114543de54eb01549d4af0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
feat(device): 1n-alt ansible improvement We're seeing extra IGMP traffic which interferes with tests which must be disabled. This is done by disabling the setting by default on all interfaces. The default setting is also adopted for other traffic-related configuration: Default sets the configuration when the interface is created. For hardware interfaces, that is at boot time. For VF interfaces, when we create them with the csit-initialize-vfs.sh script and for virtual interfaces when they're created. On the other hand, the all configuration option doesn't set the configuration. It uses the current configuration value along with the passed configuration value to produce a new value, which could be expressed as: f(old_value, value_from_all) -> new_value Where f is a function specific to each configuration option. Using all thus requires us to know the function and the old value which is less reliable than just using default everywhere. Also fix the 1n-alt VF init script. Change-Id: I3da15abfb5a1e76769076edd95d20e2168b6f71f Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
feat(device): add cx6 to 1n-alt ansible Also update 1n-alt hardware with info from dmidecode and port names to match the rules in Testbed Naming Convention. Change-Id: Ib654adaec5667f0e79a3cb86edfbf4578f5c3d5f Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>