X-Git-Url: https://gerrit.fd.io/r/gitweb?p=csit.git;a=blobdiff_plain;f=resources%2Flibraries%2Frobot%2Fshared%2Ftest_teardown.robot;h=6bfb532fbed569bf1a8896839c4ddcbe15ffedbd;hp=c3d1e8a5ca0db9855e562d32b576a7c883f65dd4;hb=03984cf5e2affcb715559fad5f68b8ba165ff8cd;hpb=a318ebefc569c5c1b1527c5de6dd3e3ac2f9c163 diff --git a/resources/libraries/robot/shared/test_teardown.robot b/resources/libraries/robot/shared/test_teardown.robot index c3d1e8a5ca..6bfb532fbe 100644 --- a/resources/libraries/robot/shared/test_teardown.robot +++ b/resources/libraries/robot/shared/test_teardown.robot @@ -1,4 +1,4 @@ -# Copyright (c) 2020 Cisco and/or its affiliates. +# Copyright (c) 2022 Cisco and/or its affiliates. # Licensed under the Apache License, Version 2.0 (the "License"); # you may not use this file except in compliance with the License. # You may obtain a copy of the License at: @@ -14,7 +14,7 @@ """Keywords used in test teardowns.""" *** Settings *** -| Resource | resources/libraries/robot/shared/container.robot +| Resource | resources/libraries/robot/shared/default.robot | Library | resources.libraries.python.PapiHistory | Library | resources.libraries.python.topology.Topology | Variables | resources/libraries/python/Constants.py @@ -45,6 +45,7 @@ | | | Run Keyword | Additional Test Tear Down Action For ${action} | | END | | Clean Sockets On All Nodes | ${nodes} +| | Finalize Test Export | Tear down test raw | | [Documentation] @@ -60,31 +61,24 @@ | | | Run Keyword | Additional Test Tear Down Action For ${action} | | END | | Clean Sockets On All Nodes | ${nodes} +| | Finalize Test Export -| Additional Test Tear Down Action For performance +# Additional Test Tear Down Actions in alphabetical order +| Additional Test Tear Down Action For acl | | [Documentation] -| | ... | Additional teardown for tests which uses performance measurement. -| | ... | Optionally, call \${resetter} (if defined) to reset DUT state. -| | -| | ... | TODO: Document what test variables are required or optional. +| | ... | Additional teardown for tests which uses ACL feature. | | -| | Run Keyword If Test Passed | Return From Keyword -| | ${use_latency} = | Get Use Latency -| | ${rate_for_teardown} = | Get Rate For Teardown -| | Call Resetter -| | Set Test Variable | \${extended_debug} | ${True} -| | Send traffic at specified rate -| | ... | trial_duration=${1.0} -| | ... | rate=${rate_for_teardown} -| | ... | trial_multiplicity=${1} -| | ... | use_latency=${use_latency} -| | ... | duration_limit=${1.0} +| | Run Keyword If Test Failed +| | ... | Vpp Log Plugin Acl Settings | ${dut1} +| | Run Keyword If Test Failed +| | ... | Vpp Log Plugin Acl Interface Assignment | ${dut1} -| Additional Test Tear Down Action For packet_trace +| Additional Test Tear Down Action For classify | | [Documentation] -| | ... | Additional teardown for tests which uses packet trace. +| | ... | Additional teardown for tests which uses classify tables. | | -| | Show Packet Trace on All DUTs | ${nodes} +| | Run Keyword If Test Failed +| | ... | Show Classify Tables Verbose on all DUTs | ${nodes} | Additional Test Tear Down Action For container | | [Documentation] @@ -94,22 +88,13 @@ | | | Destroy all '${container_group}' containers | | END -| Additional Test Tear Down Action For vhost -| | [Documentation] -| | ... | Additional teardown for tests which uses vhost(s) and VM(s). -| | -| | Show VPP vhost on all DUTs | ${nodes} -| | ${vnf_status} | ${value}= | Run Keyword And Ignore Error -| | ... | Keyword Should Exist | vnf_manager.Kill All VMs -| | Run Keyword If | '${vnf_status}' == 'PASS' | vnf_manager.Kill All VMs - -| Additional Test Tear Down Action For vhost-pt +| Additional Test Tear Down Action For nginx | | [Documentation] -| | ... | Additional teardown for tests which uses pci-passtrough and VM(s). +| | ... | Additional teardown for tests which uses nginx. | | -| | ${vnf_status} | ${value}= | Run Keyword And Ignore Error -| | ... | Keyword Should Exist | vnf_manager.Kill All VMs -| | Run Keyword If | '${vnf_status}' == 'PASS' | vnf_manager.Kill All VMs +| | FOR | ${dut} | IN | @{duts} +| | | Kill Program | ${nodes['${dut}']} | nginx +| | END | Additional Test Tear Down Action For det44 | | [Documentation] @@ -120,41 +105,48 @@ | | | ... | Show DET44 verbose | ${nodes['${dut}']} | | END -| Additional Test Tear Down Action For nat-ed +| Additional Test Tear Down Action For geneve4 | | [Documentation] -| | ... | Additional teardown for tests which uses NAT feature. +| | ... | Additional teardown for tests which uses GENEVE IPv4 tunnel. | | | | FOR | ${dut} | IN | @{duts} -| | | Show NAT44 Config | ${nodes['${dut}']} -| | | Show NAT44 Summary | ${nodes['${dut}']} -| | | Show NAT Base Data | ${nodes['${dut}']} -| | | Vpp Get Ip Table Summary | ${nodes['${dut}']} +| | | Run Keyword If Test Failed +| | | ... | Show Geneve Tunnel Data | ${nodes['${dut}']} | | END -| Additional Test Tear Down Action For namespace +| Additional Test Tear Down Action For iPerf3 | | [Documentation] -| | ... | Additional teardown for tests which uses namespace. +| | ... | Additional teardown for test which uses iPerf3 server. +| | +| | Run Keyword And Ignore Error +| | ... | Teardown iPerf | ${nodes['${iperf_server_node}']} + +| Additional Test Tear Down Action For ipsec_sa +| | [Documentation] +| | ... | Additional teardown for tests which uses IPSec security association. | | | | FOR | ${dut} | IN | @{duts} -| | | Clean Up Namespaces | ${nodes['${dut}']} +| | | Run Keyword If Test Failed +| | | ... | Show Ipsec Security Association | ${nodes['${dut}']} | | END -| Additional Test Tear Down Action For linux_bridge +| Additional Test Tear Down Action For ipsec_all | | [Documentation] -| | ... | Additional teardown for tests which uses linux_bridge. +| | ... | Additional teardown for tests which use varied IPSec configuration. +| | ... | Databases. | | | | FOR | ${dut} | IN | @{duts} -| | | Linux Del Bridge | ${nodes['${dut}']} | ${bid_TAP} +| | | Run Keyword If Test Failed +| | | ... | Vpp Ipsec Show All | ${nodes['${dut}']} | | END -| Additional Test Tear Down Action For acl +| Additional Test Tear Down Action For linux_bridge | | [Documentation] -| | ... | Additional teardown for tests which uses ACL feature. +| | ... | Additional teardown for tests which uses linux_bridge. | | -| | Run Keyword If Test Failed -| | ... | Vpp Log Plugin Acl Settings | ${dut1} -| | Run Keyword If Test Failed -| | ... | Vpp Log Plugin Acl Interface Assignment | ${dut1} +| | FOR | ${dut} | IN | @{duts} +| | | Linux Del Bridge | ${nodes['${dut}']} | ${bid_TAP} +| | END | Additional Test Tear Down Action For macipacl | | [Documentation] @@ -165,12 +157,54 @@ | | Run Keyword If Test Failed | | ... | Vpp Log Macip Acl Interface Assignment | ${dut1} -| Additional Test Tear Down Action For classify +| Additional Test Tear Down Action For namespace | | [Documentation] -| | ... | Additional teardown for tests which uses classify tables. +| | ... | Additional teardown for tests which uses namespace. | | -| | Run Keyword If Test Failed -| | ... | Show Classify Tables Verbose on all DUTs | ${nodes} +| | FOR | ${dut} | IN | @{duts} +| | | Clean Up Namespaces | ${nodes['${dut}']} +| | END + +| Additional Test Tear Down Action For nat-ed +| | [Documentation] +| | ... | Additional teardown for tests which uses NAT feature. +| | +| | FOR | ${dut} | IN | @{duts} +| | | Show NAT44 Config | ${nodes['${dut}']} +| | | Show NAT44 Summary | ${nodes['${dut}']} +| | | Show NAT Base Data | ${nodes['${dut}']} +| | | Vpp Get Ip Table Summary | ${nodes['${dut}']} +| | END + +| Additional Test Tear Down Action For packet_trace +| | [Documentation] +| | ... | Additional teardown for tests which uses packet trace. +| | +| | Show Packet Trace on All DUTs | ${nodes} + +| Additional Test Tear Down Action For telemetry +| | [Documentation] +| | ... | Additional teardown for tests which uses telemetry reads. +| | +| | Run Telemetry On All DUTs +| | ... | ${nodes} | profile=${telemetry_profile}.yaml + +| Additional Test Tear Down Action For performance +| | [Documentation] +| | ... | Additional teardown for tests which uses performance measurement. +| | ... | Optionally, call \${resetter} (if defined) to reset DUT state. +| | +| | Run Keyword If Test Passed | Return From Keyword +| | ${use_latency} = | Get Use Latency +| | ${rate_for_teardown} = | Get Rate For Teardown +| | Call Resetter +| | Set Test Variable | \${extended_debug} | ${True} +| | Send traffic at specified rate +| | ... | trial_duration=${1.0} +| | ... | rate=${rate_for_teardown} +| | ... | trial_multiplicity=${1} +| | ... | use_latency=${use_latency} +| | ... | duration_limit=${1.0} | Additional Test Tear Down Action For srv6 | | [Documentation] @@ -182,3 +216,20 @@ | | ... | Show SR Steering Policies on all DUTs | ${nodes} | | Run Keyword If Test Failed | | ... | Show SR LocalSIDs on all DUTs | ${nodes} + +| Additional Test Tear Down Action For vhost +| | [Documentation] +| | ... | Additional teardown for tests which uses vhost(s) and VM(s). +| | +| | Show VPP vhost on all DUTs | ${nodes} +| | ${vnf_status} | ${value}= | Run Keyword And Ignore Error +| | ... | Keyword Should Exist | vnf_manager.Kill All VMs +| | Run Keyword If | '${vnf_status}' == 'PASS' | vnf_manager.Kill All VMs + +| Additional Test Tear Down Action For vhost-pt +| | [Documentation] +| | ... | Additional teardown for tests which uses pci-passtrough and VM(s). +| | +| | ${vnf_status} | ${value}= | Run Keyword And Ignore Error +| | ... | Keyword Should Exist | vnf_manager.Kill All VMs +| | Run Keyword If | '${vnf_status}' == 'PASS' | vnf_manager.Kill All VMs