X-Git-Url: https://gerrit.fd.io/r/gitweb?a=blobdiff_plain;f=docs%2Freport%2Fintroduction%2Freport_history.rst;h=44164cf34c9684f4cdd6159adf7bc0d57393fdd0;hb=99c3a7054b2789bc007e9fdfe57c7ae68a9a7459;hp=615437b364aeff8823728551e0862522608e5a50;hpb=2e6fbdb290ab6128403f1f6edcc6072644843f77;p=csit.git diff --git a/docs/report/introduction/report_history.rst b/docs/report/introduction/report_history.rst index 615437b364..44164cf34c 100644 --- a/docs/report/introduction/report_history.rst +++ b/docs/report/introduction/report_history.rst @@ -1,96 +1,194 @@ Report History ============== -FD.io CSIT-1810 Report history and per .[ww] revision changes are listed below. +FD.io CSIT-2001 Report history and per .[ww] revision changes are listed below. -+----------------+----------------------------------------------------------------+ -| .[ww] Revision | Changes | -+================+================================================================+ -| .49 | 1. Split pages with graphs. | -| | | -+----------------+----------------------------------------------------------------+ -| .48 | 1. Added configurations for Denverton: | -| | | -| | a. Packet throughput :ref:`vpp_perf_configurations_2n_dnv` | -| | b. MRR :ref:`vpp_mrr_configurations_2n_dnv` | -| | | -| | 2. Added operational data for Denverton: | -| | | -| | a. Packet throughput :ref:`vpp_perf_operational_2n_dnv` | -| | | -| | 3. Added graphs for Denverton: | -| | | -| | a. Packet Throughput - L2 Switching - | -| | :ref:`packet_throughput_graphs_l2sw-2n-dnv-x553` | -| | b. Packet Throughput - IPv4 Routing - | -| | :ref:`packet_throughput_graphs_ip4-2n-dnv-x553` | -| | c. Packet Throughput - IPv6 Routing - | -| | :ref:`packet_throughput_graphs_ip6-2n-dnv-x553` | -| | d. Speedup Multi-Core - L2 Switching - | -| | :ref:`speedup_graphs_l2sw-2n-dnv-x553` | -| | e. Speedup Multi-Core - IPv4 Routing - | -| | :ref:`speedup_graphs_ip4-2n-dnv-x553` | -| | f. Speedup Multi-Core - IPv6 Routing - | -| | :ref:`speedup_graphs_ip6-2n-dnv-x553` | -| | | -| | 4. Replaced Denverton data from revision .47 with the data | -| | provided by Intel for revision .48. | -| | | -| | 5. Changed revision format of the document, see description at | -| | the bottom of this page. | -| | | -+----------------+----------------------------------------------------------------+ -| .47 | 1. Added automated wrapping of long test names in graphs. | -| | 2. Changed data and time format in the header. | -| | 3. Changed versioning. | -| | 4. Added more test runs: | -| | | -| | a. HoneyComb Functional. | -| | b. VPP on 3n-hsw testbed. | -| | | -| | 5. Added 3n-skx and 2n-skx comparisons to Report: | -| | | -| | a. VPP Performance Tests: | -| | :ref:`vpp_compare_current_vs_previous_release` | -| | b. DPDK Performance Tests: | -| | :ref:`dpdk_compare_current_vs_previous_release` | -| | | -| | 6. Changed title of this chapter to "Document History" | -| | 7. Added comparisons between topologies: | -| | | -| | a. VPP: :ref:`vpp_compare_topologies_3n-Skx_vs_2n-Skx` | -| | b. DPDK: :ref:`dpdk_compare_topologies_3n-Skx_vs_2n-Skx` | -| | | -| | 8. Added results for Denverton: | -| | | -| | a. Packet throughput :ref:`vpp_performance_results_2n_dnv` | -| | b. MRR :ref:`vpp_mrr_results_2n_dnv` | -| | | -| | 9. Added the chapter "2-Node Atom Denverton (2n-dnv)" to | -| | :ref:`tested_physical_topologies` | -| | | -| | 10. Added the chapter "Calibration Data - Denverton" to | -| | :ref:`vpp_test_environment` | -| | | -+----------------+----------------------------------------------------------------+ -| .46 | 1. dot1q KVM VMs vhost-user tests added to | -| | :ref:`KVM_VMs_vhost`. | -| | | -| | 2. Added number of test runs used to generate data for all | -| | graphs | -| | | -| | a. :ref:`VPP_Packet_Throughput` | -| | b. :ref:`throughput_speedup_multi_core` | -| | c. :ref:`VPP_Packet_Latency` | -| | | -| | 3. Added more test runs: | -| | | -| | a. K8s Container Memif, | -| | b. VPP on 3n-hsw testbed. | -| | | -+----------------+----------------------------------------------------------------+ -| .45 | Initial version | -+----------------+----------------------------------------------------------------+ ++----------------+------------------------------------------------------------+ +| .[ww] Revision | Changes | ++================+============================================================+ +<<<<<<< HEAD (953d13 Report: Fix typo in specification.) +<<<<<<< HEAD (793b6b Report: Add data) +<<<<<<< HEAD (b95753 PAL: Fix table data model) +<<<<<<< HEAD (ede849 Report: Add pdf version) +<<<<<<< HEAD (35a360 Report: Add data) +======= +<<<<<<< HEAD (ef4187 Report: Add pdf version) +>>>>>>> CHANGE (68013a Report: Configure report 2001.15) +| .13 | 1. Added data: | +======= +<<<<<<< HEAD (ede849 Report: Add pdf version) +<<<<<<< HEAD (d4f9e9 CSIT-1597 API cleanup: acl) +| .12 | 1. Added data: | +======= +======= +<<<<<<< HEAD (9b9bbb PAL: Fix table data model) +>>>>>>> CHANGE (8f2816 Report: Configure report 2001.16) +| .14 | 1. Added data: | +<<<<<<< HEAD (b95753 PAL: Fix table data model) +>>>>>>> CHANGE (0ed80e Report: COnfigure reoirt 2001.14) +>>>>>>> CHANGE (bdfc93 Report: COnfigure reoirt 2001.14) +======= +| .15 | 1. Added data: | +>>>>>>> CHANGE (8e601d Report: Configure report 2001.15) +>>>>>>> CHANGE (68013a Report: Configure report 2001.15) +======= +======= +| .16 | 1. Added data: | +>>>>>>> CHANGE (42a491 Report: Configure report 2001.16) +>>>>>>> CHANGE (8f2816 Report: Configure report 2001.16) +======= +| .18 | 1. Added data: | +>>>>>>> CHANGE (dfd4a2 Report: Configure Report 2001.18) +======= +| .19 | 1. Added data: | +>>>>>>> CHANGE (413f1d Report: Configure report 2001.19) +| | | +| | - VPP performance tests 2n-skx | +| | | +| | - all set selected for analysis and graphs | +| | - MRR tests | +| | | +| | - VPP performance tests 3n-skx | +| | | +| | - all set selected for analysis and graphs | +| | - MRR tests | +| | | +<<<<<<< HEAD (bd7b2e Report: Comparison tables) +======= +| | - Hoststack 3n-hsw tests | +| | | +| | - Reconfiguration Tests 2n-skx | +| | | +| | - Soak Tests 2n-skx | +| | | +>>>>>>> CHANGE (b1af33 Report: Add 2n-skx Soak and Reconf tests) +| | 2. Added Root Cause Analysis for VPP performance tests | +| | 2n-skx and 3n-skx. | +| | | ++----------------+------------------------------------------------------------+ +<<<<<<< HEAD (953d13 Report: Fix typo in specification.) +<<<<<<< HEAD (793b6b Report: Add data) +<<<<<<< HEAD (b95753 PAL: Fix table data model) +<<<<<<< HEAD (ede849 Report: Add pdf version) +<<<<<<< HEAD (35a360 Report: Add data) +======= +<<<<<<< HEAD (ef4187 Report: Add pdf version) +======= +======= +======= +| .18 | Skipped. | ++----------------+------------------------------------------------------------+ +>>>>>>> CHANGE (413f1d Report: Configure report 2001.19) +| .17 | Skipped. | ++----------------+------------------------------------------------------------+ +| .16 | Skipped. | ++----------------+------------------------------------------------------------+ +| .15 | Skipped. | ++----------------+------------------------------------------------------------+ +>>>>>>> CHANGE (dfd4a2 Report: Configure Report 2001.18) +| .14 | Skipped. | ++----------------+------------------------------------------------------------+ +| .13 | Skipped. | ++----------------+------------------------------------------------------------+ +>>>>>>> CHANGE (8e601d Report: Configure report 2001.15) +>>>>>>> CHANGE (68013a Report: Configure report 2001.15) +| .12 | Skipped. | ++----------------+------------------------------------------------------------+ +======= +<<<<<<< HEAD (d4f9e9 CSIT-1597 API cleanup: acl) +======= +======= +<<<<<<< HEAD (9b9bbb PAL: Fix table data model) +======= +| .15 | Skipped. | ++----------------+------------------------------------------------------------+ +| .14 | Skipped. | ++----------------+------------------------------------------------------------+ +>>>>>>> CHANGE (42a491 Report: Configure report 2001.16) +>>>>>>> CHANGE (8f2816 Report: Configure report 2001.16) +| .13 | Skipped. | ++----------------+------------------------------------------------------------+ +| .12 | Skipped. | ++----------------+------------------------------------------------------------+ +>>>>>>> CHANGE (0ed80e Report: COnfigure reoirt 2001.14) +>>>>>>> CHANGE (bdfc93 Report: COnfigure reoirt 2001.14) +| .11 | 1. Added Soak tests | +| | | +| | 2. Added data: | +| | | +| | - VPP performance tests 3n-tsh | +| | | +| | - all set selected for analysis and graphs | +| | | ++----------------+------------------------------------------------------------+ +| .10 | 1. Added data: | +| | | +| | - VPP performance tests 3n-hsw | +| | | +| | - test sets IP4, IPSec | +| | - sets selected for analysis and graphs | +| | | +| | - VPP performance tests 2n-clx | +| | | +| | - test sets IP4, IP6, L2, Memif, loadbalancer, VHost | +| | VTS | +| | - all sets selected for analysis and graphs | +| | | +| | 2. Added reconfiguration tests: | +| | | +| | - 2n-clx | +| | | +| | 3. Added Hoststack tests | +| | | +| | 4. Edited Test Methodology --> Hoststack Testing | +| | | +| | 5. Added TCP/IP tests | +| | | ++----------------+------------------------------------------------------------+ +| .09 | 1. Added data: | +| | | +| | - VPP performance tests 3n-hsw | +| | | +| | - test sets IP4, L2, VHost | +| | | +| | - VPP performance tests 2n-clx | +| | | +| | - test sets IP4, IP6, L2 | +| | - all sets selected for analysis and graphs | +| | | +| | - VPP performance tests 3n-dnv | +| | | +| | - test sets IPSec, IP4 Tunnels | +| | | +| | - VPP performance tests 3n-tsh | +| | | +| | - all set selected for analysis and graphs | +| | | +| | - VPP MRR tests 2n-clx | +| | | +| | - all sets selected for analysis and graphs | +| | | +| | - DPDK performance tests 2n-clx | +| | | +| | - all sets selected for analysis and graphs | +| | | ++----------------+------------------------------------------------------------+ +| .08 | 1. Added PDF version | +| | | +| | 2. Added data: | +| | | +| | - VPP performance tests 3n-hsw | +| | - VPP performance tests 3n-tsh | +| | - VPP MRR tests 3n-tsh | +| | - DPDK performance tests 3n-tsh | +| | | +| | 3. Chapters "Detailed Results", "Test Configuration" and | +| | "Test Operational Data" split into sub-chapters. | +| | | ++----------------+------------------------------------------------------------+ +| .07 | Initial version | +| | | ++----------------+------------------------------------------------------------+ FD.io CSIT Reports follow CSIT-[yy][mm].[ww] numbering format, with version denoted by concatenation of two digit year [yy] and two digit month [mm], and