Report: Add 2n-skx Soak and Reconf tests
[csit.git] / docs / report / introduction / report_history.rst
1 Report History
2 ==============
3
4 FD.io CSIT-2001 Report history and per .[ww] revision changes are listed below.
5
6 +----------------+------------------------------------------------------------+
7 | .[ww] Revision | Changes                                                    |
8 +================+============================================================+
9 <<<<<<< HEAD   (b95753 PAL: Fix table data model)
10 <<<<<<< HEAD   (ede849 Report: Add pdf version)
11 <<<<<<< HEAD   (35a360 Report: Add data)
12 =======
13 <<<<<<< HEAD   (ef4187 Report: Add pdf version)
14 >>>>>>> CHANGE (68013a Report: Configure report 2001.15)
15 | .13            | 1. Added data:                                             |
16 =======
17 <<<<<<< HEAD   (ede849 Report: Add pdf version)
18 <<<<<<< HEAD   (d4f9e9 CSIT-1597 API cleanup: acl)
19 | .12            | 1. Added data:                                             |
20 =======
21 =======
22 <<<<<<< HEAD   (9b9bbb PAL: Fix table data model)
23 >>>>>>> CHANGE (8f2816 Report: Configure report 2001.16)
24 | .14            | 1. Added data:                                             |
25 <<<<<<< HEAD   (b95753 PAL: Fix table data model)
26 >>>>>>> CHANGE (0ed80e Report: COnfigure reoirt 2001.14)
27 >>>>>>> CHANGE (bdfc93 Report: COnfigure reoirt 2001.14)
28 =======
29 | .15            | 1. Added data:                                             |
30 >>>>>>> CHANGE (8e601d Report: Configure report 2001.15)
31 >>>>>>> CHANGE (68013a Report: Configure report 2001.15)
32 =======
33 =======
34 | .16            | 1. Added data:                                             |
35 >>>>>>> CHANGE (42a491 Report: Configure report 2001.16)
36 >>>>>>> CHANGE (8f2816 Report: Configure report 2001.16)
37 |                |                                                            |
38 |                |    - VPP performance tests 2n-skx                          |
39 |                |                                                            |
40 |                |      - all set selected for analysis and graphs            |
41 |                |      - MRR tests                                           |
42 |                |                                                            |
43 |                |    - VPP performance tests 3n-skx                          |
44 |                |                                                            |
45 |                |      - all set selected for analysis and graphs            |
46 |                |      - MRR tests                                           |
47 |                |                                                            |
48 <<<<<<< HEAD   (bd7b2e Report: Comparison tables)
49 =======
50 |                |    - Hoststack 3n-hsw tests                                |
51 |                |                                                            |
52 |                |    - Reconfiguration Tests 2n-skx                          |
53 |                |                                                            |
54 |                |    - Soak Tests 2n-skx                                     |
55 |                |                                                            |
56 >>>>>>> CHANGE (b1af33 Report: Add 2n-skx Soak and Reconf tests)
57 |                |  2. Added Root Cause Analysis for VPP performance tests    |
58 |                |     2n-skx and 3n-skx.                                     |
59 |                |                                                            |
60 +----------------+------------------------------------------------------------+
61 <<<<<<< HEAD   (b95753 PAL: Fix table data model)
62 <<<<<<< HEAD   (ede849 Report: Add pdf version)
63 <<<<<<< HEAD   (35a360 Report: Add data)
64 =======
65 <<<<<<< HEAD   (ef4187 Report: Add pdf version)
66 =======
67 | .14            | Skipped.                                                   |
68 +----------------+------------------------------------------------------------+
69 | .13            | Skipped.                                                   |
70 +----------------+------------------------------------------------------------+
71 >>>>>>> CHANGE (8e601d Report: Configure report 2001.15)
72 >>>>>>> CHANGE (68013a Report: Configure report 2001.15)
73 | .12            | Skipped.                                                   |
74 +----------------+------------------------------------------------------------+
75 =======
76 <<<<<<< HEAD   (d4f9e9 CSIT-1597 API cleanup: acl)
77 =======
78 =======
79 <<<<<<< HEAD   (9b9bbb PAL: Fix table data model)
80 =======
81 | .15            | Skipped.                                                   |
82 +----------------+------------------------------------------------------------+
83 | .14            | Skipped.                                                   |
84 +----------------+------------------------------------------------------------+
85 >>>>>>> CHANGE (42a491 Report: Configure report 2001.16)
86 >>>>>>> CHANGE (8f2816 Report: Configure report 2001.16)
87 | .13            | Skipped.                                                   |
88 +----------------+------------------------------------------------------------+
89 | .12            | Skipped.                                                   |
90 +----------------+------------------------------------------------------------+
91 >>>>>>> CHANGE (0ed80e Report: COnfigure reoirt 2001.14)
92 >>>>>>> CHANGE (bdfc93 Report: COnfigure reoirt 2001.14)
93 | .11            | 1. Added Soak tests                                        |
94 |                |                                                            |
95 |                | 2. Added data:                                             |
96 |                |                                                            |
97 |                |    - VPP performance tests 3n-tsh                          |
98 |                |                                                            |
99 |                |      - all set selected for analysis and graphs            |
100 |                |                                                            |
101 +----------------+------------------------------------------------------------+
102 | .10            | 1. Added data:                                             |
103 |                |                                                            |
104 |                |    - VPP performance tests 3n-hsw                          |
105 |                |                                                            |
106 |                |      - test sets IP4, IPSec                                |
107 |                |      - sets selected for analysis and graphs               |
108 |                |                                                            |
109 |                |    - VPP performance tests 2n-clx                          |
110 |                |                                                            |
111 |                |      - test sets IP4, IP6, L2, Memif, loadbalancer, VHost  |
112 |                |        VTS                                                 |
113 |                |      - all sets selected for analysis and graphs           |
114 |                |                                                            |
115 |                | 2. Added reconfiguration tests:                            |
116 |                |                                                            |
117 |                |    - 2n-clx                                                |
118 |                |                                                            |
119 |                | 3. Added Hoststack tests                                   |
120 |                |                                                            |
121 |                | 4. Edited Test Methodology --> Hoststack Testing           |
122 |                |                                                            |
123 |                | 5. Added TCP/IP tests                                      |
124 |                |                                                            |
125 +----------------+------------------------------------------------------------+
126 | .09            | 1. Added data:                                             |
127 |                |                                                            |
128 |                |    - VPP performance tests 3n-hsw                          |
129 |                |                                                            |
130 |                |      - test sets IP4, L2, VHost                            |
131 |                |                                                            |
132 |                |    - VPP performance tests 2n-clx                          |
133 |                |                                                            |
134 |                |      - test sets IP4, IP6, L2                              |
135 |                |      - all sets selected for analysis and graphs           |
136 |                |                                                            |
137 |                |    - VPP performance tests 3n-dnv                          |
138 |                |                                                            |
139 |                |      - test sets IPSec, IP4 Tunnels                        |
140 |                |                                                            |
141 |                |    - VPP performance tests 3n-tsh                          |
142 |                |                                                            |
143 |                |      - all set selected for analysis and graphs            |
144 |                |                                                            |
145 |                |    - VPP MRR tests 2n-clx                                  |
146 |                |                                                            |
147 |                |      - all sets selected for analysis and graphs           |
148 |                |                                                            |
149 |                |    - DPDK performance tests 2n-clx                         |
150 |                |                                                            |
151 |                |      - all sets selected for analysis and graphs           |
152 |                |                                                            |
153 +----------------+------------------------------------------------------------+
154 | .08            | 1. Added PDF version                                       |
155 |                |                                                            |
156 |                | 2. Added data:                                             |
157 |                |                                                            |
158 |                |    - VPP performance tests 3n-hsw                          |
159 |                |    - VPP performance tests 3n-tsh                          |
160 |                |    - VPP MRR tests 3n-tsh                                  |
161 |                |    - DPDK performance tests 3n-tsh                         |
162 |                |                                                            |
163 |                | 3. Chapters "Detailed Results", "Test Configuration" and   |
164 |                |    "Test Operational Data" split into sub-chapters.        |
165 |                |                                                            |
166 +----------------+------------------------------------------------------------+
167 | .07            | Initial version                                            |
168 |                |                                                            |
169 +----------------+------------------------------------------------------------+
170
171 FD.io CSIT Reports follow CSIT-[yy][mm].[ww] numbering format, with version
172 denoted by concatenation of two digit year [yy] and two digit month [mm], and
173 maintenance revision identified by two digit calendar week number [ww].