- From: Greg Wilkins <gregw@intalio.com>
- Date: Fri, 18 Jul 2014 16:28:07 +1000
- To: Willy Tarreau <w@1wt.eu>
- Cc: HTTP Working Group <ietf-http-wg@w3.org>
- Message-ID: <CAH_y2NFWmJ19RFjrdKF=0X=P-xU+r3ur3Od_aYYGMzHJn7rkFQ@mail.gmail.com>
On 18 July 2014 15:49, Willy Tarreau <w@1wt.eu> wrote:
> BTW, I think that with the data you currently have and with your encoder,
> you
> could check how often a literal refers to the dynamic table in your data
> set,
> which will be a good indication of the relevance or not of my concern
> above.
>
Willy,
Below is the frequency distribution of the various field encodings uses and
their size, with some annotations. This is for my preferred option of the
noCopy static1 and a default 4K table. You can see that from 38037
fields, only 690(1.8%) of them needed 2 byte encoding, whilst 3594(9.4%)
used a 1 byte static index and 18884 (49.6%) used a 1 byte index to the
dynamic header table.
18884 IdxField 1 # 1B index to header table
3958 LitIdxName1HuffVal 23 # 1B name index, 22 byte huffman value
(date!)
3594 StaticIndexed 1 # 1B index to static table
1492 LitIdxName1HuffValIdxd 5 # 1B index, 4 byte huffman value
827 LitIdxName1HuffValIdxd 6
690 IdxField 2 # 2B index to static table
622 LitIdxName1HuffValIdxd 22
591 LitIdxName1HuffValIdxd 4
486 LitIdxName1HuffValIdxd 13
337 LitIdxName1HuffVal 22
324 LitIdxName1HuffValIdxd 7
312 LitIdxName1HuffVal 24
307 LitIdxName1HuffValIdxd 19
264 LitIdxName1HuffValIdxd 18
250 LitIdxName1HuffValIdxd 9
245 LitIdxName1HuffValIdxd 14
241 LitIdxName1HuffValIdxd 8
179 LitHuffNameHuffValIdxd 14
175 LitIdxName1HuffValIdxd 10
173 LitIdxName1HuffValIdxd 20
132 LitIdxName1HuffVal 17
124 LitIdxNameXHuffValIdxd 34
124 LitIdxName1HuffValIdxd 12
116 LitIdxName1HuffValIdxd 48
115 LitIdxName1HuffValIdxd 21
106 LitIdxNameXHuffValIdxd 11
105 LitIdxNameXHuffValIdxd 36
91 LitIdxName1HuffValIdxd 15
86 LitHuffNameHuffValIdxd 18
75 LitIdxName1HuffValIdxd 3
74 LitHuffNameHuffValIdxd 25
69 LitIdxName1HuffValIdxd 11
64 LitIdxNameXHuffValIdxd 52
64 LitIdxNameXHuffValIdxd 51
64 LitIdxName1HuffVal 18
62 LitIdxName1HuffVal 5
60 LitHuffNameHuffValIdxd 20
57 LitIdxName1LitValNeverIdx 104
55 LitIdxNameXHuffValIdxd 7
52 LitIdxName1HuffValIdxd 47
49 LitIdxName1HuffValIdxd 44
48 LitIdxName1HuffValIdxd 24
48 LitIdxName1HuffVal 16
47 LitIdxName1HuffVal 12
45 LitIdxName1HuffValIdxd 50
44 LitIdxName1HuffValIdxd 23
44 LitIdxName1HuffValIdxd 17
42 LitIdxNameXHuffValIdxd 50
42 LitIdxName1HuffValIdxd 16
41 LitIdxNameXHuffValIdxd 53
41 LitIdxName1HuffValIdxd 27
41 LitIdxName1HuffVal 4
39 LitIdxNameXHuffValIdxd 37
39 LitIdxNameXHuffValIdxd 14
37 LitHuffNameHuffValIdxd 21
35 LitIdxName1HuffValIdxd 28
34 LitHuffNameHuffValIdxd 16
33 LitIdxName1HuffVal 19
31 LitIdxName1HuffValIdxd 29
30 LitIdxName1LitValNeverIdx 100
29 LitIdxNameXHuffValIdxd 41
28 LitHuffNameHuffValIdxd 15
26 LitHuffNameHuffValIdxd 22
24 LitIdxName1LitValNeverIdx 91
24 LitIdxName1HuffValIdxd 35
23 LitIdxName1HuffValIdxd 39
20 LitIdxNameXHuffValIdxd 42
20 LitIdxNameXHuffValIdxd 10
20 LitIdxName1HuffValIdxd 32
20 LitHuffNameHuffValIdxd 24
19 LitHuffNameHuffValIdxd 26
18 LitIdxName1HuffValIdxd 43
17 LitIdxNameXHuffValIdxd 16
16 LitIdxName1HuffValIdxd 41
15 LitIdxNameXHuffValIdxd 54
15 LitIdxNameXHuffValIdxd 24
15 LitIdxName1LitValNeverIdx 98
15 LitIdxName1LitValNeverIdx 96
15 LitIdxName1HuffValIdxd 40
15 LitIdxName1HuffValIdxd 33
15 LitIdxName1HuffValIdxd 31
15 LitIdxName1HuffValIdxd 30
15 LitIdxName1HuffVal 28
15 LitIdxName1HuffVal 11
14 LitIdxName1LitValNeverIdx 81
14 LitIdxName1HuffValIdxd 25
14 LitHuffNameHuffValIdxd 183
13 LitIdxNameXHuffValIdxd 6
13 LitIdxNameXHuffValIdxd 132
13 LitIdxName1LitValNeverIdx 82
13 LitIdxName1HuffValIdxd 26
13 LitHuffNameHuffValIdxd 17
12 LitIdxNameXHuffValIdxd 85
12 LitIdxNameXHuffValIdxd 60
12 LitIdxNameXHuffValIdxd 59
12 LitIdxNameXHuffValIdxd 22
12 LitIdxName1LitValNeverIdx 78
12 LitIdxName1HuffValIdxd 106
12 LitHuffNameHuffValIdxd 27
11 LitIdxNameXHuffValIdxd 74
11 LitIdxNameXHuffValIdxd 46
11 LitIdxNameXHuffValIdxd 40
11 LitIdxNameXHuffValIdxd 109
11 LitIdxName1HuffValIdxd 59
11 LitHuffNameHuffValIdxd 13
11 LitHuffNameHuffValIdxd 11
10 LitIdxNameXHuffValIdxd 43
10 LitIdxNameXHuffValIdxd 39
10 LitIdxNameXHuffValIdxd 19
10 LitIdxNameXHuffValIdxd 12
10 LitIdxName1LitValNeverIdx 112
10 LitIdxName1HuffVal 26
10 LitHuffNameHuffValIdxd 30
10 LitHuffNameHuffValIdxd 157
9 LitIdxNameXHuffValIdxd 49
9 LitIdxNameXHuffValIdxd 25
9 LitIdxName1HuffValIdxd 46
9 LitIdxName1HuffValIdxd 38
9 LitIdxName1HuffValIdxd 34
9 LitIdxName1HuffValIdxd 109
9 LitHuffNameHuffValIdxd 28
9 LitHuffNameHuffValIdxd 23
8 LitIdxNameXHuffValIdxd 30
8 LitIdxNameXHuffValIdxd 26
8 LitIdxNameXHuffValIdxd 23
8 LitIdxNameXHuffValIdxd 21
8 LitIdxNameXHuffValIdxd 110
8 LitIdxName1LitValNeverIdx 14
8 LitIdxName1LitValNeverIdx 103
8 LitIdxName1HuffValIdxd 42
8 LitHuffNameHuffValIdxd 34
8 LitHuffNameHuffValIdxd 32
8 LitHuffNameHuffValIdxd 29
7 LitIdxNameXHuffValIdxd 35
7 LitIdxName1LitValNeverIdx 107
7 LitIdxName1HuffValIdxd 49
7 LitIdxName1HuffVal 15
7 LitHuffNameHuffValIdxd 12
6 LitIdxNameXHuffValIdxd 62
6 LitIdxNameXHuffValIdxd 58
6 LitIdxNameXHuffValIdxd 5
6 LitIdxNameXHuffValIdxd 44
6 LitIdxNameXHuffValIdxd 106
6 LitIdxName1LitValNeverIdx 86
6 LitIdxName1LitValNeverIdx 150
6 LitIdxName1LitValIdxd 26
6 LitIdxName1HuffValIdxd 45
6 LitIdxName1HuffVal 37
6 LitHuffNameHuffValIdxd 66
6 LitHuffNameHuffValIdxd 41
6 LitHuffNameHuffValIdxd 40
6 LitHuffNameHuffValIdxd 19
5 LitIdxNameXHuffValIdxd 9
5 LitIdxNameXHuffValIdxd 78
5 LitIdxNameXHuffValIdxd 38
5 LitIdxNameXHuffValIdxd 29
5 LitIdxNameXHuffValIdxd 17
5 LitIdxNameXHuffValIdxd 15
5 LitIdxNameXHuffValIdxd 13
5 LitIdxName1LitValNeverIdx 84
5 LitIdxName1LitValNeverIdx 76
5 LitIdxName1LitValNeverIdx 356
5 LitIdxName1LitValNeverIdx 143
5 LitIdxName1HuffValIdxd 64
5 LitIdxName1HuffValIdxd 61
5 LitIdxName1HuffValIdxd 55
5 LitIdxName1HuffValIdxd 36
5 LitIdxName1HuffVal 35
5 LitIdxName1HuffVal 27
5 LitHuffNameHuffValIdxd 80
5 LitHuffNameHuffValIdxd 50
4 LitIdxNameXHuffValIdxd 91
4 LitIdxNameXHuffValIdxd 86
4 LitIdxNameXHuffValIdxd 57
4 LitIdxNameXHuffValIdxd 20
4 LitIdxNameXHuffValIdxd 18
4 LitIdxNameXHuffValIdxd 154
4 LitIdxNameXHuffValIdxd 125
4 LitIdxName1LitValNeverIdx 88
4 LitIdxName1LitValNeverIdx 64
4 LitIdxName1LitValNeverIdx 199
4 LitIdxName1LitValNeverIdx 169
4 LitIdxName1LitValNeverIdx 142
4 LitIdxName1LitValNeverIdx 118
4 LitIdxName1LitValNeverIdx 113
4 LitIdxName1HuffValIdxd 53
4 LitIdxName1HuffVal 34
4 LitIdxName1HuffVal 33
4 LitIdxName1HuffVal 14
4 LitIdxName1HuffVal 13
4 LitHuffNameHuffValIdxd 49
4 LitHuffNameHuffValIdxd 43
4 LitHuffNameHuffValIdxd 33
4 LitHuffNameHuffValIdxd 31
3 LitIdxNameXHuffValIdxd 77
3 LitIdxNameXHuffValIdxd 75
3 LitIdxNameXHuffValIdxd 71
3 LitIdxNameXHuffValIdxd 61
3 LitIdxNameXHuffValIdxd 48
3 LitIdxNameXHuffValIdxd 33
3 LitIdxNameXHuffValIdxd 28
3 LitIdxNameXHuffValIdxd 180
3 LitIdxName1LitValNeverIdx 97
3 LitIdxName1LitValNeverIdx 90
3 LitIdxName1LitValNeverIdx 63
3 LitIdxName1LitValNeverIdx 215
3 LitIdxName1LitValNeverIdx 200
3 LitIdxName1LitValNeverIdx 167
3 LitIdxName1LitValNeverIdx 160
3 LitIdxName1LitValNeverIdx 120
3 LitIdxName1LitValNeverIdx 109
3 LitIdxName1LitValNeverIdx 105
3 LitIdxName1HuffValIdxd 82
3 LitIdxName1HuffValIdxd 78
3 LitIdxName1HuffVal 36
3 LitIdxName1HuffVal 20
3 LitHuffNameHuffValIdxd 9
3 LitHuffNameHuffValIdxd 86
3 LitHuffNameHuffValIdxd 8
3 LitHuffNameHuffValIdxd 68
3 LitHuffNameHuffValIdxd 67
3 LitHuffNameHuffValIdxd 65
3 LitHuffNameHuffValIdxd 51
3 LitHuffNameHuffValIdxd 42
2 LitIdxNameXHuffValIdxd 81
2 LitIdxNameXHuffValIdxd 8
2 LitIdxNameXHuffValIdxd 73
2 LitIdxNameXHuffValIdxd 68
2 LitIdxNameXHuffValIdxd 64
2 LitIdxNameXHuffValIdxd 56
2 LitIdxNameXHuffValIdxd 55
2 LitIdxNameXHuffValIdxd 27
2 LitIdxNameXHuffValIdxd 105
2 LitIdxNameXHuffValIdxd 104
2 LitIdxName1LitValNeverIdx 92
2 LitIdxName1LitValNeverIdx 85
2 LitIdxName1LitValNeverIdx 79
2 LitIdxName1LitValNeverIdx 71
2 LitIdxName1LitValNeverIdx 54
2 LitIdxName1LitValNeverIdx 340
2 LitIdxName1LitValNeverIdx 305
2 LitIdxName1LitValNeverIdx 197
2 LitIdxName1LitValNeverIdx 186
2 LitIdxName1LitValNeverIdx 183
2 LitIdxName1LitValNeverIdx 149
2 LitIdxName1LitValNeverIdx 144
2 LitIdxName1LitValNeverIdx 131
2 LitIdxName1LitValNeverIdx 127
2 LitIdxName1LitValNeverIdx 117
2 LitIdxName1LitValNeverIdx 116
2 LitIdxName1LitValNeverIdx 110
2 LitIdxName1LitValNeverIdx 108
2 LitIdxName1LitValNeverIdx 102
2 LitIdxName1LitValIdxd 47
2 LitIdxName1LitValIdxd 278
2 LitIdxName1LitValIdxd 125
2 LitIdxName1LitValIdxd 10
2 LitIdxName1HuffValIdxd 92
2 LitIdxName1HuffValIdxd 72
2 LitIdxName1HuffValIdxd 68
2 LitIdxName1HuffValIdxd 52
2 LitIdxName1HuffValIdxd 37
2 LitIdxName1HuffValIdxd 2
2 LitIdxName1HuffVal 51
2 LitIdxName1HuffVal 31
2 LitIdxName1HuffVal 29
2 LitHuffNameHuffValIdxd 89
2 LitHuffNameHuffValIdxd 88
2 LitHuffNameHuffValIdxd 71
2 LitHuffNameHuffValIdxd 61
2 LitHuffNameHuffValIdxd 60
2 LitHuffNameHuffValIdxd 39
2 LitHuffNameHuffValIdxd 37
2 LitHuffNameHuffValIdxd 10
1 LitIdxNameXHuffValIdxd 95
1 LitIdxNameXHuffValIdxd 92
1 LitIdxNameXHuffValIdxd 89
1 LitIdxNameXHuffValIdxd 80
1 LitIdxNameXHuffValIdxd 79
1 LitIdxNameXHuffValIdxd 76
1 LitIdxNameXHuffValIdxd 67
1 LitIdxNameXHuffValIdxd 4
1 LitIdxNameXHuffValIdxd 209
1 LitIdxNameXHuffValIdxd 175
1 LitIdxNameXHuffValIdxd 120
1 LitIdxNameXHuffValIdxd 107
1 LitIdxNameXHuffValIdxd 100
1 LitIdxName1LitValNeverIdx 99
1 LitIdxName1LitValNeverIdx 94
1 LitIdxName1LitValNeverIdx 80
1 LitIdxName1LitValNeverIdx 74
1 LitIdxName1LitValNeverIdx 59
1 LitIdxName1LitValNeverIdx 45
1 LitIdxName1LitValNeverIdx 44
1 LitIdxName1LitValNeverIdx 397
1 LitIdxName1LitValNeverIdx 39
1 LitIdxName1LitValNeverIdx 372
1 LitIdxName1LitValNeverIdx 324
1 LitIdxName1LitValNeverIdx 301
1 LitIdxName1LitValNeverIdx 293
1 LitIdxName1LitValNeverIdx 289
1 LitIdxName1LitValNeverIdx 285
1 LitIdxName1LitValNeverIdx 281
1 LitIdxName1LitValNeverIdx 277
1 LitIdxName1LitValNeverIdx 273
1 LitIdxName1LitValNeverIdx 269
1 LitIdxName1LitValNeverIdx 266
1 LitIdxName1LitValNeverIdx 23
1 LitIdxName1LitValNeverIdx 225
1 LitIdxName1LitValNeverIdx 219
1 LitIdxName1LitValNeverIdx 214
1 LitIdxName1LitValNeverIdx 209
1 LitIdxName1LitValNeverIdx 189
1 LitIdxName1LitValNeverIdx 184
1 LitIdxName1LitValNeverIdx 179
1 LitIdxName1LitValNeverIdx 176
1 LitIdxName1LitValNeverIdx 174
1 LitIdxName1LitValNeverIdx 172
1 LitIdxName1LitValNeverIdx 162
1 LitIdxName1LitValNeverIdx 159
1 LitIdxName1LitValNeverIdx 154
1 LitIdxName1LitValNeverIdx 138
1 LitIdxName1LitValNeverIdx 134
1 LitIdxName1LitValNeverIdx 133
1 LitIdxName1LitValNeverIdx 129
1 LitIdxName1LitValNeverIdx 126
1 LitIdxName1LitValNeverIdx 124
1 LitIdxName1LitValNeverIdx 121
1 LitIdxName1LitValNeverIdx 106
1 LitIdxName1LitValNeverIdx 101
1 LitIdxName1LitValIdxd 89
1 LitIdxName1LitValIdxd 68
1 LitIdxName1LitValIdxd 57
1 LitIdxName1LitValIdxd 53
1 LitIdxName1LitValIdxd 40
1 LitIdxName1LitValIdxd 366
1 LitIdxName1LitValIdxd 36
1 LitIdxName1LitValIdxd 347
1 LitIdxName1LitValIdxd 34
1 LitIdxName1LitValIdxd 299
1 LitIdxName1LitValIdxd 262
1 LitIdxName1LitValIdxd 249
1 LitIdxName1LitValIdxd 177
1 LitIdxName1LitValIdxd 134
1 LitIdxName1LitValIdxd 102
1 LitIdxName1HuffValIdxd 960
1 LitIdxName1HuffValIdxd 87
1 LitIdxName1HuffValIdxd 84
1 LitIdxName1HuffValIdxd 81
1 LitIdxName1HuffValIdxd 80
1 LitIdxName1HuffValIdxd 77
1 LitIdxName1HuffValIdxd 76
1 LitIdxName1HuffValIdxd 75
1 LitIdxName1HuffValIdxd 74
1 LitIdxName1HuffValIdxd 73
1 LitIdxName1HuffValIdxd 718
1 LitIdxName1HuffValIdxd 70
1 LitIdxName1HuffValIdxd 69
1 LitIdxName1HuffValIdxd 674
1 LitIdxName1HuffValIdxd 67
1 LitIdxName1HuffValIdxd 65
1 LitIdxName1HuffValIdxd 639
1 LitIdxName1HuffValIdxd 63
1 LitIdxName1HuffValIdxd 62
1 LitIdxName1HuffValIdxd 60
1 LitIdxName1HuffValIdxd 58
1 LitIdxName1HuffValIdxd 567
1 LitIdxName1HuffValIdxd 54
1 LitIdxName1HuffValIdxd 522
1 LitIdxName1HuffValIdxd 51
1 LitIdxName1HuffValIdxd 493
1 LitIdxName1HuffValIdxd 466
1 LitIdxName1HuffValIdxd 445
1 LitIdxName1HuffValIdxd 420
1 LitIdxName1HuffValIdxd 377
1 LitIdxName1HuffValIdxd 370
1 LitIdxName1HuffValIdxd 342
1 LitIdxName1HuffValIdxd 299
1 LitIdxName1HuffValIdxd 255
1 LitIdxName1HuffValIdxd 180
1 LitIdxName1HuffValIdxd 178
1 LitIdxName1HuffValIdxd 177
1 LitIdxName1HuffValIdxd 141
1 LitIdxName1HuffVal 3
1 LitIdxName1HuffVal 25
1 LitIdxName1HuffVal 21
1 LitHuffNameHuffValIdxd 96
1 LitHuffNameHuffValIdxd 93
1 LitHuffNameHuffValIdxd 81
1 LitHuffNameHuffValIdxd 72
1 LitHuffNameHuffValIdxd 47
1 LitHuffNameHuffValIdxd 44
1 LitHuffNameHuffValIdxd 36
1 LitHuffNameHuffValIdxd 35
1 LitHuffNameHuffValIdxd 135
1 LitHuffNameHuffValIdxd 128
1 LitHuffNameHuffValIdxd 109
--
Greg Wilkins <gregw@intalio.com>
http://eclipse.org/jetty HTTP, SPDY, Websocket server and client that scales
http://www.webtide.com advice and support for jetty and cometd.
Received on Friday, 18 July 2014 06:28:40 UTC