W3C home > Mailing lists > Public > public-qa-dev@w3.org > January 2008

quickie markup validator benchmark

From: Olivier Thereaux <ot@w3.org>
Date: Thu, 31 Jan 2008 16:35:13 +0900
To: public-qa-dev@w3.org
Message-ID: <20080131073513.GA900@w3.mag.keio.ac.jp>


I wanted to see how bad the markup validator would perform if I added
XML::Parser for Appendix C checking in XHTML 1.0, and ended up making a
small batch of apache benchmarking between 0.7.4 and the current HEAD.

Tests were done on qa-dev (a moderate machine with moderate load).


validator 0.8.3 - html2 short document / XHTML+SVG+mathml moderate
sample

ab -n500 -c5 -t30
"http://localhost/wmvs/HEAD/check?uri=http%3A%2F%2Fqa-dev.w3.org%2Fwmvs%2FHEAD%2Fdev%2Ftests%2Fhtml20.html"


Concurrency Level:      5
Time taken for tests:   30.40690 seconds
Complete requests:      825
Failed requests:        0
Write errors:           0
Total transferred:      13247792 bytes
HTML transferred:       12961996 bytes
Requests per second:    27.46 [#/sec] (mean)
Time per request:       182.065 [ms] (mean)
Time per request:       36.413 [ms] (mean, across all concurrent
requests)
Transfer rate:          430.65 [Kbytes/sec] received

ab -n500 -c1 -t30
"http://localhost/wmvs/HEAD/check?uri=http%3A%2F%2Fqa-dev.w3.org%2Fwmvs%2FHEAD%2Fdev%2Ftests%2Fhtml20.html"

Concurrency Level:      1
Time taken for tests:   30.20364 seconds
Complete requests:      766
Failed requests:        0
Write errors:           0
Total transferred:      12300960 bytes
HTML transferred:       12035578 bytes
Requests per second:    25.52 [#/sec] (mean)
Time per request:       39.191 [ms] (mean)
Time per request:       39.191 [ms] (mean, across all concurrent
requests)
Transfer rate:          400.13 [Kbytes/sec] received

ab -n500 -c2 -t30
"http://localhost/wmvs/HEAD/check?uri=http%3A%2F%2Fqa-dev.w3.org%2Fwmvs%2FHEAD%2Fdev%2Ftests%2Fhtml20.html"

Concurrency Level:      2
Time taken for tests:   30.15470 seconds
Complete requests:      867
Failed requests:        0
Write errors:           0
Total transferred:      13921808 bytes
HTML transferred:       13621480 bytes
Requests per second:    28.89 [#/sec] (mean)
Time per request:       69.240 [ms] (mean)
Time per request:       34.620 [ms] (mean, across all concurrent
requests)
Transfer rate:          452.93 [Kbytes/sec] received

ab -n500 -c1 -t30
"http://localhost/wmvs/HEAD/check?uri=http%3A%2F%2Fwww.w3.org%2FTR%2FXHTMLplusMathMLplusSVG%2Fsample.xhtml"

Concurrency Level:      1
Time taken for tests:   30.210331 seconds
Complete requests:      88
Failed requests:        0
Write errors:           0
Total transferred:      1276184 bytes
HTML transferred:       1245390 bytes
Requests per second:    2.91 [#/sec] (mean)
Time per request:       343.299 [ms] (mean)
Time per request:       343.299 [ms] (mean, across all concurrent
requests)
Transfer rate:          41.24 [Kbytes/sec] received

ab -n500 -c2 -t30
"http://localhost/wmvs/HEAD/check?uri=http%3A%2F%2Fwww.w3.org%2FTR%2FXHTMLplusMathMLplusSVG%2Fsample.xhtml"

Concurrency Level:      2
Time taken for tests:   30.349883 seconds
Complete requests:      102
Failed requests:        0
Write errors:           0
Total transferred:      1477910 bytes
HTML transferred:       1442272 bytes
Requests per second:    3.36 [#/sec] (mean)
Time per request:       595.096 [ms] (mean)
Time per request:       297.548 [ms] (mean, across all concurrent
requests)
Transfer rate:          47.55 [Kbytes/sec] received

ab -n500 -c5 -t30
"http://localhost/wmvs/HEAD/check?uri=http%3A%2F%2Fwww.w3.org%2FTR%2FXHTMLplusMathMLplusSVG%2Fsample.xhtml"

Concurrency Level:      5
Time taken for tests:   30.85118 seconds
Complete requests:      99
Failed requests:        0
Write errors:           0
Total transferred:      1434683 bytes
HTML transferred:       1400083 bytes
Requests per second:    3.29 [#/sec] (mean)
Time per request:       1519.450 [ms] (mean)
Time per request:       303.890 [ms] (mean, across all concurrent
requests)
Transfer rate:          46.57 [Kbytes/sec] received



Same with 0.7.4 on the same machine



ab -n500 -c1 -t30
"http://localhost/wmvs/0.7.4/check?uri=http%3A%2F%2Fqa-dev.w3.org%2Fwmvs%2FHEAD%2Fdev%2Ftests%2Fhtml20.html"

Concurrency Level:      1
Time taken for tests:   30.349498 seconds
Complete requests:      46
Failed requests:        44
   (Connect: 0, Length: 44, Exceptions: 0)
Write errors:           0
Total transferred:      575249 bytes
HTML transferred:       558987 bytes
Requests per second:    1.52 [#/sec] (mean)
Time per request:       659.772 [ms] (mean)
Time per request:       659.772 [ms] (mean, across all concurrent
requests)
Transfer rate:          18.48 [Kbytes/sec] received


ab -n500 -c2 -t30
"http://localhost/wmvs/0.7.4/check?uri=http%3A%2F%2Fqa-dev.w3.org%2Fwmvs%2FHEAD%2Fdev%2Ftests%2Fhtml20.html"

Concurrency Level:      2
Time taken for tests:   30.228441 seconds
Complete requests:      52
Failed requests:        50
   (Connect: 0, Length: 50, Exceptions: 0)
Write errors:           0
Total transferred:      645455 bytes
HTML transferred:       627117 bytes
Requests per second:    1.72 [#/sec] (mean)
Time per request:       1162.632 [ms] (mean)
Time per request:       581.316 [ms] (mean, across all concurrent
requests)
Transfer rate:          20.84 [Kbytes/sec] received


ab -n500 -c5 -t30
"http://localhost/wmvs/0.7.4/check?uri=http%3A%2F%2Fqa-dev.w3.org%2Fwmvs%2FHEAD%2Fdev%2Ftests%2Fhtml20.html"

Concurrency Level:      5
Time taken for tests:   30.69671 seconds
Complete requests:      50
Failed requests:        46
   (Connect: 0, Length: 46, Exceptions: 0)
Write errors:           0
Total transferred:      625140 bytes
HTML transferred:       607241 bytes
Requests per second:    1.66 [#/sec] (mean)
Time per request:       3006.967 [ms] (mean)
Time per request:       601.393 [ms] (mean, across all concurrent
requests)
Transfer rate:          20.29 [Kbytes/sec] received


ab -n500 -c1 -t30
"http://localhost/wmvs/0.7.4/check?uri=http%3A%2F%2Fwww.w3.org%2FTR%2FXHTMLplusMathMLplusSVG%2Fsample.xhtml"

Concurrency Level:      1
Time taken for tests:   30.446677 seconds
Complete requests:      33
Failed requests:        29
   (Connect: 0, Length: 29, Exceptions: 0)
Write errors:           0
Total transferred:      394471 bytes
HTML transferred:       382707 bytes
Requests per second:    1.08 [#/sec] (mean)
Time per request:       922.627 [ms] (mean)
Time per request:       922.627 [ms] (mean, across all concurrent
requests)
Transfer rate:          12.65 [Kbytes/sec] received

ab -n500 -c2 -t30
"http://localhost/wmvs/0.7.4/check?uri=http%3A%2F%2Fwww.w3.org%2FTR%2FXHTMLplusMathMLplusSVG%2Fsample.xhtml"

Concurrency Level:      2
Time taken for tests:   30.52482 seconds
Complete requests:      37
Failed requests:        34
   (Connect: 0, Length: 34, Exceptions: 0)
Write errors:           0
Total transferred:      437575 bytes
HTML transferred:       424381 bytes
Requests per second:    1.23 [#/sec] (mean)
Time per request:       1624.459 [ms] (mean)
Time per request:       812.229 [ms] (mean, across all concurrent
requests)
Transfer rate:          14.21 [Kbytes/sec] received


ab -n500 -c5 -t30
"http://localhost/wmvs/0.7.4/check?uri=http%3A%2F%2Fwww.w3.org%2FTR%2FXHTMLplusMathMLplusSVG%2Fsample.xhtml"

Concurrency Level:      5
Time taken for tests:   30.882024 seconds
Complete requests:      36
Failed requests:        35
   (Connect: 0, Length: 35, Exceptions: 0)
Write errors:           0
Total transferred:      429838 bytes
HTML transferred:       416760 bytes
Requests per second:    1.17 [#/sec] (mean)
Time per request:       4289.170 [ms] (mean)
Time per request:       857.834 [ms] (mean, across all concurrent
requests)
Transfer rate:          13.57 [Kbytes/sec] received


-- 
olivier
Received on Thursday, 31 January 2008 07:35:22 GMT

This archive was generated by hypermail 2.2.0+W3C-0.50 : Thursday, 19 August 2010 18:12:48 GMT