head 1.12;
access;
symbols;
locks; strict;
comment @# @;
1.12
date 2007.01.29.16.33.33; author RicardoPereira; state Exp;
branches;
next 1.11;
1.11
date 2006.04.19.17.41.22; author RicardoPereira; state Exp;
branches;
next 1.10;
1.10
date 2006.04.19.17.40.35; author RicardoPereira; state Exp;
branches;
next 1.9;
1.9
date 2006.04.19.17.39.36; author RicardoPereira; state Exp;
branches;
next 1.8;
1.8
date 2006.04.19.17.36.49; author RicardoPereira; state Exp;
branches;
next 1.7;
1.7
date 2006.04.19.17.34.01; author RicardoPereira; state Exp;
branches;
next 1.6;
1.6
date 2006.04.19.17.31.03; author RicardoPereira; state Exp;
branches;
next 1.5;
1.5
date 2006.04.19.17.23.37; author RicardoPereira; state Exp;
branches;
next 1.4;
1.4
date 2006.04.19.16.41.10; author RicardoPereira; state Exp;
branches;
next 1.3;
1.3
date 2006.04.12.23.23.01; author RicardoPereira; state Exp;
branches;
next 1.2;
1.2
date 2006.04.12.23.19.12; author RicardoPereira; state Exp;
branches;
next 1.1;
1.1
date 2006.04.12.23.18.09; author RicardoPereira; state Exp;
branches;
next ;
desc
@Added benchmark for resolver
.
@
1.12
log
@none
@
text
@%META:TOPICINFO{author="RicardoPereira" date="1170088413" format="1.1" version="1.12"}%
---++ Benchmarks for TDWG Standards LSID Resolver
---+++ Results Summary
| |*Low Load* | *Medium Load* | *High Load* |
| Plain CGI | 624 ms | 3168 ms | N/A |
| Mod Perl | 24 ms | 118 ms | 415 ms |
| Gain (CGI/Mod Perl) | 26x | 27x | N/A |
---+++ Recommendation
* Use *mod_perl* when using the Perl LSID Resolver Stack.
---+++ Benchmark Details
* [[LSIDResolverTdwgStandardsBenchmarksLowLoadCgi][Low Load - Plain CGI]]
* [[LSIDResolverTdwgStandardsBenchmarksMidLoadCgi][Medium Load - Plain CGI]]
* [[LSIDResolverTdwgStandardsBenchmarksLowLoadModPerl][Low Load - mod_perl]]
* [[LSIDResolverTdwgStandardsBenchmarksMidLoadModPerl][Medium Load - mod_perl]]
* [[LSIDResolverTdwgStandardsBenchmarksHiLoadModPerl][High Load - mod_perl]]
----
---+++++ Categories
CategoryWorkingGroup
CategoryPrototypingWG
@
1.11
log
@Added recommendation
.
@
text
@d1 1
d6 4
a9 2
{{table columns="4" cellpadding="1" cells="###;Low Load - Mean Time;Medium Load - Mean Time;High Load - Mean Time; Plain CGI;624 ms;3168 ms;N/A;Mod Perl;24 ms;118 ms;415 ms;Gain (CGI/Mod Perl);26x;27x;N/A"}}
d13 1
a13 1
*Use mod_perl when using the Perl LSID Resolver Stack!!!* In our case, it improved performance about 26 times.
d18 5
a22 5
[[LSIDResolverTdwgStandardsBenchmarksLowLoadCgi][Low Load - Plain CGI]]
[[LSIDResolverTdwgStandardsBenchmarksMidLoadCgi][Medium Load - Plain CGI]]
[[LSIDResolverTdwgStandardsBenchmarksLowLoadModPerl][Low Load - mod_perl]]
[[LSIDResolverTdwgStandardsBenchmarksMidLoadModPerl][Medium Load - mod_perl]]
[[LSIDResolverTdwgStandardsBenchmarksHiLoadModPerl][High Load - mod_perl]]
d29 1
@
1.10
log
@Added recommendation
.
@
text
@a6 1
---+++ Benchmark Details
d8 4
a11 1
Recommendation: *Use mod_perl when using the Perl LSID Resolver Stack!!!*
@
1.9
log
@Moved benchmarks to separate pages.
.
@
text
@d9 4
@
1.8
log
@
.
@
text
@a14 206
---+++ Plain CGI Setup (low load)
*Description:*
* Evaluated response times of resolver using *ab* (ApacheBench)
* This setup is using plain CGI. Major improvements are expected if mod_perl is used instead (50% gain, at least).
* Total Requests: 10
* Concurrency: 2
* Requests per second: 3.21 [#/sec] (mean)
* Time per request: 623.579 [ms] (mean)
*Command:*:
""
ab -n 10 -c 2 http://tdwgbox.tdwg.gbif.org/authority/metadata/?lsid=urn:lsid:lsid.tdwg.gbif.org:standards:64
""
*Output:*
""
[root@@condor ]# ab -n 10 -c 2 http://tdwgbox.tdwg.gbif.org/authority/metadata/
?lsid=urn:lsid:lsid.tdwg.gbif.org:standards:64
This is ApacheBench, Version 2.0.41-dev <$Revision: 1.141 $> apache-2.0
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/
Benchmarking tdwgbox.tdwg.gbif.org (be patient).....done
Server Software: Apache/2.0.52
Server Hostname: tdwgbox.tdwg.gbif.org
Server Port: 80
Document Path: /authority/metadata/?lsid=urn:lsid:lsid.tdwg.gbif.org:st
andards:64
Document Length: 3664 bytes
Concurrency Level: 2
Time taken for tests: 3.117896 seconds
Complete requests: 10
Failed requests: 0
Write errors: 0
Total transferred: 38250 bytes
HTML transferred: 36640 bytes
Requests per second: 3.21 [#/sec] (mean)
Time per request: 623.579 [ms] (mean)
Time per request: 311.790 [ms] (mean, across all concurrent requests)
Transfer rate: 11.87 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.9 0 2
Processing: 593 622 14.9 626 634
Waiting: 587 616 14.9 620 628
Total: 593 622 15.3 626 635
Percentage of the requests served within a certain time (ms)
50% 626
66% 633
75% 634
80% 635
90% 635
95% 635
98% 635
99% 635
100% 635 (longest request)
""
----
---+++ Plain CGI Setup (medium load)
*Description:*
* Evaluated response times of resolver using *ab* (ApacheBench)
* This setup is using plain CGI. Major improvements are expected if mod_perl is used instead (50% gain, at least).
* Total Requests: 100
* Concurrency: 10
* Requests per second: 3.16 [#/sec] (mean)
* Time per request: 3168.253 [ms] (mean)
*Command:*:
""
ab -n 100 -c 10 http://tdwgbox.tdwg.gbif.org/authority/metadata/?lsid=urn:lsid:lsid.tdwg.gbif.org:standards:64
""
*Output:*
""
[root@@condor ]# ab -n 100 -c 10 http://tdwgbox.tdwg.gbif.org/authority/metadat
a/?lsid=urn:lsid:lsid.tdwg.gbif.org:standards:64
This is ApacheBench, Version 2.0.41-dev <$Revision: 1.141 $> apache-2.0
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/
Benchmarking tdwgbox.tdwg.gbif.org (be patient).....done
Server Software: Apache/2.0.52
Server Hostname: tdwgbox.tdwg.gbif.org
Server Port: 80
Document Path: /authority/metadata/?lsid=urn:lsid:lsid.tdwg.gbif.org:st
andards:64
Document Length: 3664 bytes
Concurrency Level: 10
Time taken for tests: 31.682528 seconds
Complete requests: 100
Failed requests: 1
(Connect: 0, Length: 1, Exceptions: 0)
Write errors: 0
Non-2xx responses: 1
Total transferred: 379884 bytes
HTML transferred: 363734 bytes
Requests per second: 3.16 [#/sec] (mean)
Time per request: 3168.253 [ms] (mean)
Time per request: 316.825 [ms] (mean, across all concurrent requests)
Transfer rate: 11.68 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 210 769.3 0 3000
Processing: 600 2812 1298.2 2541 7957
Waiting: 593 2806 1298.7 2535 7951
Total: 601 3022 1690.4 2553 10957
Percentage of the requests served within a certain time (ms)
50% 2553
66% 2940
75% 3482
80% 4187
90% 5495
95% 6200
98% 8342
99% 10957
100% 10957 (longest request)
""
----
---+++ ModPerl Setup (low load)
*Description:*
* Evaluated response times of resolver using *ab* (ApacheBench)
* This setup is using mod_perl.
* Total Requests: 10
* Concurrency: 2
* Requests per second: 83.14 [#/sec] (mean)
* Time per request: 24.056 [ms] (mean)
*Command:*:
""
ab -n 10 -c 2 http://tdwgbox.tdwg.gbif.org/authority/metadata/?lsid=urn:lsid:lsid.tdwg.gbif.org:standards:64
""
*Output:*
""
[root@@condor ]# ab -n 10 -c 2 http://tdwgbox.tdwg.gbif.org/authority/metadata/
?lsid=urn:lsid:lsid.tdwg.gbif.org:standards:64
This is ApacheBench, Version 2.0.41-dev <$Revision: 1.141 $> apache-2.0
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/
Benchmarking tdwgbox.tdwg.gbif.org (be patient).....done
Server Software: Apache/2.0.52
Server Hostname: tdwgbox.tdwg.gbif.org
Server Port: 80
Document Path: /authority/metadata/?lsid=urn:lsid:lsid.tdwg.gbif.org:st
andards:64
Document Length: 3632 bytes
Concurrency Level: 2
Time taken for tests: 0.120278 seconds
Complete requests: 10
Failed requests: 0
Write errors: 0
Total transferred: 37930 bytes
HTML transferred: 36320 bytes
Requests per second: 83.14 [#/sec] (mean)
Time per request: 24.056 [ms] (mean)
Time per request: 12.028 [ms] (mean, across all concurrent requests)
Transfer rate: 307.62 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 0
Processing: 23 23 0.7 23 24
Waiting: 23 23 0.5 23 24
Total: 23 23 0.7 23 24
Percentage of the requests served within a certain time (ms)
50% 23
66% 24
75% 24
80% 24
90% 24
95% 24
98% 24
99% 24
100% 24 (longest request)
""
a15 70
---+++ ModPerl Setup (medium load)
*Description:*
* Evaluated response times of resolver using *ab* (ApacheBench)
* This setup is using plain CGI. Major improvements are expected if mod_perl is used instead (50% gain, at least).
* Total Requests: 10
* Concurrency: 2
* Requests per second: 84.59 [#/sec] (mean)
* Time per request: 118.220 [ms] (mean)
*Command:*:
""
ab -n 100 -c 10 http://tdwgbox.tdwg.gbif.org/authority/metadata/?lsid=urn:lsid:lsid.tdwg.gbif.org:standards:64
""
*Output:*
""
[root@@condor ]# ab -n 100 -c 10 http://tdwgbox.tdwg.gbif.org/authority/metadat
a/?lsid=urn:lsid:lsid.tdwg.gbif.org:standards:64
This is ApacheBench, Version 2.0.41-dev <$Revision: 1.141 $> apache-2.0
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/
Benchmarking tdwgbox.tdwg.gbif.org (be patient).....done
Server Software: Apache/2.0.52
Server Hostname: tdwgbox.tdwg.gbif.org
Server Port: 80
Document Path: /authority/metadata/?lsid=urn:lsid:lsid.tdwg.gbif.org:st
andards:64
Document Length: 3632 bytes
Concurrency Level: 10
Time taken for tests: 1.182199 seconds
Complete requests: 100
Failed requests: 0
Write errors: 0
Total transferred: 379300 bytes
HTML transferred: 363200 bytes
Requests per second: 84.59 [#/sec] (mean)
Time per request: 118.220 [ms] (mean)
Time per request: 11.822 [ms] (mean, across all concurrent requests)
Transfer rate: 312.98 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 0
Processing: 24 110 50.2 106 294
Waiting: 23 110 50.2 104 294
Total: 24 110 50.2 106 294
Percentage of the requests served within a certain time (ms)
50% 106
66% 127
75% 147
80% 157
90% 172
95% 199
98% 224
99% 294
100% 294 (longest request)
""
----
@
1.7
log
@
.
@
text
@d7 9
a15 1
----
@
1.6
log
@Added benchmarks using mod_perl and summary table.
.
@
text
@d5 1
a5 1
{{table columns="3" cellpadding="1" cells="###;Low Load Test Mean Time;Medium Load Test Mean Time;Plain CGI;624 ms;3168 ms;Mod Perl;24 ms;118 ms;Gain (CGI/Mod Perl);26x;27x"}}
@
1.5
log
@Added benchmarks using mod_perl
.
@
text
@d3 4
@
1.4
log
@
.
@
text
@d142 138
@
1.3
log
@
.
@
text
@d79 2
a80 2
* Requests per second: 3.21 [#/sec] (mean)
* Time per request: 623.579 [ms] (mean)
@
1.2
log
@
.
@
text
@d4 1
a4 1
---+++ Plain CGI Setup
d72 70
@
1.1
log
@Initial revision
@
text
@a8 2
* Command line: ab -n 10 -c 2 http://tdwgbox.tdwg.gbif.org/authority/metadata/
?lsid=urn:lsid:lsid.tdwg.gbif.org:standards:64
d14 4
@