====== FusionIO benchmarks ======
===== 16KB request size, 100GB file, ioDrive, raw results =====
==== Random read ====
^ type^ Threads ^ bytes/sec ^ req/sec ^ response time 95%, ms ^
| rndrd | 1| 140.59Mb| 8997.85| 0.11|
| rndrd | 4| 446.37Mb| 28567.50| 0.16|
| rndrd | 8| 530Mb| 33919.83| 0.28|
| rndrd | 16| 530.41Mb| 33946.24| 0.52|
| rndrd | 32| 696.18Mb| 44555.37| 1.10|
| rndrd | 64| 709.34Mb| 45398.08| 2.80|
| rndrd | 128| 711.69Mb| 45548.03| 6.55|
| rndrd | 512| 712.65Mb| 45609.86| 32.04|
=== RAID 10 ===
^ type^ Threads ^ bytes/sec ^ req/sec ^ response time 95%, ms ^
| rndrd | 1| 3.8238Mb| 244.72| 5.78|
| rndrd | 4| 12.003Mb| 768.19| 11.07|
| rndrd | 8| 21.97Mb| 1406.10| 13.16|
| rndrd | 16| 32.16Mb| 2058.27| 20.97|
| rndrd | 32| 42.608Mb| 2726.90| 35.30|
| rndrd | 64| 51.183Mb| 3275.68| 65.02|
| rndrd | 128| 58.903Mb| 3769.80| 119.04|
| rndrd | 512| 58.84Mb| 3765.74| 315.85|
==== Random write ====
^ type^ Threads ^ bytes/sec ^ req/sec ^ response time 95%, ms ^
| rndwr | 1| 131.68Mb| 8427.78| 0.11|
| rndwr | 4| 316.15Mb| 20233.38| 0.16|
| rndwr | 8| 162.96Mb| 10429.52| 0.87|
| rndwr | 16| 203Mb| 12992.17| 1.55|
| rndwr | 32| 204.09Mb| 13062.02| 19.71|
| rndwr | 64| 181.57Mb| 11620.78| 21.12|
| rndwr | 128| 187.38Mb| 11992.53| 27.01|
| rndwr | 512| 185.83Mb| 11893.13| 25.82|
==== RAID 10 ====
^ type^ Threads ^ bytes/sec ^ req/sec ^ response time 95%, ms ^
| rndwr | 1| 17.483Mb| 1118.90| 1.96|
| rndwr | 4| 18.934Mb| 1211.75| 5.22|
| rndwr | 8| 19.366Mb| 1239.44| 10.29|
| rndwr | 16| 19.24Mb| 1231.34| 21.94|
| rndwr | 32| 19.398Mb| 1241.48| 51.53|
| rndwr | 64| 19.449Mb| 1244.76| 128.40|
| rndwr | 128| 19.395Mb| 1241.30| 183.95|
| rndwr | 512| 19.666Mb| 1258.61| 970.20|
==== Random read/write ====
^ type^ Threads ^ bytes/sec ^ req/sec ^ response time 95%, ms ^
| rndrw | 1| 112.29Mb| 7186.47| 0.12|
| rndrw | 4| 238.96Mb| 15293.44| 0.41|
| rndrw | 8| 268.09Mb| 17157.47| 0.50|
| rndrw | 16| 280.24Mb| 17935.08| 0.90|
| rndrw | 32| 291.46Mb| 18653.19| 2.13|
| rndrw | 64| 294.29Mb| 18834.56| 11.90|
| rndrw | 128| 271.81Mb| 17395.96| 30.66|
| rndrw | 512| 268.31Mb| 17171.73| 33.24|
==== Sequential read ====
^ type^ Threads ^ bytes/sec ^ req/sec ^ response time 95%, ms ^
| seqrd | 1| 226.64Mb| 14504.75| 0.08|
| seqrd | 4| 544.12Mb| 34823.73| 0.14|
| seqrd | 8| 706.04Mb| 45186.61| 0.20|
| seqrd | 16| 728.45Mb| 46620.58| 0.37|
| seqrd | 32| 731Mb| 46784.02| 0.72|
| seqrd | 64| 729.61Mb| 46695.22| 1.53|
| seqrd | 128| 728.38Mb| 46616.61| 4.07|
| seqrd | 512| 733.21Mb| 46925.65| 33.13|
==== Sequential write ====
^ type^ Threads ^ bytes/sec ^ req/sec ^ response time 95%, ms ^
| seqwr | 1| 129.12Mb| 8263.75| 0.11|
| seqwr | 4| 99.434Mb| 6363.75| 1.05|
| seqwr | 8| 97.361Mb| 6231.11| 4.06|
| seqwr | 16| 84.424Mb| 5403.12| 8.44|
| seqwr | 32| 75.217Mb| 4813.89| 16.67|
| seqwr | 64| 75.735Mb| 4847.01| 37.87|
| seqwr | 128| 78.347Mb| 5014.19| 94.14|
| seqwr | 512| 72.744Mb| 4655.61| 223.80|
===== Write performance vs filesize =====
| 1G | rndwr | 1| 156.21Mb| 9997.36| 0.10|
| 1G | rndwr | 4| 486.54Mb| 31138.34| 0.14|
| 1G | rndwr | 8| 662.65Mb| 42409.48| 0.22|
| 1G | rndwr | 16| 622.38Mb| 39832.21| 0.43|
| 2G | rndwr | 1| 148.26Mb| 9488.49| 0.10|
| 2G | rndwr | 4| 432.08Mb| 27653.12| 0.15|
| 2G | rndwr | 8| 607.49Mb| 38879.54| 0.22|
| 2G | rndwr | 16| 618.2Mb| 39564.58| 0.43|
| 4G | rndwr | 1| 144.52Mb| 9249.05| 0.11|
| 4G | rndwr | 4| 450.64Mb| 28841.16| 0.15|
| 4G | rndwr | 8| 598.14Mb| 38280.90| 0.22|
| 4G | rndwr | 16| 609.26Mb| 38992.92| 0.42|
| 8G | rndwr | 1| 141.04Mb| 9026.67| 0.11|
| 8G | rndwr | 4| 428.67Mb| 27434.92| 0.15|
| 8G | rndwr | 8| 587.03Mb| 37569.68| 0.23|
| 8G | rndwr | 16| 601.22Mb| 38477.97| 0.43|
| 16G | rndwr | 1| 139.67Mb| 8939.10| 0.11|
| 16G | rndwr | 4| 424.4Mb| 27161.88| 0.15|
| 16G | rndwr | 8| 579.46Mb| 37085.25| 0.23|
| 16G | rndwr | 16| 589.89Mb| 37753.11| 0.43|
| 32G | rndwr | 1| 134.33Mb| 8596.88| 0.11|
| 32G | rndwr | 4| 443.59Mb| 28389.95| 0.15|
| 32G | rndwr | 8| 566.54Mb| 36258.29| 0.23|
| 32G | rndwr | 16| 554.73Mb| 35502.79| 0.48|
| 64G | rndwr | 1| 133.96Mb| 8573.70| 0.11|
| 64G | rndwr | 4| 432.25Mb| 27663.83| 0.15|
| 64G | rndwr | 8| 439.34Mb| 28117.54| 0.24|
| 64G | rndwr | 16| 414.28Mb| 26513.68| 0.63|
| 96G | rndwr | 1| 131.48Mb| 8415.03| 0.11|
| 96G | rndwr | 4| 418.78Mb| 26801.95| 0.15|
| 96G | rndwr | 8| 201.39Mb| 12888.96| 0.57|
| 96G | rndwr | 16| 249.74Mb| 15983.13| 1.44|
| 112G | rndwr | 1| 132.07Mb| 8452.25| 0.11|
| 112G | rndwr | 4| 317.76Mb| 20336.44| 0.16|
| 112G | rndwr | 8| 144.98Mb| 9278.94| 1.02|
| 112G | rndwr | 16| 179.78Mb| 11505.64| 1.74|
===== Appendix =====
==== Server specification ====
Dell PowerEdge R900
4 x QuadCore CPUS
Ubuntu 9.04
XFS filesystem with --nobarrier mount options
local storage: RAID 10 on 8 disks, 2.5", 15K RPMS
processor : 15
vendor_id : GenuineIntel
cpu family : 6
model : 15
model name : Intel(R) Xeon(R) CPU E7320 @ 2.13GHz
stepping : 11
cpu MHz : 2127.933
cache size : 2048 KB
physical id : 6
siblings : 4
core id : 3
cpu cores : 4
apicid : 27
initial apicid : 27
fpu : yes
fpu_exception : yes
cpuid level : 10
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca lahf_lm tpr_shadow vnmi flexpriority
bogomips : 4255.88
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management:
==== ioDrive info ====
fio-status -a
Found 1 ioDrive in this system
Fusion-io driver version: 1.2.6.5
fct0 Attached as 'fioa' (block device)
Fusion-io ioDimm3 160GB, Product Number:FS1-001-161-ES SN:04158
ioDimm3, PN:001194010, Mfr:000, Date:20081121
Firmware v36867
128.85 GBytes block device size, 198 GBytes physical device size, Samsung SLC
8192 blocks, 256 pages, 94528 bytes/page (25 pads, 1 planes, 4 banks)
Error correction: 11 bits per 240 bytes, retire above 4 bits
FPGA ID:0 Format UID:00000000103e013269e1000048e06800
PCI:13:00.0, Slot Number:4
Vendor:1aed, Device:1005, Sub vendor:1aed, Sub device:1010
Internal temperature: avg 48.2 degC, max 50.2 degC
Board temperature: 41 degC
Internal voltage: avg 0.973V, max 0.976V
Aux voltage: avg 2.479V, max 2.481V
Media status: Healthy; Reserves: 100.00%, warn at 10%
Data: 99.24%, MD: 99.27%
Lifetime data volumes:
Physical bytes written: 34,057,536,206,408
Physical bytes read : 27,373,034,350,472
==== sysbench script ====
#!/bin/sh
set -u
set -x
set -e
for size in 1G 2G 4G 8G 16G 32G 64G 96G 112G; do
for mode in seqwr seqrd rndrd rndwr rndrw; do
#for mode in rndwr; do
#for blksize in 512 4096 8192 16384 32768 65536 ; do
for blksize in 16384 ; do
./sysbench --test=fileio --file-num=64 --file-total-size=$size prepare
for threads in 1 4 8 16; do
#for threads in 1 4 8 16 32 64 128 512; do
echo "====== testing $blksize in $threads threads"
echo PARAMS $size $mode $threads $blksize > sysbench-size-$size-mode-$mode-threads-$threads-blksz-$blksize
./sysbench --test=fileio --file-total-size=$size --file-test-mode=$mode\
--max-time=120 --max-requests=100000000 --num-threads=$threads --init-rng=on \
--file-num=64 --file-extra-flags=direct --file-fsync-freq=0 --file-block-size=$blksize run \
| tee -a sysbench-size-$size-mode-$mode-threads-$threads-blksz-$blksize 2>&1
done
./sysbench --test=fileio --file-total-size=$size cleanup
done
done
done