====== SSD benchmark ====== * 8 Intel X-25M 80GB SSD’s attached to 2 Adaptec 5805 Raid cards ( 4 cards / adapter) * Price: Intel X-25M 80GB = $259.95 ( on 12-Jan-2010, http://www.amazon.com/Intel-X25-M-Mainstream-SSDSA2MH080G2C1-Internal/dp/B002IGT7IK/ref=sr_1_3?ie=UTF8&s=electronics&qid=1263336558&sr=8-3) Vendor: INTEL Model: SSDSA2M080 Rev: 2CV1 Type: Direct-Access ANSI SCSI revision: 05 * Filesystem xfs mounted --nobarrier * Block size 16KB * OS: CentOS 5.4 * Description of setup. - In first runs (software) each card connected as individual card to Adaptec, so in OS we see 8 individual cards. Card configured in software RAIDs: RAID0, RAID10, RAID5, RAID50 - In second round (marked as hardware) each Adaptec is configured as hardware RAID0 over 4 cards, so in OS we see 2 devices. Devices connected in software RAIDs: RAID0 and RAID10 with different OS schedules over each device. Summary results (in MB/sec, more is better): * rndrd - random read, rndwr - random write, rndrw - random read/write, seqrd - seq reads, seqwr - seq writes ^type^threads^raid0^raid10^raid5^raid50^hw_raid0_cfq^hw_raid0_deadline^hw_raid10_cfq^hw_raid10_deadline^hw_raid10_noop^FusionIO 320GB MLC^ | rndrd | 1| 36.504| 36.61| 34.441| 34.011| 36.217| 36.874| 36.284| 35.846| 36.727| 114.71| | rndrd | 4| 156.9| 152.76| 127.11| 129.69| 167.92| 165.89| 160.49| 159.57| 162.36| 351.96| | rndrd | 8| 266.33| 258.9| 212.56| 221.69| 281.85| 284.71| 268.17| 265.96| 262.07| 385.09| | rndrd | 16| 386.5| 366.14| 312.6| 325.41| 412.32| 414.24| 361.98| 363.95| 360.13| 386.44| | rndrd | 32| 487.59| 473.09| 394.32| 394.18| 510.41| 511.75| 441.23| 444.64| 431.5| 535.55| | rndrd | 64| 787.49| 608.17| 442.12| 440.24| 771.59| 771.21| 638.68| 587.3| 534.85| 553.45| ^type^threads^raid0^raid10^raid5^raid50^hw_raid0_cfq^hw_raid0_deadline^hw_raid10_cfq^hw_raid10_deadline^hw_raid10_noop^FusionIO 320GB MLC^ | rndrw | 1| 39.212| 29.051| 21.566| 21.682| 30.273| 16.062| 23.192| 19.704| 17.22| 102.38| | rndrw | 4| 134.14| 72.353| 49.187| 58.86| 103.43| 59.752| 70.77| 63.285| 64.825| 210.26| | rndrw | 8| 209.78| 103.23| 57.715| 80.381| 140.14| 82.653| 90.571| 81.202| 82.509| 244| | rndrw | 16| 301.24| 127.96| 66.929| 87.963| 169.21| 106.95| 107.28| 97.062| 97.97| 318.95| | rndrw | 32| 328.76| 142.53| 67.314| 91.205| 184| 121.85| 117.6| 101.99| 109.46| 413.95| | rndrw | 64| 304.51| 115.25| 67.398| 80.983| 194.22| 137.27| 117.41| 112.08| 88.129| 454.13| ^type^threads^raid0^raid10^raid5^raid50^hw_raid0_cfq^hw_raid0_deadline^hw_raid10_cfq^hw_raid10_deadline^hw_raid10_noop^FusionIO 320GB MLC^ | rndwr | 1| 137.09| 72.511| 11.789| 12.795| 132.33| 124.34| 90.425| 93.608| 88.774| 149.33| | rndwr | 4| 285.12| 123.07| 19.92| 23.683| 173.68| 63.811| 49.729| 66.17| 55.521| 411.02| | rndwr | 8| 268.15| 55.241| 24.968| 32.637| 118.06| 62.66| 25.874| 33.359| 37.085| 455.25| | rndwr | 16| 203.91| 42.84| 29.002| 43.687| 145.06| 81.61| 32.809| 41.309| 41.761| 472.3| | rndwr | 32| 232.21| 49.197| 29.649| 43.409| 130.05| 82.946| 44.588| 42.821| 43.818| 457.6| | rndwr | 64| 252.05| 53.657| 30.376| 34.523| 123.71| 70.304| 51.392| 46.992| 49.284| 387.17| ^type^threads^raid0^raid10^raid5^raid50^hw_raid0_cfq^hw_raid0_deadline^hw_raid10_cfq^hw_raid10_deadline^hw_raid10_noop^FusionIO 320GB MLC^ | seqrd | 1| 203.54| 181.15| 123.08| 125.88| 199.48| 194.01| 183.99| 183.7| 210.38| 191.02| | seqrd | 4| 35.371| 29.78| 45.005| 44.182| 18.598| 431.47| 13.766| 236.26| 218.96| 518.28| | seqrd | 8| 52.729| 40.74| 55.241| 52.285| 27.044| 599.77| 24.69| 279.97| 229.95| 660.78| | seqrd | 16| 121.92| 78.601| 89.684| 94.378| 51.553| 582.67| 41.732| 245.12| 215.91| 680.16| | seqrd | 32| 226.07| 149.76| 139.11| 155.42| 95.273| 558.59| 71.007| 321| 313.5| 687.22| | seqrd | 64| 384.28| 266.66| 223.45| 249.74| 164.19| 610.68| 116.97| 505.39| 473.36| 688.18| ^type^threads^raid0^raid10^raid5^raid50^hw_raid0_cfq^hw_raid0_deadline^hw_raid10_cfq^hw_raid10_deadline^hw_raid10_noop^FusionIO 320GB MLC^ | seqwr | 1| 131.72| 85.9| 23.288| 9.6019| 126.26| 128.28| 93.684| 97.829| 93.428| 123.38| | seqwr | 4| 120.54| 85.339| 16.916| 8.3996| 116.48| 116.17| 92.205| 95.857| 84.388| 107.08| | seqwr | 8| 109.07| 64.678| 16.9| 7.1522| 106.56| 103.62| 81.552| 83.484| 76.786| 109.05| | seqwr | 16| 99.954| 68.896| 24.615| 14.149| 99.581| 92.456| 72.84| 80.678| 69.237| 96.236| | seqwr | 32| 94.988| 58.844| 22.097| 15.807| 91.136| 80.986| 62.421| 67.383| 62.516| 81.275| | seqwr | 64| 92.352| 58.778| 27.108| 15.348| 91.95| 85.602| 62.804| 70.593| 61.462| 78.732| ==== software RAID0 ==== mdadm --create /dev/md0 -v --raid-devices=8 --level=0 /dev/sdb /dev/sdc /dev/sdd /dev/sde /dev/sdf /dev/sdg /dev/sdh /dev/sdi mkfs.xfs /dev/md0 mount /dev/md0 /bench -o nobarrier size: /dev/md0 596G 5.1M 596G 1% /bench Results: ^ size^type^ thr^bytes/sec^req/sec^ | 100G | rndrd | 1| 36.504Mb| 2336.23| 0.44| | 100G | rndrd | 4| 156.9Mb| 10041.90| 0.49| | 100G | rndrd | 8| 266.33Mb| 17044.94| 0.61| | 100G | rndrd | 16| 386.5Mb| 24735.98| 1.02| | 100G | rndrd | 32| 487.59Mb| 31205.55| 2.07| | 100G | rndrd | 64| 787.49Mb| 50399.13| 1.97| | 100G | rndrw | 1| 39.212Mb| 2509.54| 0.96| | 100G | rndrw | 4| 134.14Mb| 8584.83| 1.61| | 100G | rndrw | 8| 209.78Mb| 13426.23| 1.81| | 100G | rndrw | 16| 301.24Mb| 19279.45| 2.10| | 100G | rndrw | 32| 328.76Mb| 21040.38| 3.20| | 100G | rndrw | 64| 304.51Mb| 19488.51| 11.95| | 100G | rndwr | 1| 137.09Mb| 8773.47| 0.15| | 100G | rndwr | 4| 285.12Mb| 18247.74| 0.33| | 100G | rndwr | 8| 268.15Mb| 17161.75| 0.73| | 100G | rndwr | 16| 203.91Mb| 13050.17| 3.69| | 100G | rndwr | 32| 232.21Mb| 14861.57| 7.08| | 100G | rndwr | 64| 252.05Mb| 16131.32| 14.35| | 100G | seqrd | 1| 203.54Mb| 13026.38| 0.11| | 100G | seqrd | 4| 35.371Mb| 2263.74| 8.02| | 100G | seqrd | 8| 52.729Mb| 3374.66| 8.07| | 100G | seqrd | 16| 121.92Mb| 7802.87| 8.01| | 100G | seqrd | 32| 226.07Mb| 14468.37| 8.13| | 100G | seqrd | 64| 384.28Mb| 24594.01| 8.50| | 100G | seqwr | 1| 131.72Mb| 8430.16| 0.16| | 100G | seqwr | 4| 120.54Mb| 7714.44| 1.55| | 100G | seqwr | 8| 109.07Mb| 6980.26| 3.85| | 100G | seqwr | 16| 99.954Mb| 6397.07| 8.20| | 100G | seqwr | 32| 94.988Mb| 6079.26| 16.59| | 100G | seqwr | 64| 92.352Mb| 5910.53| 32.98| ==== Software RAID10 ==== mdadm --create /dev/md0 -v --raid-devices=8 --level=10 /dev/sdb /dev/sdc /dev/sdd /dev/sde /dev/sdf /dev/sdg /dev/sdh /dev/sdi mkfs.xfs /dev/md0 mount /dev/md0 /bench -o nobarrier size: /dev/md0 298G 4.6M 298G 1% Results: ^ size^type^ thr^bytes/sec^req/sec^ | 100G | rndrd | 1| 36.61Mb| 2343.04| 0.43| | 100G | rndrd | 4| 152.76Mb| 9776.94| 0.51| | 100G | rndrd | 8| 258.9Mb| 16569.92| 0.62| | 100G | rndrd | 16| 366.14Mb| 23432.88| 1.27| | 100G | rndrd | 32| 473.09Mb| 30277.78| 2.36| | 100G | rndrd | 64| 608.17Mb| 38923.18| 3.45| | 100G | rndrw | 1| 29.051Mb| 1859.25| 1.48| | 100G | rndrw | 4| 72.353Mb| 4630.58| 1.85| | 100G | rndrw | 8| 103.23Mb| 6606.46| 2.20| | 100G | rndrw | 16| 127.96Mb| 8189.15| 3.71| | 100G | rndrw | 32| 142.53Mb| 9121.70| 9.78| | 100G | rndrw | 64| 115.25Mb| 7376.08| 35.57| | 100G | rndwr | 1| 72.511Mb| 4640.71| 0.26| | 100G | rndwr | 4| 123.07Mb| 7876.68| 0.69| | 100G | rndwr | 8| 55.241Mb| 3535.43| 10.71| | 100G | rndwr | 16| 42.84Mb| 2741.75| 24.07| | 100G | rndwr | 32| 49.197Mb| 3148.59| 40.72| | 100G | rndwr | 64| 53.657Mb| 3434.07| 77.08| | 100G | seqrd | 1| 181.15Mb| 11593.63| 0.14| | 100G | seqrd | 4| 29.78Mb| 1905.89| 8.13| | 100G | seqrd | 8| 40.74Mb| 2607.34| 8.26| | 100G | seqrd | 16| 78.601Mb| 5030.44| 8.48| | 100G | seqrd | 32| 149.76Mb| 9584.68| 8.89| | 100G | seqrd | 64| 266.66Mb| 17066.21| 9.82| | 100G | seqwr | 1| 85.9Mb| 5497.58| 0.26| | 100G | seqwr | 4| 85.339Mb| 5461.71| 1.92| | 100G | seqwr | 8| 64.678Mb| 4139.37| 6.72| | 100G | seqwr | 16| 68.896Mb| 4409.33| 10.76| | 100G | seqwr | 32| 58.844Mb| 3766.03| 21.12| | 100G | seqwr | 64| 58.778Mb| 3761.81| 41.73| ==== Software RAID5 ==== mdadm --create /dev/md0 -v --raid-devices=8 --level=5 /dev/sdb /dev/sdc /dev/sdd /dev/sde /dev/sdf /dev/sdg /dev/sdh /dev/sdi mkfs.xfs /dev/md0 /dev/md0 521G 5.5M 521G 1% ^ size^type^ thr^bytes/sec^req/sec^ | 100G | rndrd | 1| 34.441Mb| 2204.20| 0.52| | 100G | rndrd | 4| 127.11Mb| 8134.80| 0.60| | 100G | rndrd | 8| 212.56Mb| 13603.58| 0.79| | 100G | rndrd | 16| 312.6Mb| 20006.67| 1.33| | 100G | rndrd | 32| 394.32Mb| 25236.65| 2.39| | 100G | rndrd | 64| 442.12Mb| 28295.73| 3.95| | 100G | rndrw | 1| 21.566Mb| 1380.23| 1.58| | 100G | rndrw | 4| 49.187Mb| 3147.99| 2.57| | 100G | rndrw | 8| 57.715Mb| 3693.74| 3.93| | 100G | rndrw | 16| 66.929Mb| 4283.49| 7.31| | 100G | rndrw | 32| 67.314Mb| 4308.12| 24.59| | 100G | rndrw | 64| 67.398Mb| 4313.48| 62.84| | 100G | rndwr | 1| 11.789Mb| 754.51| 2.07| | 100G | rndwr | 4| 19.92Mb| 1274.91| 4.20| | 100G | rndwr | 8| 24.968Mb| 1597.94| 7.78| | 100G | rndwr | 16| 29.002Mb| 1856.10| 23.23| | 100G | rndwr | 32| 29.649Mb| 1897.57| 65.42| | 100G | rndwr | 64| 30.376Mb| 1944.09| 151.88| | 100G | seqrd | 1| 123.08Mb| 7877.22| 0.23| | 100G | seqrd | 4| 45.005Mb| 2880.30| 7.98| | 100G | seqrd | 8| 55.241Mb| 3535.40| 8.27| | 100G | seqrd | 16| 89.684Mb| 5739.74| 8.69| | 100G | seqrd | 32| 139.11Mb| 8903.27| 9.37| | 100G | seqrd | 64| 223.45Mb| 14300.98| 10.58| | 100G | seqwr | 1| 23.288Mb| 1490.41| 0.57| | 100G | seqwr | 4| 16.916Mb| 1082.63| 17.08| | 100G | seqwr | 8| 16.9Mb| 1081.61| 35.17| | 100G | seqwr | 16| 24.615Mb| 1575.37| 47.13| | 100G | seqwr | 32| 22.097Mb| 1414.20| 99.41| | 100G | seqwr | 64| 27.108Mb| 1734.91| 151.65| ==== Software RAID50 ==== mdadm --create /dev/md1 -v --raid-devices=4 --level=5 /dev/sdb /dev/sdc /dev/sdd /dev/sde mdadm --create /dev/md2 -v --raid-devices=4 --level=5 /dev/sdf /dev/sdg /dev/sdh /dev/sdi mdadm --create /dev/md0 -v --raid-devices=2 --level=0 /dev/md1 /dev/md2 /dev/md0 447G 4.6M 447G 1% ^ size^type^ thr^bytes/sec^req/sec^ | 100G | rndrd | 1| 34.011Mb| 2176.71| 0.53| | 100G | rndrd | 4| 129.69Mb| 8299.89| 0.59| | 100G | rndrd | 8| 221.69Mb| 14188.06| 0.74| | 100G | rndrd | 16| 325.41Mb| 20826.37| 1.43| | 100G | rndrd | 32| 394.18Mb| 25227.28| 2.82| | 100G | rndrd | 64| 440.24Mb| 28175.41| 4.72| | 100G | rndrw | 1| 21.682Mb| 1387.67| 1.59| | 100G | rndrw | 4| 58.86Mb| 3767.03| 2.52| | 100G | rndrw | 8| 80.381Mb| 5144.37| 3.48| | 100G | rndrw | 16| 87.963Mb| 5629.62| 5.21| | 100G | rndrw | 32| 91.205Mb| 5837.13| 11.93| | 100G | rndrw | 64| 80.983Mb| 5182.88| 45.51| | 100G | rndwr | 1| 12.795Mb| 818.90| 2.05| | 100G | rndwr | 4| 23.683Mb| 1515.74| 3.96| | 100G | rndwr | 8| 32.637Mb| 2088.78| 4.95| | 100G | rndwr | 16| 43.687Mb| 2795.95| 8.37| | 100G | rndwr | 32| 43.409Mb| 2778.17| 28.30| | 100G | rndwr | 64| 34.523Mb| 2209.48| 142.46| | 100G | seqrd | 1| 125.88Mb| 8056.18| 0.22| | 100G | seqrd | 4| 44.182Mb| 2827.67| 8.01| | 100G | seqrd | 8| 52.285Mb| 3346.23| 8.29| | 100G | seqrd | 16| 94.378Mb| 6040.19| 8.54| | 100G | seqrd | 32| 155.42Mb| 9947.01| 9.23| | 100G | seqrd | 64| 249.74Mb| 15983.45| 10.63| | 100G | seqwr | 1| 9.6019Mb| 614.52| 7.91| | 100G | seqwr | 4| 8.3996Mb| 537.57| 26.24| | 100G | seqwr | 8| 7.1522Mb| 457.74| 72.06| | 100G | seqwr | 16| 14.149Mb| 905.53| 87.32| | 100G | seqwr | 32| 15.807Mb| 1011.66| 163.73| | 100G | seqwr | 64| 15.348Mb| 982.26| 323.90| ===== Hardware 2 RAID0 ===== ==== Software RAID0 ==== mdadm --create /dev/md0 -v --raid-devices=2 --level=0 /dev/sdb /dev/sdc mkfs.xfs -f /dev/md0 /dev/md0 596G 5.1M 596G 1% Results CFQ ^ size^type^ thr^bytes/sec^req/sec^ | 100G | rndrd | 1| 36.217Mb| 2317.87| 0.45| | 100G | rndrd | 4| 167.92Mb| 10747.02| 0.47| | 100G | rndrd | 8| 281.85Mb| 18038.22| 0.59| | 100G | rndrd | 16| 412.32Mb| 26388.62| 0.91| | 100G | rndrd | 32| 510.41Mb| 32666.40| 1.60| | 100G | rndrd | 64| 771.59Mb| 49381.57| 2.02| | 100G | rndrw | 1| 30.273Mb| 1937.44| 1.19| | 100G | rndrw | 4| 103.43Mb| 6619.82| 1.81| | 100G | rndrw | 8| 140.14Mb| 8969.08| 2.53| | 100G | rndrw | 16| 169.21Mb| 10829.57| 6.23| | 100G | rndrw | 32| 184Mb| 11775.94| 13.29| | 100G | rndrw | 64| 194.22Mb| 12430.31| 25.35| | 100G | rndwr | 1| 132.33Mb| 8469.28| 0.15| | 100G | rndwr | 4| 173.68Mb| 11115.67| 0.48| | 100G | rndwr | 8| 118.06Mb| 7555.76| 3.35| | 100G | rndwr | 16| 145.06Mb| 9283.78| 5.55| | 100G | rndwr | 32| 130.05Mb| 8322.96| 13.13| | 100G | rndwr | 64| 123.71Mb| 7917.62| 27.62| | 100G | seqrd | 1| 199.48Mb| 12767.02| 0.12| | 100G | seqrd | 4| 18.598Mb| 1190.30| 8.06| | 100G | seqrd | 8| 27.044Mb| 1730.81| 8.16| | 100G | seqrd | 16| 51.553Mb| 3299.37| 8.77| | 100G | seqrd | 32| 95.273Mb| 6097.49| 10.79| | 100G | seqrd | 64| 164.19Mb| 10508.05| 12.22| | 100G | seqwr | 1| 126.26Mb| 8080.87| 0.17| | 100G | seqwr | 4| 116.48Mb| 7454.67| 1.43| | 100G | seqwr | 8| 106.56Mb| 6819.57| 3.49| | 100G | seqwr | 16| 99.581Mb| 6373.16| 7.47| | 100G | seqwr | 32| 91.136Mb| 5832.70| 15.23| | 100G | seqwr | 64| 91.95Mb| 5884.79| 29.58| Results DEADLINE: ^ size^type^ thr^bytes/sec^req/sec^ | 100G | rndrd | 1| 36.874Mb| 2359.92| 0.44| | 100G | rndrd | 4| 165.89Mb| 10617.22| 0.47| | 100G | rndrd | 8| 284.71Mb| 18221.62| 0.58| | 100G | rndrd | 16| 414.24Mb| 26511.58| 0.90| | 100G | rndrd | 32| 511.75Mb| 32751.87| 1.59| | 100G | rndrd | 64| 771.21Mb| 49357.67| 2.02| | 100G | rndrw | 1| 16.062Mb| 1027.97| 1.55| | 100G | rndrw | 4| 59.752Mb| 3824.12| 2.45| | 100G | rndrw | 8| 82.653Mb| 5289.81| 4.05| | 100G | rndrw | 16| 106.95Mb| 6844.51| 7.05| | 100G | rndrw | 32| 121.85Mb| 7798.62| 13.68| | 100G | rndrw | 64| 137.27Mb| 8785.47| 26.17| | 100G | rndwr | 1| 124.34Mb| 7958.06| 0.15| | 100G | rndwr | 4| 63.811Mb| 4083.94| 2.14| | 100G | rndwr | 8| 62.66Mb| 4010.27| 5.50| | 100G | rndwr | 16| 81.61Mb| 5223.05| 9.83| | 100G | rndwr | 32| 82.946Mb| 5308.53| 20.44| | 100G | rndwr | 64| 70.304Mb| 4499.43| 51.73| | 100G | seqrd | 1| 194.01Mb| 12416.92| 0.12| | 100G | seqrd | 4| 431.47Mb| 27614.31| 0.25| | 100G | seqrd | 8| 599.77Mb| 38385.01| 0.40| | 100G | seqrd | 16| 582.67Mb| 37290.59| 1.41| | 100G | seqrd | 32| 558.59Mb| 35749.96| 2.53| | 100G | seqrd | 64| 610.68Mb| 39083.37| 2.98| | 100G | seqwr | 1| 128.28Mb| 8209.97| 0.16| | 100G | seqwr | 4| 116.17Mb| 7434.98| 1.41| | 100G | seqwr | 8| 103.62Mb| 6631.73| 3.48| | 100G | seqwr | 16| 92.456Mb| 5917.15| 7.59| | 100G | seqwr | 32| 80.986Mb| 5183.08| 15.27| | 100G | seqwr | 64| 85.602Mb| 5478.51| 30.37| ==== Software RAID1 ==== mdadm --create /dev/md0 -v --raid-devices=2 --level=1 /dev/sdb /dev/sdc /dev/md0 298G 4.6M 298G 1% Results CFQ ^ size^type^ thr^bytes/sec^req/sec^ | 100G | rndrd | 1| 36.284Mb| 2322.14| 0.45| | 100G | rndrd | 4| 160.49Mb| 10271.58| 0.50| | 100G | rndrd | 8| 268.17Mb| 17162.58| 0.65| | 100G | rndrd | 16| 361.98Mb| 23166.68| 1.04| | 100G | rndrd | 32| 441.23Mb| 28238.49| 1.90| | 100G | rndrd | 64| 638.68Mb| 40875.53| 2.56| | 100G | rndrw | 1| 23.192Mb| 1484.27| 1.66| | 100G | rndrw | 4| 70.77Mb| 4529.31| 2.64| | 100G | rndrw | 8| 90.571Mb| 5796.53| 4.99| | 100G | rndrw | 16| 107.28Mb| 6865.85| 7.82| | 100G | rndrw | 32| 117.6Mb| 7526.26| 13.19| | 100G | rndrw | 64| 117.41Mb| 7514.19| 35.12| | 100G | rndwr | 1| 90.425Mb| 5787.23| 0.24| | 100G | rndwr | 4| 49.729Mb| 3182.68| 2.54| | 100G | rndwr | 8| 25.874Mb| 1655.94| 13.52| | 100G | rndwr | 16| 32.809Mb| 2099.79| 19.44| | 100G | rndwr | 32| 44.588Mb| 2853.66| 21.92| | 100G | rndwr | 64| 51.392Mb| 3289.06| 46.05| | 100G | seqrd | 1| 183.99Mb| 11775.37| 0.13| | 100G | seqrd | 4| 13.766Mb| 881.06| 8.36| | 100G | seqrd | 8| 24.69Mb| 1580.13| 8.21| | 100G | seqrd | 16| 41.732Mb| 2670.87| 15.90| | 100G | seqrd | 32| 71.007Mb| 4544.47| 17.77| | 100G | seqrd | 64| 116.97Mb| 7486.24| 20.32| | 100G | seqwr | 1| 93.684Mb| 5995.79| 0.22| | 100G | seqwr | 4| 92.205Mb| 5901.14| 2.35| | 100G | seqwr | 8| 81.552Mb| 5219.30| 6.46| | 100G | seqwr | 16| 72.84Mb| 4661.76| 12.48| | 100G | seqwr | 32| 62.421Mb| 3994.92| 25.05| | 100G | seqwr | 64| 62.804Mb| 4019.45| 52.15| Results DEADLINE ^ size^type^ thr^bytes/sec^req/sec^ | 100G | rndrd | 1| 35.846Mb| 2294.15| 0.45| | 100G | rndrd | 4| 159.57Mb| 10212.17| 0.50| | 100G | rndrd | 8| 265.96Mb| 17021.58| 0.64| | 100G | rndrd | 16| 363.95Mb| 23292.63| 1.05| | 100G | rndrd | 32| 444.64Mb| 28456.90| 1.90| | 100G | rndrd | 64| 587.3Mb| 37587.05| 3.04| | 100G | rndrw | 1| 19.704Mb| 1261.09| 1.72| | 100G | rndrw | 4| 63.285Mb| 4050.26| 2.58| | 100G | rndrw | 8| 81.202Mb| 5196.96| 4.94| | 100G | rndrw | 16| 97.062Mb| 6211.99| 7.94| | 100G | rndrw | 32| 101.99Mb| 6527.40| 14.91| | 100G | rndrw | 64| 112.08Mb| 7172.83| 30.17| | 100G | rndwr | 1| 93.608Mb| 5990.94| 0.23| | 100G | rndwr | 4| 66.17Mb| 4234.90| 2.05| | 100G | rndwr | 8| 33.359Mb| 2134.98| 10.27| | 100G | rndwr | 16| 41.309Mb| 2643.77| 12.07| | 100G | rndwr | 32| 42.821Mb| 2740.54| 25.79| | 100G | rndwr | 64| 46.992Mb| 3007.46| 56.78| | 100G | seqrd | 1| 183.7Mb| 11757.01| 0.13| | 100G | seqrd | 4| 236.26Mb| 15120.67| 0.59| | 100G | seqrd | 8| 279.97Mb| 17918.01| 1.37| | 100G | seqrd | 16| 245.12Mb| 15687.73| 2.55| | 100G | seqrd | 32| 321Mb| 20543.91| 2.90| | 100G | seqrd | 64| 505.39Mb| 32345.16| 3.35| | 100G | seqwr | 1| 97.829Mb| 6261.07| 0.21| | 100G | seqwr | 4| 95.857Mb| 6134.82| 2.23| | 100G | seqwr | 8| 83.484Mb| 5342.97| 6.51| | 100G | seqwr | 16| 80.678Mb| 5163.36| 12.31| | 100G | seqwr | 32| 67.383Mb| 4312.53| 29.38| | 100G | seqwr | 64| 70.593Mb| 4517.94| 50.01| Results NOOP: ^ size^type^ thr^bytes/sec^req/sec^ | 100G | rndrd | 1| 36.727Mb| 2350.50| 0.44| | 100G | rndrd | 4| 162.36Mb| 10390.82| 0.49| | 100G | rndrd | 8| 262.07Mb| 16772.49| 0.66| | 100G | rndrd | 16| 360.13Mb| 23048.30| 1.07| | 100G | rndrd | 32| 431.5Mb| 27615.78| 1.99| | 100G | rndrd | 64| 534.85Mb| 34230.11| 3.38| | 100G | rndrw | 1| 17.22Mb| 1102.09| 1.74| | 100G | rndrw | 4| 64.825Mb| 4148.79| 2.70| | 100G | rndrw | 8| 82.509Mb| 5280.56| 5.03| | 100G | rndrw | 16| 97.97Mb| 6270.09| 8.13| | 100G | rndrw | 32| 109.46Mb| 7005.52| 14.58| | 100G | rndrw | 64| 88.129Mb| 5640.24| 65.02| | 100G | rndwr | 1| 88.774Mb| 5681.54| 0.24| | 100G | rndwr | 4| 55.521Mb| 3553.36| 2.33| | 100G | rndwr | 8| 37.085Mb| 2373.42| 8.75| | 100G | rndwr | 16| 41.761Mb| 2672.71| 11.64| | 100G | rndwr | 32| 43.818Mb| 2804.35| 21.13| | 100G | rndwr | 64| 49.284Mb| 3154.19| 49.40| | 100G | seqrd | 1| 210.38Mb| 13464.08| 0.11| | 100G | seqrd | 4| 218.96Mb| 14013.48| 0.67| | 100G | seqrd | 8| 229.95Mb| 14716.85| 1.69| | 100G | seqrd | 16| 215.91Mb| 13818.41| 2.63| | 100G | seqrd | 32| 313.5Mb| 20063.69| 2.80| | 100G | seqrd | 64| 473.36Mb| 30295.17| 3.44| | 100G | seqwr | 1| 93.428Mb| 5979.42| 0.24| | 100G | seqwr | 4| 84.388Mb| 5400.81| 2.25| | 100G | seqwr | 8| 76.786Mb| 4914.32| 6.29| | 100G | seqwr | 16| 69.237Mb| 4431.19| 13.36| | 100G | seqwr | 32| 62.516Mb| 4001.05| 29.52| | 100G | seqwr | 64| 61.462Mb| 3933.58| 53.96| ===== Hardware RAID0 on 4 disks ===== Deadline scheduler ^ size^type^ thr^bytes/sec^req/sec^ | 100G | rndrd | 1| 40.918Mb| 2618.73| 0.40| | 100G | rndrd | 4| 159.73Mb| 10222.72| 0.48| | 100G | rndrd | 8| 233.51Mb| 14944.35| 0.68| | 100G | rndrd | 16| 267.48Mb| 17118.55| 1.36| | 100G | rndrd | 32| 403.18Mb| 25803.57| 1.68| | 100G | rndrd | 64| 426.35Mb| 27286.71| 2.87| | 100G | rndrw | 1| 28.323Mb| 1812.70| 1.61| | 100G | rndrw | 4| 73.775Mb| 4721.63| 3.08| | 100G | rndrw | 8| 92.413Mb| 5914.44| 5.86| | 100G | rndrw | 16| 99.212Mb| 6349.55| 11.74| | 100G | rndrw | 32| 103.32Mb| 6612.50| 20.64| | 100G | rndrw | 64| 104.58Mb| 6693.06| 35.37| | 100G | rndwr | 1| 132.3Mb| 8467.04| 0.14| | 100G | rndwr | 4| 37.609Mb| 2406.99| 4.29| | 100G | rndwr | 8| 33.823Mb| 2164.68| 9.35| | 100G | rndwr | 16| 47.222Mb| 3022.22| 10.01| | 100G | rndwr | 32| 54.733Mb| 3502.89| 18.61| | 100G | rndwr | 64| 62.215Mb| 3981.75| 40.78| | 100G | seqrd | 1| 235.3Mb| 15058.93| 0.10| | 100G | seqrd | 4| 444.83Mb| 28469.08| 0.21| | 100G | seqrd | 8| 508.06Mb| 32515.99| 0.35| | 100G | seqrd | 16| 365.5Mb| 23392.28| 2.20| | 100G | seqrd | 32| 317.11Mb| 20295.29| 2.89| | 100G | seqrd | 64| 487.01Mb| 31168.90| 3.29| | 100G | seqwr | 1| 151.46Mb| 9693.63| 0.12| | 100G | seqwr | 4| 141.69Mb| 9068.47| 1.93| | 100G | seqwr | 8| 130.99Mb| 8383.06| 5.80| | 100G | seqwr | 16| 117.12Mb| 7495.58| 10.66| | 100G | seqwr | 32| 110.83Mb| 7092.81| 21.12| | 100G | seqwr | 64| 105.56Mb| 6755.53| 41.85| ===== Sysbench script ===== #!/bin/sh set -u set -x set -e for size in 100G; do for mode in seqwr seqrd rndrd rndwr rndrw; do #for mode in rndwr; do #for blksize in 512 4096 8192 16384 32768 65536 ; do for blksize in 16384 ; do ./sysbench --test=fileio --file-num=64 --file-total-size=$size prepare #for threads in 1 4 8; do for threads in 1 4 8 16 32 64; do echo "====== testing $blksize in $threads threads" echo PARAMS $size $mode $threads $blksize > sysbench-size-$size-mode-$mode-threads-$threads-blksz-$blksize ./sysbench --test=fileio --file-total-size=$size --file-test-mode=$mode\ --max-time=120 --max-requests=100000000 --num-threads=$threads --init-rng=on \ --file-num=64 --file-extra-flags=direct --file-fsync-freq=0 --file-block-size=$blksize run \ | tee -a sysbench-size-$size-mode-$mode-threads-$threads-blksz-$blksize 2>&1 done ./sysbench --test=fileio --file-total-size=$size cleanup done done done