How we caught sea crucians, or review of Huawei OceanStor Dorado2100 G2

At the end of 2012, Huawei introduced the second generation of the OceanStor Dorado2100 G2 storage system. It was interesting for us to compare it with the recently visited IBM FlashSystem 820 flash testing system . But first, a little more about Dorado.

The Dorado2100 G2 architecture is entirely built on SSD solid state drives and uses advanced cache management technology and scheduling algorithms for I / O operations. High reliability of the system is ensured by redundancy of components: power supplies, fans, controllers, interface modules, SSD and BBU are duplicated and allow to avoid the occurrence of single failures, and the used methods of balancing the degree of wear, the restoration of damaged blocks and scrubbing technology providing an average uptime (MTBF) of over 1,200,000 hours. The power of the device 580W saves up to 90% energy consumption compared to traditional disk arrays.
')

Hardware Specifications
Number of controllers	2
External host port	Active-Active
Number of built-in I / O ports	8 x 8 Gbps Fiber Channel
Supported maximum number of I / O modules	2
I / O expansion module	4 x 8 Gbps Fiber Channel 4 x 10 Gbps iSCSI (ToE) 2 x 40 Gbps InfiniBand QDR
Capacity	SLC: 2.5 or 5 TB eMLC: 5 or 10 TB
Maximum supported number of disk expansion modules	3
Performance
Bandwidth	10 Gbps
Iops	600,000
Response time	500 µs
Software characteristics
Supported RAID Levels	0,5,10
Maximum supported number of hosts	512
Maximum supported LUNs	2,048
Channel Duplication Software (Multipathing)	Ultrapath

As spheres where Dorado2100 G2 can be useful, are called work with databases, ERP-systems and "cloud" services.

Now I would like to give a few words to the management of this storage system. The main configuration tool is OceanStor ISM, written in Java and, accordingly, cross-platform. Yes, this is not the usual web interface, it is not so convenient, but nevertheless it is quite workable. Actually there is nothing unusual there, everything is fairly standard - setting up controllers, disks, Luns, etc. All that is needed to prepare for the storage.

And of course there are simple tools for monitoring system load. The second management tool is the UltraPath console, which allows you to “tune” the system a little. More information about the capabilities of UltraPath can be found on the Huawei website .

Recalling our recent testing of the Huawei Tecal ES3000, we expected quite a lot from the Chinese manufacturer, what happened in practice - our tests will show, which we turn to.

Testbed configuration:

Platform - IBM X3650 M4
Processor - Xeon E2603
Memory - 8 GB
Hard drives - 3xSAS 146GB 10k

We tested the storage using our standard set of test packets, which we have repeatedly used in our articles.

ATTO Disk Benchmark
We carried out testing with parameters:

Total Length = 256 Mb
Queue Depth = 2-10

AS SSD Benchmark

Crystaldiskmark

Iometer
For testing, a set of patterns that we have already tested was chosen:

Database
File server
Workstation
Webserver

As results, we chose the maximum values obtained during testing.

Fio
Here we carried out 2 tests: the first test was using Multipath, and the second using UltraPath, which Huawei itself proposes to use. When testing in Windows, we gave the result only with the use of UltraPath, due to the fact that the test results when using Multipath differed no more than the statistical error in the tests.

Multipath

Ultrapath

As you can see, there are no test results on the graph with iodepth = 128, for some unknown reason, when using UltraPath, the server just hung while passing this test.

For those who want to see all the numbers with their own eyes, I suggest a test log:

iodepth = 2 multipath.txt

readtest: (groupid = 0, jobs = 1): err = 0: pid = 27151: Thu Jan 30 06:55:09 2014
read: io = 48262MB, bw = 13728KB / s, iops = 3431, runt = 3600001msec
slat (usec): min = 4, max = 204, avg = 15.55, stdev = 7.32
clat (usec): min = 15, max = 39894, avg = 563.43, stdev = 351.04
lat (usec): min = 58, max = 39902, avg = 579.26, stdev = 351.19
clat percentiles (usec):
| 1.00th = [112], 5.00th = [478], 10.00th = [486], 20.00th = [498],
| 30.00th = [502], 40.00th = [510], 50.00th = [516], 60.00th = [524],
| 70.00th = [532], 80.00th = [548], 90.00th = [572], 95.00th = [612],
| 99.00th = [2192], 99.50th = [2896], 99.90th = [4512], 99.95th = [5536],
| 99.99th = [8896]
bw (KB / s): min = 12536, max = 68688, per = 100.00%, avg = 13733.93, stdev = 847.69
lat (usec): 20 = 0.01%, 50 = 0.01%, 100 = 0.90%, 250 = 0.34%, 500 = 23.59%
lat (usec): 750 = 71.95%, 1000 = 0.47%
lat (msec): 2 = 1.59%, 4 = 1.00%, 10 = 0.15%, 20 = 0.01%, 50 = 0.01%
cpu: usr = 2.03%, sys = 6.87%, ctx = 9201829, majf = 0, minf = 26
IO depths: 1 = 0.1%, 2 = 100.0%, 4 = 0.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 12354944 / w = 0 / d = 0, short = r = 0 / w = 0 / d = 0
writetest: (groupid = 0, jobs = 1): err = 0: pid = 27156: Thu Jan 30 06:55:09 2014
write: io = 97529MB, bw = 27742KB / s, iops = 6935, runt = 3600001msec
slat (usec): min = 4, max = 213, avg = 14.24, stdev = 7.47
clat (usec): min = 18, max = 36671, avg = 270.04, stdev = 295.55
lat (usec): min = 159, max = 36685, avg = 284.53, stdev = 295.67
clat percentiles (usec):
| 1.00th = [177], 5.00th = [187], 10.00th = [193], 20.00th = [203],
| 30.00th = [213], 40.00th = [225], 50.00th = [239], 60.00th = [253],
| 70.00th = [270], 80.00th = [286], 90.00th = [306], 95.00th = [326],
| 99.00th = [1240], 99.50th = [1960], 99.90th = [4448], 99.95th = [5600],
| 99.99th = [9024]
bw (KB / s): min = 24928, max = 34440, per = 100.00%, avg = 27749.52, stdev = 492.00
lat (usec): 20 = 0.01%, 50 = 0.01%, 100 = 0.01%, 250 = 57.92%, 500 = 40.48%
lat (usec): 750 = 0.21%, 1000 = 0.13%
lat (msec): 2 = 0.77%, 4 = 0.35%, 10 = 0.13%, 20 = 0.01%, 50 = 0.01%
cpu: usr = 3.88%, sys = 11.12%, ctx = 16215320, majf = 0, minf = 25
IO depths: 1 = 0.1%, 2 = 100.0%, 4 = 0.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 0 / w = 24967501 / d = 0, short = r = 0 / w = 0 / d = 0

Run status group 0 (all jobs):
READ: io = 48262MB, aggrb = 13727KB / s, minb = 13727KB / s, maxb = 13727KB / s, mint = 3600001msec, maxt = 3600001msec
WRITE: io = 97529MB, aggrb = 27741KB / s, minb = 27741KB / s, maxb = 27741KB / s, mint = 3600001msec, maxt = 3600001msec

iodepth = 2 ultrapath.txt

readtest: (groupid = 0, jobs = 1): err = 0: pid = 10335: Wed Feb 5 02:34:35 2014
read: io = 47483MB, bw = 13506KB / s, iops = 3376, runt = 3600001msec
slat (usec): min = 5, max = 395, avg = 19.94, stdev = 8.25
clat (usec): min = 37, max = 34114, avg = 568.92, stdev = 339.14
lat (usec): min = 70, max = 34126, avg = 589.11, stdev = 339.21
clat percentiles (usec):
| 1.00th = [470], 5.00th = [482], 10.00th = [490], 20.00th = [498],
| 30.00th = [506], 40.00th = [516], 50.00th = [524], 60.00th = [532],
| 70.00th = [540], 80.00th = [548], 90.00th = [564], 95.00th = [588],
| 99.00th = [2160], 99.50th = [2896], 99.90th = [4512], 99.95th = [5408],
| 99.99th = [8256]
bw (KB / s): min = 12480, max = 14704, per = 100.00%, avg = 13512.29, stdev = 157.48
lat (usec): 50 = 0.01%, 100 = 0.04%, 250 = 0.01%, 500 = 20.90%, 750 = 75.84%
lat (usec): 1000 = 0.47%
lat (msec): 2 = 1.59%, 4 = 1.00%, 10 = 0.15%, 20 = 0.01%, 50 = 0.01%
cpu: usr = 2.56%, sys = 10.39%, ctx = 9131317, majf = 0, minf = 28
IO depths: 1 = 0.1%, 2 = 100.0%, 4 = 0.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 12155666 / w = 0 / d = 0, short = r = 0 / w = 0 / d = 0
writetest: (groupid = 0, jobs = 1): err = 0: pid = 10336: Wed Feb 5 02:34:35 2014
write: io = 96926MB, bw = 27570KB / s, iops = 6892, runt = 3600001msec
slat (usec): min = 5, max = 375, avg = 17.50, stdev = 7.38
clat (usec): min = 1, max = 71496, avg = 269.86, stdev = 297.41
lat (usec): min = 155, max = 71520, avg = 287.60, stdev = 297.52
clat percentiles (usec):
| 1.00th = [175], 5.00th = [187], 10.00th = [197], 20.00th = [205],
| 30.00th = [213], 40.00th = [227], 50.00th = [243], 60.00th = [255],
| 70.00th = [266], 80.00th = [282], 90.00th = [298], 95.00th = [314],
| 99.00th = [1240], 99.50th = [1928], 99.90th = [4448], 99.95th = [5664],
| 99.99th = [9024]
bw (KB / s): min = 24800, max = 30800, per = 100.00%, avg = 27578.14, stdev = 488.64
lat (usec): 2 = 0.01%, 4 = 0.01%, 20 = 0.01%, 50 = 0.01%, 100 = 0.01%
lat (usec): 250 = 56.41%, 500 = 41.98%, 750 = 0.22%, 1000 = 0.15%
lat (msec): 2 = 0.76%, 4 = 0.34%, 10 = 0.13%, 20 = 0.01%, 50 = 0.01%
lat (msec): 100 = 0.01%
cpu: usr = 4.02%, sys = 16.92%, ctx = 13716798, majf = 0, minf = 23
IO depths: 1 = 0.1%, 2 = 100.0%, 4 = 0.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 0 / w = 24813159 / d = 0, short = r = 0 / w = 0 / d = 0

Run status group 0 (all jobs):
READ: io = 47483MB, aggrb = 13506KB / s, minb = 13506KB / s, maxb = 13506KB / s, mint = 3600001msec, maxt = 3600001msec
WRITE: io = 96926MB, aggrb = 27570KB / s, minb = 27570KB / s, maxb = 27570KB / s, mint = 3600001msec, maxt = 3600001msec

iodepth = 4 multipath.txt

readtest: (groupid = 0, jobs = 1): err = 0: pid = 31591: Fri Jan 31 01:54:03 2014
read: io = 88400MB, bw = 25145KB / s, iops = 6286, runt = 3600001msec
slat (usec): min = 4, max = 250, avg = 14.27, stdev = 8.42
clat (usec): min = 1, max = 252743, avg = 619.02, stdev = 463.07
lat (usec): min = 51, max = 252752, avg = 633.55, stdev = 463.24
clat percentiles (usec):
| 1.00th = [430], 5.00th = [454], 10.00th = [470], 20.00th = [486],
| 30.00th = [498], 40.00th = [510], 50.00th = [524], 60.00th = [540],
| 70.00th = [556], 80.00th = [572], 90.00th = [636], 95.00th = [1208],
| 99.00th = [2736], 99.50th = [3088], 99.90th = [4448], 99.95th = [7136],
| 99.99th = [10944]
bw (KB / s): min = 12776, max = 29040, per = 100.00%, avg = 25154.17, stdev = 1181.63
lat (usec): 2 = 0.01%, 20 = 0.01%, 50 = 0.01%, 100 = 0.02%, 250 = 0.01%
lat (usec): 500 = 30.85%, 750 = 61.13%, 1000 = 1.31%
lat (msec): 2 = 4.32%, 4 = 2.22%, 10 = 0.11%, 20 = 0.01%, 50 = 0.01%
lat (msec): 500 = 0.01%
cpu: usr = 2.54%, sys = 9.93%, ctx = 15108356, majf = 0, minf = 28
IO depths: 1 = 0.1%, 2 = 0.1%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 22630420 / w = 0 / d = 0, short = r = 0 / w = 0 / d = 0
writetest: (groupid = 0, jobs = 1): err = 0: pid = 31598: Fri Jan 31 01:54:03 2014
write: io = 186093MB, bw = 52933KB / s, iops = 13233, runt = 3600001msec
slat (usec): min = 4, max = 1657, avg = 13.49, stdev = 8.74
clat (usec): min = 19, max = 252403, avg = 285.97, stdev = 270.15
lat (usec): min = 131, max = 252417, avg = 299.71, stdev = 270.25
clat percentiles (usec):
| 1.00th = [159], 5.00th = [177], 10.00th = [189], 20.00th = [205],
| 30.00th = [219], 40.00th = [233], 50.00th = [247], 60.00th = [262],
| 70.00th = [282], 80.00th = [302], 90.00th = [338], 95.00th = [390],
| 99.00th = [1416], 99.50th = [2008], 99.90th = [3088], 99.95th = [3536],
| 99.99th = [5536]
bw (KB / s): min = 26168, max = 57408, per = 100.00%, avg = 52945.78, stdev = 957.86
lat (usec): 20 = 0.01%, 50 = 0.01%, 100 = 0.01%, 250 = 52.07%, 500 = 44.81%
lat (usec): 750 = 0.54%, 1000 = 0.93%
lat (msec): 2 = 1.16%, 4 = 0.47%, 10 = 0.02%, 20 = 0.01%, 50 = 0.01%
lat (msec): 500 = 0.01%
cpu: usr = 4.43%, sys = 18.75%, ctx = 24858450, majf = 0, minf = 25
IO depths: 1 = 0.1%, 2 = 0.1%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 0 / w = 47639735 / d = 0, short = r = 0 / w = 0 / d = 0

Run status group 0 (all jobs):
READ: io = 88400MB, aggrb = 25144KB / s, minb = 25144KB / s, maxb = 25144KB / s, mint = 3600001msec, maxt = 3600001msec
WRITE: io = 186093MB, aggrb = 52933KB / s, minb = 52933KB / s, maxb = 52933KB / s, mint = 3600001msec, maxt = 3600001msec

iodepth = 4 ultrapath.txt

readtest: (groupid = 0, jobs = 1): err = 0: pid = 1426: Wed Feb 5 05:00:46 2014
read: io = 87619MB, bw = 24923KB / s, iops = 6230, runt = 3600001msec
slat (usec): min = 4, max = 435, avg = 18.65, stdev = 9.66
clat (usec): min = 1, max = 42725, avg = 620.44, stdev = 400.33
lat (usec): min = 59, max = 42743, avg = 639.33, stdev = 400.36
clat percentiles (usec):
| 1.00th = [434], 5.00th = [462], 10.00th = [478], 20.00th = [498],
| 30.00th = [516], 40.00th = [524], 50.00th = [540], 60.00th = [556],
| 70.00th = [572], 80.00th = [596], 90.00th = [628], 95.00th = [1160],
| 99.00th = [2608], 99.50th = [2992], 99.90th = [3824], 99.95th = [4896],
| 99.99th = [10048]
bw (KB / s): min = 22040, max = 28800, per = 100.00%, avg = 24932.92, stdev = 672.04
lat (usec): 2 = 0.01%, 10 = 0.01%, 50 = 0.01%, 100 = 0.02%, 250 = 0.01%
lat (usec): 500 = 21.68%, 750 = 71.07%, 1000 = 1.13%
lat (msec): 2 = 4.11%, 4 = 1.90%, 10 = 0.07%, 20 = 0.01%, 50 = 0.01%
cpu: usr = 3.46%, sys = 16.46%, ctx = 10130926, majf = 0, minf = 29
IO depths: 1 = 0.1%, 2 = 0.1%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 22430409 / w = 0 / d = 0, short = r = 0 / w = 0 / d = 0
writetest: (groupid = 0, jobs = 1): err = 0: pid = 1427: Wed Feb 5 05:00:46 2014
write: io = 178391MB, bw = 50742KB / s, iops = 12685, runt = 3600001msec
slat (usec): min = 4, max = 429, avg = 16.46, stdev = 8.82
clat (usec): min = 1, max = 72199, avg = 296.40, stdev = 263.44
lat (usec): min = 138, max = 72215, avg = 313.09, stdev = 263.56
clat percentiles (usec):
| 1.00th = [161], 5.00th = [183], 10.00th = [197], 20.00th = [213],
| 30.00th = [227], 40.00th = [243], 50.00th = [258], 60.00th = [274],
| 70.00th = [294], 80.00th = [318], 90.00th = [350], 95.00th = [378],
| 99.00th = [1480], 99.50th = [2096], 99.90th = [3280], 99.95th = [3760],
| 99.99th = [5472]
bw (KB / s): min = 47168, max = 57024, per = 100.00%, avg = 50755.16, stdev = 826.15
lat (usec): 2 = 0.01%, 50 = 0.01%, 100 = 0.01%, 250 = 45.05%, 500 = 51.84%
lat (usec): 750 = 0.44%, 1000 = 0.88%
lat (msec): 2 = 1.23%, 4 = 0.52%, 10 = 0.03%, 20 = 0.01%, 50 = 0.01%
lat (msec): 100 = 0.01%
cpu: usr = 5.19%, sys = 26.31%, ctx = 13900189, majf = 0, minf = 26
IO depths: 1 = 0.1%, 2 = 0.1%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 0 / w = 45668083 / d = 0, short = r = 0 / w = 0 / d = 0

Run status group 0 (all jobs):
READ: io = 87619MB, aggrb = 24922KB / s, minb = 24922KB / s, maxb = 24922KB / s, mint = 3600001msec, maxt = 3600001msec
WRITE: io = 178391MB, aggrb = 50742KB / s, minb = 50742KB / s, maxb = 50742KB / s, mint = 3600001msec, maxt = 3600001msec

iodepth = 8 multipath.txt

readtest: (groupid = 0, jobs = 1): err = 0: pid = 32266: Fri Jan 31 04:33:06 2014
read: io = 154170MB, bw = 43853KB / s, iops = 10963, runt = 3600003msec
slat (usec): min = 4, max = 354, avg = 16.79, stdev = 16.05
clat (usec): min = 0, max = 900645, avg = 709.75, stdev = 618.94
lat (usec): min = 51, max = 900656, avg = 726.86, stdev = 618.57
clat percentiles (usec):
| 1.00th = [402], 5.00th = [438], 10.00th = [454], 20.00th = [474],
| 30.00th = [494], 40.00th = [510], 50.00th = [532], 60.00th = [556],
| 70.00th = [580], 80.00th = [644], 90.00th = [1176], 95.00th = [1928],
| 99.00th = [3152], 99.50th = [3536], 99.90th = [6176], 99.95th = [8256],
| 99.99th = [11200]
bw (KB / s): min = 32488, max = 57256, per = 100.00%, avg = 43865.77, stdev = 3915.90
lat (usec): 2 = 0.01%, 20 = 0.01%, 50 = 0.01%, 100 = 0.01%, 250 = 0.01%
lat (usec): 500 = 33.97%, 750 = 50.90%, 1000 = 2.68%
lat (msec): 2 = 7.72%, 4 = 4.44%, 10 = 0.25%, 20 = 0.02%, 50 = 0.01%
lat (msec): 1000 = 0.01%
cpu: usr = 3.73%, sys = 17.55%, ctx = 26845755, majf = 0, minf = 32
IO depths: 1 = 0.1%, 2 = 0.1%, 4 = 0.1%, 8 = 100.0%, 16 = 0.0%, 32 = 0.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.1%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 39467552 / w = 0 / d = 0, short = r = 0 / w = 0 / d = 0
writetest: (groupid = 0, jobs = 1): err = 0: pid = 32271: Fri Jan 31 04:33:06 2014
write: io = 308578MB, bw = 87773KB / s, iops = 21943, runt = 3600001msec
slat (usec): min = 4, max = 455, avg = 13.71, stdev = 10.67
clat (usec): min = 19, max = 44079, avg = 348.39, stdev = 354.61
lat (usec): min = 126, max = 44088, avg = 362.38, stdev = 354.49
clat percentiles (usec):
| 1.00th = [161], 5.00th = [187], 10.00th = [203], 20.00th = [225],
| 30.00th = [243], 40.00th = [258], 50.00th = [274], 60.00th = [294],
| 70.00th = [318], 80.00th = [350], 90.00th = [430], 95.00th = [756],
| 99.00th = [2096], 99.50th = [2608], 99.90th = [3760], 99.95th = [4320],
| 99.99th = [6496]
bw (KB / s): min = 80088, max = 101800, per = 100.00%, avg = 87793.89, stdev = 2000.83
lat (usec): 20 = 0.01%, 50 = 0.01%, 100 = 0.01%, 250 = 34.51%, 500 = 58.42%
lat (usec): 750 = 2.05%, 1000 = 1.48%
lat (msec): 2 = 2.41%, 4 = 1.05%, 10 = 0.07%, 20 = 0.01%, 50 = 0.01%
cpu: usr = 6.25%, sys = 28.75%, ctx = 31304284, majf = 0, minf = 25
IO depths: 1 = 0.1%, 2 = 0.1%, 4 = 0.1%, 8 = 100.0%, 16 = 0.0%, 32 = 0.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.1%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 0 / w = 78995890 / d = 0, short = r = 0 / w = 0 / d = 0

Run status group 0 (all jobs):
READ: io = 154170MB, aggrb = 43852KB / s, minb = 43852KB / s, maxb = 43852KB / s, mint = 3600003msec, maxt = 3600003msec
WRITE: io = 308578MB, aggrb = 87773KB / s, minb = 87773KB / s, maxb = 87773KB / s, mint = 3600001msec, maxt = 3600001msec

iodepth = 8 ultrapath.txt

readtest: (groupid = 0, jobs = 1): err = 0: pid = 29988: Wed Feb 5 07:58:17 2014
read: io = 154995MB, bw = 44087KB / s, iops = 11021, runt = 3600006msec
slat (usec): min = 4, max = 650, avg = 20.76, stdev = 14.52
clat (usec): min = 1, max = 47104, avg = 702.42, stdev = 602.03
lat (usec): min = 55, max = 47123, avg = 723.44, stdev = 601.81
clat percentiles (usec):
| 1.00th = [402], 5.00th = [430], 10.00th = [446], 20.00th = [466],
| 30.00th = [482], 40.00th = [502], 50.00th = [524], 60.00th = [548],
| 70.00th = [588], 80.00th = [652], 90.00th = [1144], 95.00th = [1912],
| 99.00th = [3152], 99.50th = [3568], 99.90th = [6496], 99.95th = [8256],
| 99.99th = [10944]
bw (KB / s): min = 32488, max = 59328, per = 100.00%, avg = 44100.56, stdev = 4310.49
lat (usec): 2 = 0.01%, 50 = 0.01%, 100 = 0.02%, 250 = 0.01%, 500 = 39.82%
lat (usec): 750 = 45.28%, 1000 = 2.96%
lat (msec): 2 = 7.28%, 4 = 4.34%, 10 = 0.27%, 20 = 0.02%, 50 = 0.01%
cpu: usr = 4.75%, sys = 28.35%, ctx = 15429521, majf = 0, minf = 32
IO depths: 1 = 0.1%, 2 = 0.1%, 4 = 0.1%, 8 = 100.0%, 16 = 0.0%, 32 = 0.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.1%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 39678782 / w = 0 / d = 0, short = r = 0 / w = 0 / d = 0
writetest: (groupid = 0, jobs = 1): err = 0: pid = 29989: Wed Feb 5 07:58:17 2014
write: io = 295457MB, bw = 84041KB / s, iops = 21010, runt = 3600001msec
slat (usec): min = 5, max = 1025, avg = 19.37, stdev = 13.41
clat (usec): min = 49, max = 46460, avg = 359.13, stdev = 368.20
lat (usec): min = 135, max = 46475, avg = 378.76, stdev = 367.82
clat percentiles (usec):
| 1.00th = [159], 5.00th = [183], 10.00th = [203], 20.00th = [229],
| 30.00th = [251], 40.00th = [270], 50.00th = [290], 60.00th = [310],
| 70.00th = [334], 80.00th = [370], 90.00th = [426], 95.00th = [756],
| 99.00th = [2192], 99.50th = [2768], 99.90th = [4016], 99.95th = [4640],
| 99.99th = [6496]
bw (KB / s): min = 72592, max = 101856, per = 100.00%, avg = 84060.37, stdev = 2465.20
lat (usec): 50 = 0.01%, 100 = 0.01%, 250 = 29.88%, 500 = 63.95%, 750 = 1.16%
lat (usec): 1000 = 1.32%
lat (msec): 2 = 2.45%, 4 = 1.15%, 10 = 0.10%, 20 = 0.01%, 50 = 0.01%
cpu: usr = 7.03%, sys = 46.57%, ctx = 12954941, majf = 0, minf = 25
IO depths: 1 = 0.1%, 2 = 0.1%, 4 = 0.1%, 8 = 100.0%, 16 = 0.0%, 32 = 0.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.1%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 0 / w = 75637077 / d = 0, short = r = 0 / w = 0 / d = 0

Run status group 0 (all jobs):
READ: io = 154995MB, aggrb = 44087KB / s, minb = 44087KB / s, maxb = 44087KB / s, mint = 3600006msec, maxt = 3600006msec
WRITE: io = 295457MB, aggrb = 84041KB / s, minb = 84041KB / s, maxb = 84041KB / s, mint = 3600001msec, maxt = 3600001msec

iodepth = 16 multipath.txt

readtest: (groupid = 0, jobs = 1): err = 0: pid = 26102: Thu Jan 30 02:55:58 2014
read: io = 240369MB, bw = 68372KB / s, iops = 17092, runt = 3600004msec
slat (usec): min = 4, max = 470, avg = 15.61, stdev = 17.25
clat (usec): min = 1, max = 999588, avg = 917.79, stdev = 2841.78
lat (usec): min = 51, max = 999671, avg = 933.72, stdev = 2841.76
clat percentiles (usec):
| 1.00th = [402], 5.00th = [434], 10.00th = [450], 20.00th = [478],
| 30.00th = [498], 40.00th = [524], 50.00th = [556], 60.00th = [596],
| 70.00th = [652], 80.00th = [788], 90.00th = [1528], 95.00th = [2384],
| 99.00th = [3664], 99.50th = [7392], 99.90th = [47360], 99.95th = [64256],
| 99.99th = [91648]
bw (KB / s): min = 4890, max = 101096, per = 100.00%, avg = 68424.07, stdev = 24048.31
lat (usec): 2 = 0.01%, 20 = 0.01%, 50 = 0.01%, 100 = 0.01%, 250 = 0.01%
lat (usec): 500 = 30.93%, 750 = 47.28%, 1000 = 6.07%
lat (msec): 2 = 8.67%, 4 = 6.20%, 10 = 0.46%, 20 = 0.13%, 50 = 0.15%
lat (msec): 100 = 0.09%, 250 = 0.01%, 500 = 0.01%, 750 = 0.01%, 1000 = 0.01%
cpu: usr = 5.27%, sys = 24.04%, ctx = 33079601, majf = 0, minf = 42
IO depths: 1 = 0.1%, 2 = 0.1%, 4 = 0.1%, 8 = 0.1%, 16 = 100.0%, 32 = 0.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.1%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 61534506 / w = 0 / d = 0, short = r = 0 / w = 0 / d = 0
writetest: (groupid = 0, jobs = 1): err = 0: pid = 26116: Thu Jan 30 02:55:58 2014
write: io = 387361MB, bw = 110183KB / s, iops = 27545, runt = 3600001msec
slat (usec): min = 4, max = 466, avg = 16.62, stdev = 16.50
clat (usec): min = 29, max = 1001.8K, avg = 561.59, stdev = 895.67
lat (usec): min = 134, max = 1001.9K, avg = 578.56, stdev = 895.33
clat percentiles (usec):
| 1.00th = [199], 5.00th = [249], 10.00th = [282], 20.00th = [326],
| 30.00th = [362], 40.00th = [398], 50.00th = [434], 60.00th = [482],
| 70.00th = [548], 80.00th = [668], 90.00th = [916], 95.00th = [1224],
| 99.00th = [2544], 99.50th = [3184], 99.90th = [4768], 99.95th = [5664],
| 99.99th = [12608]
bw (KB / s): min = 9975, max = 151784, per = 100.00%, avg = 110233.65, stdev = 12753.77
lat (usec): 50 = 0.01%, 100 = 0.01%, 250 = 5.03%, 500 = 57.80%, 750 = 21.80%
lat (usec): 1000 = 7.19%
lat (msec): 2 = 6.38%, 4 = 1.58%, 10 = 0.20%, 20 = 0.01%, 50 = 0.01%
lat (msec): 100 = 0.01%, 250 = 0.01%, 500 = 0.01%, 750 = 0.01%, 1000 = 0.01%
lat (msec): 2000 = 0.01%
cpu: usr = 6.80%, sys = 38.36%, ctx = 43663956, majf = 0, minf = 24
IO depths: 1 = 0.1%, 2 = 0.1%, 4 = 0.1%, 8 = 0.1%, 16 = 100.0%, 32 = 0.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.1%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 0 / w = 99164359 / d = 0, short = r = 0 / w = 0 / d = 0

Run status group 0 (all jobs):
READ: io = 240369MB, aggrb = 68371KB / s, minb = 68371KB / s, maxb = 68371KB / s, mint = 3600004msec, maxt = 3600004msec
WRITE: io = 387361MB, aggrb = 110182KB / s, minb = 110182KB / s, maxb = 110182KB / s, mint = 3600001msec, maxt = 3600001msec

iodepth = 16 ultrapath.txt

readtest: (groupid = 0, jobs = 1): err = 0: pid = 3964: Thu Feb 6 10:16:49 2014
read: io = 259319MB, bw = 73761KB / s, iops = 18440, runt = 3600027msec
slat (usec): min = 4, max = 8602, avg = 19.33, stdev = 36.15
clat (usec): min = 21, max = 1607.9K, avg = 846.25, stdev = 1673.49
lat (usec): min = 58, max = 1607.9K, avg = 865.84, stdev = 1673.86
clat percentiles (usec):
| 1.00th = [406], 5.00th = [426], 10.00th = [442], 20.00th = [458],
| 30.00th = [474], 40.00th = [490], 50.00th = [510], 60.00th = [540],
| 70.00th = [612], 80.00th = [876], 90.00th = [1656], 95.00th = [2576],
| 99.00th = [4768], 99.50th = [6816], 99.90th = [9792], 99.95th = [11200],
| 99.99th = [40704]
bw (KB / s): min = 40, max = 106055, per = 100.00%, avg = 73817.40, stdev = 8578.02
lat (usec): 50 = 0.01%, 100 = 0.01%, 250 = 0.01%, 500 = 45.52%, 750 = 30.72%
lat (usec): 1000 = 6.18%
lat (msec): 2 = 9.76%, 4 = 6.38%, 10 = 1.34%, 20 = 0.06%, 50 = 0.02%
lat (msec): 100 = 0.01%, 250 = 0.01%, 500 = 0.01%, 2000 = 0.01%
cpu: usr = 6.18%, sys = 39.18%, ctx = 20805418, majf = 0, minf = 40
IO depths: 1 = 0.1%, 2 = 0.1%, 4 = 0.1%, 8 = 0.1%, 16 = 100.0%, 32 = 0.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.1%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 66385600 / w = 0 / d = 0, short = r = 0 / w = 0 / d = 0
writetest: (groupid = 0, jobs = 1): err = 0: pid = 3965: Thu Feb 6 10:16:49 2014
write: io = 364798MB, bw = 103765KB / s, iops = 25941, runt = 3600001msec
slat (usec): min = 4, max = 2685, avg = 25.16, stdev = 22.87
clat (usec): min = 76, max = 1080.5K, avg = 589.20, stdev = 1047.79
lat (usec): min = 139, max = 1080.5K, avg = 614.70, stdev = 1047.39
clat percentiles (usec):
| 1.00th = [237], 5.00th = [270], 10.00th = [298], 20.00th = [350],
| 30.00th = [414], 40.00th = [470], 50.00th = [502], 60.00th = [524],
| 70.00th = [556], 80.00th = [604], 90.00th = [748], 95.00th = [1256],
| 99.00th = [3088], 99.50th = [3728], 99.90th = [5280], 99.95th = [6048],
| 99.99th = [10176]
bw (KB / s): min = 1672, max = 156408, per = 100.00%, avg = 103841.82, stdev = 7313.15
lat (usec): 100 = 0.01%, 250 = 2.19%, 500 = 47.73%, 750 = 40.12%, 1000 = 3.15%
lat (msec): 2 = 4.03%, 4 = 2.40%, 10 = 0.36%, 20 = 0.01%, 50 = 0.01%
lat (msec): 100 = 0.01%, 250 = 0.01%, 500 = 0.01%, 1000 = 0.01%, 2000 = 0.01%
cpu: usr = 7.09%, sys = 67.83%, ctx = 5081433, majf = 0, minf = 26
IO depths: 1 = 0.1%, 2 = 0.1%, 4 = 0.1%, 8 = 0.1%, 16 = 100.0%, 32 = 0.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.1%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 0 / w = 93388195 / d = 0, short = r = 0 / w = 0 / d = 0

Run status group 0 (all jobs):
READ: io = 259319MB, aggrb = 73761KB / s, minb = 73761KB / s, maxb = 73761KB / s, mint = 3600027msec, maxt = 3600027msec
WRITE: io = 364798MB, aggrb = 103764KB / s, minb = 103764KB / s, maxb = 103764KB / s, mint = 3600001msec, maxt = 3600001msec

iodepth = 32 multipath.txt

readtest: (groupid = 0, jobs = 1): err = 0: pid = 423: Fri Jan 31 07:01:03 2014
read: io = 328913MB, bw = 93557KB / s, iops = 23389, runt = 3600010msec
slat (usec): min = 3, max = 1080, avg = 15.14, stdev = 26.92
clat (usec): min = 48, max = 1002.4K, avg = 1349.93, stdev = 2873.03
lat (usec): min = 58, max = 1002.4K, avg = 1365.48, stdev = 2872.78
clat percentiles (usec):
| 1.00th = [474], 5.00th = [548], 10.00th = [604], 20.00th = [692],
| 30.00th = [780], 40.00th = [900], 50.00th = [1012], 60.00th = [1128],
| 70.00th = [1256], 80.00th = [1512], 90.00th = [2320], 95.00th = [3120],
| 99.00th = [4704], 99.50th = [6816], 99.90th = [39168], 99.95th = [56576],
| 99.99th = [86528]
bw (KB / s): min = 6558, max = 145064, per = 100.00%, avg = 93671.04, stdev = 24855.12
lat (usec): 50 = 0.01%, 100 = 0.01%, 250 = 0.01%, 500 = 2.00%, 750 = 25.05%
lat (usec): 1000 = 21.60%
lat (msec): 2 = 38.62%, 4 = 10.83%, 10 = 1.55%, 20 = 0.14%, 50 = 0.13%
lat (msec): 100 = 0.06%, 250 = 0.01%, 500 = 0.01%, 750 = 0.01%, 1000 = 0.01%
lat (msec): 2000 = 0.01%
cpu: usr = 5.95%, sys = 26.46%, ctx = 36935184, majf = 0, minf = 56
IO depths: 1 = 0.1%, 2 = 0.1%, 4 = 0.1%, 8 = 0.1%, 16 = 0.1%, 32 = 100.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.1%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 84201777 / w = 0 / d = 0, short = r = 0 / w = 0 / d = 0
writetest: (groupid = 0, jobs = 1): err = 0: pid = 428: Fri Jan 31 07:01:03 2014
write: io = 397543MB, bw = 113079KB / s, iops = 28269, runt = 3600002msec
slat (usec): min = 4, max = 744, avg = 16.76, stdev = 29.38
clat (usec): min = 90, max = 1002.4K, avg = 1111.71, stdev = 1614.82
lat (usec): min = 147, max = 1002.4K, avg = 1128.95, stdev = 1614.41
clat percentiles (usec):
| 1.00th = [342], 5.00th = [454], 10.00th = [580], 20.00th = [724],
| 30.00th = [812], 40.00th = [900], 50.00th = [988], 60.00th = [1080],
| 70.00th = [1176], 80.00th = [1288], 90.00th = [1624], 95.00th = [2256],
| 99.00th = [3952], 99.50th = [4576], 99.90th = [6112], 99.95th = [7008],
| 99.99th = [11968]
bw (KB / s): min = 8608, max = 149936, per = 100.00%, avg = 113220.31, stdev = 12272.62
lat (usec): 100 = 0.01%, 250 = 0.03%, 500 = 6.57%, 750 = 16.26%, 1000 = 28.53%
lat (msec): 2 = 42.21%, 4 = 5.48%, 10 = 0.92%, 20 = 0.01%, 50 = 0.01%
lat (msec): 100 = 0.01%, 250 = 0.01%, 500 = 0.01%, 1000 = 0.01%, 2000 = 0.01%
cpu: usr = 5.90%, sys = 33.57%, ctx = 35759063, majf = 0, minf = 26
IO depths: 1 = 0.1%, 2 = 0.1%, 4 = 0.1%, 8 = 0.1%, 16 = 0.1%, 32 = 100.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.1%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 0 / w = 101771023 / d = 0, short = r = 0 / w = 0 / d = 0

Run status group 0 (all jobs):
READ: io = 328913MB, aggrb = 93557KB / s, minb = 93557KB / s, maxb = 93557KB / s, mint = 3600010msec, maxt = 3600010msec
WRITE: io = 397543MB, aggrb = 113078KB / s, minb = 113078KB / s, maxb = 113078KB / s, mint = 3600002msec, maxt = 3600002msec

iodepth = 32 ultrapath.txt

readtest: (groupid = 0, jobs = 1): err = 0: pid = 4401: Fri Feb 7 01:28:11 2014
read: io = 253292MB, bw = 72047KB / s, iops = 18011, runt = 3600039msec
slat (usec): min = 3, max = 11159, avg = 20.21, stdev = 73.43
clat (usec): min = 1, max = 1974.8K, avg = 1752.93, stdev = 3931.55
lat (usec): min = 61, max = 1974.8K, avg = 1773.56, stdev = 3932.06
clat percentiles (usec):
| 1.00th = [482], 5.00th = [548], 10.00th = [612], 20.00th = [724],
| 30.00th = [860], 40.00th = [1012], 50.00th = [1208], 60.00th = [1512],
| 70.00th = [1864], 80.00th = [2288], 90.00th = [3184], 95.00th = [4192],
| 99.00th = [7392], 99.50th = [9664], 99.90th = [37120], 99.95th = [58624],
| 99.99th = [138240]
bw (KB / s): min = 4010, max = 241592, per = 100.00%, avg = 72266.04, stdev = 18501.78
lat (usec): 2 = 0.01%, 20 = 0.01%, 50 = 0.01%, 100 = 0.01%, 250 = 0.01%
lat (usec): 500 = 1.73%, 750 = 20.07%, 1000 = 17.38%
lat (msec): 2 = 34.74%, 4 = 20.34%, 10 = 5.27%, 20 = 0.28%, 50 = 0.12%
lat (msec): 100 = 0.05%, 250 = 0.01%, 500 = 0.01%, 750 = 0.01%, 2000 = 0.01%
cpu: usr = 5.30%, sys = 39.39%, ctx = 13898594, majf = 0, minf = 56
IO depths: 1 = 0.1%, 2 = 0.1%, 4 = 0.1%, 8 = 0.1%, 16 = 0.1%, 32 = 100.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.1%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 64842830 / w = 0 / d = 0, short = r = 0 / w = 0 / d = 0
writetest: (groupid = 0, jobs = 1): err = 0: pid = 4402: Fri Feb 7 01:28:11 2014
write: io = 393497MB, bw = 111928KB / s, iops = 27982, runt = 3600001msec
slat (usec): min = 4, max = 9057, avg = 16.81, stdev = 49.04
clat (usec): min = 0, max = 2292.8K, avg = 1123.70, stdev = 2689.64
lat (usec): min = 157, max = 2292.8K, avg = 1140.91, stdev = 2689.55
clat percentiles (usec):
| 1.00th = [366], 5.00th = [442], 10.00th = [486], 20.00th = [532],
| 30.00th = [572], 40.00th = [668], 50.00th = [852], 60.00th = [1020],
| 70.00th = [1224], 80.00th = [1512], 90.00th = [1944], 95.00th = [2576],
| 99.00th = [4512], 99.50th = [5280], 99.90th = [7392], 99.95th = [9664],
| 99.99th = [101888]
bw (KB / s): min = 4237, max = 186440, per = 100.00%, avg = 112183.91, stdev = 13867.37
lat (usec): 2 = 0.01%, 4 = 0.01%, 20 = 0.01%, 50 = 0.01%, 100 = 0.01%
lat (usec): 250 = 0.09%, 500 = 11.98%, 750 = 33.05%, 1000 = 13.56%
lat (msec): 2 = 32.13%, 4 = 7.61%, 10 = 1.53%, 20 = 0.02%, 50 = 0.01%
lat (msec): 100 = 0.01%, 250 = 0.01%, 500 = 0.01%, 750 = 0.01%, 2000 = 0.01%
lat (msec):> = 2000 = 0.01%
cpu: usr = 7.10%, sys = 48.53%, ctx = 8015753, majf = 0, minf = 26
IO depths: 1 = 0.1%, 2 = 0.1%, 4 = 0.1%, 8 = 0.1%, 16 = 0.1%, 32 = 100.0%,> = 64 = 0.0%
submit: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.0%, 64 = 0.0%,> = 64 = 0.0%
complete: 0 = 0.0%, 4 = 100.0%, 8 = 0.0%, 16 = 0.0%, 32 = 0.1%, 64 = 0.0%,> = 64 = 0.0%
issued: total = r = 0 / w = 100735259 / d = 0, short = r = 0 / w = 0 / d = 0

Run status group 0 (all jobs):
READ: io = 253292MB, aggrb = 72046KB / s, minb = 72046KB / s, maxb = 72046KB / s, mint = 3600039msec, maxt = 3600039msec
WRITE: io = 393497MB, aggrb = 111928KB / s, minb = 111928KB / s, maxb = 111928KB / s, mint = 3600001msec, maxt = 3600001msec

iodepth = 64 multipath.txt

readtest: (groupid = 0, jobs = 1): err = 0: pid = 926: Fri Jan 31 08:58:08 2014
read: io = 652296MB, bw = 185542KB / s, iops = 46385, runt = 3600006msec
slat (usec): min = 3, max = 4153, avg = 9.20, stdev = 18.22
clat (usec): min = 30, max = 1002.2K, avg = 1367.91, stdev = 1081.03
lat (usec): min = 87, max = 1002.2K, avg = 1377.43, stdev = 1082.05
clat percentiles (usec):
| 1.00th = [668], 5.00th = [772], 10.00th = [844], 20.00th = [964],
| 30.00th = [1048], 40.00th = [1112], 50.00th = [1160], 60.00th = [1224],
| 70.00th = [1320], 80.00th = [1464], 90.00th = [1720], 95.00th = [2384],
| 99.00th = [6368], 99.50th = [7968], 99.90th = [12096], 99.95th = [16320],
| 99.99th = [27264]
bw (KB /s): min=114536, max=212944, per=100.00%, avg=185577.52, stdev=10223.71
lat (usec): 50=0.01%, 100=0.01%, 250=0.01%, 500=0.01%, 750=3.96%
lat (usec): 1000=20.29%
lat (msec): 2=69.05%, 4=4.27%, 10=2.23%, 20=0.16%, 50=0.03%
lat (msec): 100=0.01%, 2000=0.01%
cpu: usr=8.61%, sys=32.56%, ctx=34570996, majf=0, minf=88
IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued: total=r=166987885/w=0/d=0, short=r=0/w=0/d=0
writetest: (groupid=0, jobs=1): err= 0: pid=934: Fri Jan 31 08:58:08 2014
write: io=111448MB, bw=31701KB/s, iops=7925, runt=3600001msec
slat (usec): min=3, max=4311, avg=10.96, stdev=20.02
clat (usec): min=58, max=401810, avg=8062.31, stdev=19613.64
lat (usec): min=172, max=401832, avg=8073.55, stdev=19613.28
clat percentiles (usec):
| 1.00th=[ 438], 5.00th=[ 604], 10.00th=[ 708], 20.00th=[ 884],
| 30.00th=[ 1080], 40.00th=[ 1272], 50.00th=[ 1496], 60.00th=[ 1800],
| 70.00th=[ 2448], 80.00th=[ 3824], 90.00th=[22656], 95.00th=[54016],
| 99.00th=[99840], 99.50th=[100864], 99.90th=[101888], 99.95th=[102912],
| 99.99th=[103936]
bw (KB /s): min= 6566, max=143488, per=100.00%, avg=31797.68, stdev=9642.02
lat (usec): 100=0.01%, 250=0.01%, 500=2.05%, 750=10.39%, 1000=13.82%
lat (msec): 2=37.66%, 4=16.93%, 10=5.82%, 20=2.69%, 50=5.17%
lat (msec): 100=4.56%, 250=0.90%, 500=0.01%
cpu: usr=1.80%, sys=8.36%, ctx=3597659, majf=0, minf=26
IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued: total=r=0/w=28530630/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
READ: io=652296MB, aggrb=185541KB/s, minb=185541KB/s, maxb=185541KB/s, mint=3600006msec, maxt=3600006msec
WRITE: io=111448MB, aggrb=31700KB/s, minb=31700KB/s, maxb=31700KB/s, mint=3600001msec, maxt=3600001msec

iodepth = 64 ultrapath.txt

readtest: (groupid=0, jobs=1): err= 0: pid=24318: Thu Feb 6 07:31:04 2014
read: io=282495MB, bw=80354KB/s, iops=20088, runt=3600006msec
slat (usec): min=3, max=9427, avg=17.03, stdev=78.78
clat (usec): min=78, max=103266, avg=3164.72, stdev=3269.88
lat (usec): min=83, max=103271, avg=3182.29, stdev=3277.82
clat percentiles (usec):
| 1.00th=[ 700], 5.00th=[ 876], 10.00th=[ 1004], 20.00th=[ 1160],
| 30.00th=[ 1336], 40.00th=[ 1528], 50.00th=[ 1736], 60.00th=[ 2040],
| 70.00th=[ 2672], 80.00th=[ 4448], 90.00th=[ 8640], 95.00th=[10816],
| 99.00th=[14272], 99.50th=[15680], 99.90th=[19584], 99.95th=[21632],
| 99.99th=[27264]
bw (KB /s): min=40841, max=112192, per=100.00%, avg=80403.74, stdev=10790.61
lat (usec): 100=0.01%, 250=0.01%, 500=0.02%, 750=1.74%, 1000=8.00%
lat (msec): 2=49.39%, 4=19.33%, 10=14.80%, 20=6.63%, 50=0.08%
lat (msec): 100=0.01%, 250=0.01%
cpu: usr=4.74%, sys=35.34%, ctx=6798101, majf=0, minf=88
IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued: total=r=72318753/w=0/d=0, short=r=0/w=0/d=0
writetest: (groupid=0, jobs=1): err= 0: pid=24319: Thu Feb 6 07:31:04 2014
write: io=351363MB, bw=99943KB/s, iops=24985, runt=3600001msec
slat (usec): min=4, max=8910, avg=11.73, stdev=24.54
clat (usec): min=24, max=64699, avg=2547.66, stdev=2956.77
lat (usec): min=162, max=64717, avg=2559.65, stdev=2957.73
clat percentiles (usec):
| 1.00th=[ 410], 5.00th=[ 494], 10.00th=[ 580], 20.00th=[ 748],
| 30.00th=[ 908], 40.00th=[ 1080], 50.00th=[ 1256], 60.00th=[ 1640],
| 70.00th=[ 2672], 80.00th=[ 3984], 90.00th=[ 5856], 95.00th=[ 8896],
| 99.00th=[13632], 99.50th=[16320], 99.90th=[23680], 99.95th=[27008],
| 99.99th=[34560]
bw (KB /s): min=55944, max=233784, per=100.00%, avg=100023.65, stdev=14015.00
lat (usec): 50=0.01%, 250=0.01%, 500=5.43%, 750=14.81%, 1000=15.25%
lat (msec): 2=28.63%, 4=15.88%, 10=16.22%, 20=3.55%, 50=0.22%
lat (msec): 100=0.01%
cpu: usr=6.58%, sys=32.85%, ctx=8909307, majf=0, minf=25
IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued: total=r=0/w=89948953/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
READ: io=282495MB, aggrb=80354KB/s, minb=80354KB/s, maxb=80354KB/s, mint=3600006msec, maxt=3600006msec
WRITE: io=351363MB, aggrb=99943KB/s, minb=99943KB/s, maxb=99943KB/s, mint=3600001msec, maxt=3600001msec

iodepth = 128 multipath.txt

readtest: (groupid=0, jobs=1): err= 0: pid=16046: Mon Feb 3 02:15:47 2014
read: io=579775MB, bw=164914KB/s, iops=41228, runt=3600002msec
slat (usec): min=0, max=974090, avg=27.48, stdev=254.31
clat (usec): min=0, max=1006.2K, avg=4017.33, stdev=3221.76
lat (usec): min=0, max=1006.2K, avg=4045.08, stdev=3236.78
clat percentiles (usec):
| 1.00th=[ 1320], 5.00th=[ 1928], 10.00th=[ 2096], 20.00th=[ 2224],
| 30.00th=[ 2320], 40.00th=[ 2416], 50.00th=[ 2928], 60.00th=[ 3824],
| 70.00th=[ 4704], 80.00th=[ 5792], 90.00th=[ 7584], 95.00th=[ 9024],
| 99.00th=[11840], 99.50th=[12864], 99.90th=[15808], 99.95th=[17024],
| 99.99th=[20864]
bw (KB /s): min= 732, max=213908598, per=100.00%, avg=165120.58, stdev=2522660.59
lat (usec): 2=0.11%, 20=0.01%, 50=0.01%, 100=0.01%, 250=0.01%
lat (usec): 500=0.01%, 750=0.08%, 1000=0.20%
lat (msec): 2=6.28%, 4=55.51%, 10=34.85%, 20=2.96%, 50=0.01%
lat (msec): 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec): 2000=0.01%
cpu: usr=7.96%, sys=44.49%, ctx=36526731, majf=0, minf=152
IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
issued: total=r=148422358/w=0/d=0, short=r=0/w=0/d=0
writetest: (groupid=0, jobs=1): err= 0: pid=16054: Mon Feb 3 02:15:47 2014
write: io=348347MB, bw=99085KB/s, iops=24771, runt=3600004msec
slat (usec): min=3, max=976572, avg=37.04, stdev=325.40
clat (usec): min=13, max=1005.5K, avg=5128.32, stdev=3744.49
lat (usec): min=191, max=1005.6K, avg=5165.61, stdev=3756.93
clat percentiles (usec):
| 1.00th=[ 1048], 5.00th=[ 1544], 10.00th=[ 1992], 20.00th=[ 2832],
| 30.00th=[ 3632], 40.00th=[ 4320], 50.00th=[ 4832], 60.00th=[ 5472],
| 70.00th=[ 6176], 80.00th=[ 7136], 90.00th=[ 8512], 95.00th=[ 9664],
| 99.00th=[11968], 99.50th=[12864], 99.90th=[14784], 99.95th=[15680],
| 99.99th=[19584]
bw (KB /s): min= 753, max=129744, per=100.00%, avg=99231.31, stdev=4713.98
lat (usec): 20=0.01%, 50=0.01%, 100=0.01%, 250=0.01%, 500=0.03%
lat (usec): 750=0.23%, 1000=0.58%
lat (msec): 2=9.31%, 4=25.25%, 10=60.44%, 20=4.14%, 50=0.01%
lat (msec): 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec): 2000=0.01%
cpu: usr=5.35%, sys=24.39%, ctx=4316924, majf=0, minf=26
IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
issued: total=r=0/w=89176850/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
READ: io=579775MB, aggrb=164913KB/s, minb=164913KB/s, maxb=164913KB/s, mint=3600002msec, maxt=3600002msec
WRITE: io=348347MB, aggrb=99085KB/s, minb=99085KB/s, maxb=99085KB/s, mint=3600004msec, maxt=3600004msec

SQLIO
With a block size of 64 kilobytes.

With a block size of 512 kilobytes.

For those who want to see all the numbers with their own eyes, I suggest a test log:

Random Reads Test_64.txt

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t1 -o1 -s600 -b64 -FE:\par
am.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 1 thread (0) using mask 0x0 (0)
1 thread reading for 600 secs from file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1214.66
MBs/sec: 75.91

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t2 -o1 -s600 -b64 -FE:\par
am.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 2 threads (0-1) using mask 0x0 (0)
2 threads reading for 600 secs from file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 2572.83
MBs/sec: 160.80

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t4 -o1 -s600 -b64 -FE:\par
am.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 4 threads (0-3) using mask 0x0 (0)
4 threads reading for 600 secs from file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 5341.55
MBs/sec: 333.84

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t8 -o1 -s600 -b64 -FE:\par
am.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 9788.54
MBs/sec: 611.78

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t8 -o2 -s600 -b64 -FE:\par
am.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 2 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11581.91
MBs/sec: 723.86

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t8 -o4 -s600 -b64 -FE:\par
am.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 4 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11569.19
MBs/sec: 723.07

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t8 -o8 -s600 -b64 -FE:\par
am.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 8 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11568.45
MBs/sec: 723.02

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t8 -o16 -s600 -b64 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 16 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11545.43
MBs/sec: 721.58

C:\Users\>
C:\Users\>E:\sqlio.exe -BH -kR -frandom -t8 -o32 -s600 -b64 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 32 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11452.12
MBs/sec: 715.75

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t8 -o64 -s600 -b64 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 64 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11451.62
MBs/sec: 715.72

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t8 -o128 -s600 -b64 -FE:\p
aram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 128 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11445.70
MBs/sec: 715.35

Random Writes Test_64.txt

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t1 -o1 -s600 -b64 -FE:\par
am.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 1 thread (0) using mask 0x0 (0)
1 thread writing for 600 secs to file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 2294.78
MBs/sec: 143.42

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t2 -o1 -s600 -b64 -FE:\par
am.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 2 threads (0-1) using mask 0x0 (0)
2 threads writing for 600 secs to file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 4620.18
MBs/sec: 288.76

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t4 -o1 -s600 -b64 -FE:\par
am.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 4 threads (0-3) using mask 0x0 (0)
4 threads writing for 600 secs to file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 7925.35
MBs/sec: 495.33

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t8 -o1 -s600 -b64 -FE:\par
am.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11514.60
MBs/sec: 719.66

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t8 -o2 -s600 -b64 -FE:\par
am.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 2 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11788.28
MBs/sec: 736.76

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t8 -o4 -s600 -b64 -FE:\par
am.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 4 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11889.59
MBs/sec: 743.09

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t8 -o8 -s600 -b64 -FE:\par
am.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 8 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11890.72
MBs/sec: 743.17

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t8 -o16 -s600 -b64 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 16 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11890.81
MBs/sec: 743.17

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t8 -o32 -s120 -b64 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 120 secs to file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 32 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11890.11
MBs/sec: 743.13

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t8 -o64 -s120 -b64 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 120 secs to file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 64 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11888.97
MBs/sec: 743.06

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t8 -o128 -s120 -b64 -FE:\p
aram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 120 secs to file E:\testfile.dat
using 64KB random IOs
enabling multiple I/Os per thread with 128 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11889.67
MBs/sec: 743.10

Senquential Reads Test_64.txt

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t1 -o1 -s600 -b64 -FE:
\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 1 thread (0) using mask 0x0 (0)
1 thread reading for 600 secs from file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1125.99
MBs/sec: 70.37

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t2 -o1 -s600 -b64 -FE:
\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 2 threads (0-1) using mask 0x0 (0)
2 threads reading for 600 secs from file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 2353.74
MBs/sec: 147.10

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t4 -o1 -s600 -b64 -FE:
\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 4 threads (0-3) using mask 0x0 (0)
4 threads reading for 600 secs from file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 4838.02
MBs/sec: 302.37

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t8 -o1 -s600 -b64 -FE:
\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 8933.36
MBs/sec: 558.33

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t8 -o2 -s600 -b64 -FE:
\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 2 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11590.41
MBs/sec: 724.40

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t8 -o4 -s600 -b64 -FE:
\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 4 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11569.03
MBs/sec: 723.06

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t8 -o8 -s600 -b64 -FE:
\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 8 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11550.46
MBs/sec: 721.90

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t8 -o16 -s600 -b64 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 16 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11544.53
MBs/sec: 721.53

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t8 -o32 -s600 -b64 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 32 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11442.90
MBs/sec: 715.18

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t8 -o64 -s600 -b64 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 64 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11443.36
MBs/sec: 715.21

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t8 -o128 -s600 -b64 -F
E:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 128 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11459.39
MBs/sec: 716.21

Senquential Writes Test_64.txt

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t1 -o1 -s600 -b64 -FE:
\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 1 thread (0) using mask 0x0 (0)
1 thread writing for 600 secs to file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 2424.47
MBs/sec: 151.52

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t2 -o1 -s600 -b64 -FE:
\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 2 threads (0-1) using mask 0x0 (0)
2 threads writing for 600 secs to file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 5105.29
MBs/sec: 319.08

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t4 -o1 -s600 -b64 -FE:
\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 4 threads (0-3) using mask 0x0 (0)
4 threads writing for 600 secs to file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 8326.97
MBs/sec: 520.43

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t8 -o1 -s600 -b64 -FE:
\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11593.60
MBs/sec: 724.60

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t8 -o2 -s600 -b64 -FE:
\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 2 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11881.82
MBs/sec: 742.61

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t8 -o4 -s600 -b64 -FE:
\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 4 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11886.10
MBs/sec: 742.88

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t8 -o8 -s600 -b64 -FE:
\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 8 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11886.85
MBs/sec: 742.92

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t8 -o16 -s600 -b64 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 16 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11886.79
MBs/sec: 742.92

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t8 -o32 -s120 -b64 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 120 secs to file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 32 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11888.19
MBs/sec: 743.01

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t8 -o64 -s120 -b64 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 120 secs to file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 64 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11886.67
MBs/sec: 742.91

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t8 -o128 -s120 -b64 -F
E:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 120 secs to file E:\testfile.dat
using 64KB sequential IOs
enabling multiple I/Os per thread with 128 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 11887.17
MBs/sec: 742.94

Random Reads Test_512.txt

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t1 -o1 -s600 -b512 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 1 thread (0) using mask 0x0 (0)
1 thread reading for 600 secs from file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 443.55
MBs/sec: 221.77

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t2 -o1 -s600 -b512 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 2 threads (0-1) using mask 0x0 (0)
2 threads reading for 600 secs from file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 860.57
MBs/sec: 430.28

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t4 -o1 -s600 -b512 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 4 threads (0-3) using mask 0x0 (0)
4 threads reading for 600 secs from file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1480.60
MBs/sec: 740.30

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t8 -o1 -s600 -b512 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1553.24
MBs/sec: 776.62

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t8 -o2 -s600 -b512 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 2 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1553.15
MBs/sec: 776.57

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t8 -o4 -s600 -b512 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 4 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1553.10
MBs/sec: 776.55

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t8 -o8 -s600 -b512 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 8 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1553.11
MBs/sec: 776.55

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t8 -o16 -s600 -b512 -FE:\p
aram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 16 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1553.06
MBs/sec: 776.53

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t8 -o32 -s600 -b512 -FE:\p
aram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 32 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1552.84
MBs/sec: 776.42

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t8 -o64 -s600 -b512 -FE:\p
aram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 64 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1552.74
MBs/sec: 776.37

C:\Users\>E:\sqlio.exe -BH -kR -frandom -t8 -o128 -s600 -b512 -FE:\
param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 128 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1552.99
MBs/sec: 776.49

Random Writes Test_512.txt

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t1 -o1 -s600 -b512 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 1 thread (0) using mask 0x0 (0)
1 thread writing for 600 secs to file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 602.47
MBs/sec: 301.23

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t2 -o1 -s600 -b512 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 2 threads (0-1) using mask 0x0 (0)
2 threads writing for 600 secs to file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1132.45
MBs/sec: 566.22

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t4 -o1 -s600 -b512 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 4 threads (0-3) using mask 0x0 (0)
4 threads writing for 600 secs to file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1552.91
MBs/sec: 776.45

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t8 -o1 -s600 -b512 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1561.28
MBs/sec: 780.64

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t8 -o2 -s600 -b512 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 2 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1561.40
MBs/sec: 780.70

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t8 -o4 -s600 -b512 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 4 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1561.34
MBs/sec: 780.67

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t8 -o8 -s600 -b512 -FE:\pa
ram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 8 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1561.34
MBs/sec: 780.67

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t8 -o16 -s600 -b512 -FE:\p
aram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 16 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1561.36
MBs/sec: 780.68

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t8 -o32 -s120 -b512 -FE:\p
aram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 120 secs to file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 32 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1561.07
MBs/sec: 780.53

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t8 -o64 -s120 -b512 -FE:\p
aram.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 120 secs to file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 64 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1561.08
MBs/sec: 780.54

C:\Users\>E:\sqlio.exe -BH -kW -frandom -t8 -o128 -s120 -b512 -FE:\
param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 120 secs to file E:\testfile.dat
using 512KB random IOs
enabling multiple I/Os per thread with 128 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1561.10
MBs/sec: 780.55

Senquential Reads Test_512.txt

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t1 -o1 -s600 -b512 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 1 thread (0) using mask 0x0 (0)
1 thread reading for 600 secs from file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 415.86
MBs/sec: 207.93

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t2 -o1 -s600 -b512 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 2 threads (0-1) using mask 0x0 (0)
2 threads reading for 600 secs from file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 811.34
MBs/sec: 405.67

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t4 -o1 -s600 -b512 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 4 threads (0-3) using mask 0x0 (0)
4 threads reading for 600 secs from file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1456.29
MBs/sec: 728.14

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t8 -o1 -s600 -b512 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1552.56
MBs/sec: 776.28

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t8 -o2 -s600 -b512 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 2 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1552.52
MBs/sec: 776.26

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t8 -o4 -s600 -b512 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 4 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1552.48
MBs/sec: 776.24

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t8 -o8 -s600 -b512 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 8 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1552.47
MBs/sec: 776.23

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t8 -o16 -s600 -b512 -F
E:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 16 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1552.45
MBs/sec: 776.22

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t8 -o32 -s600 -b512 -F
E:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 32 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1552.40
MBs/sec: 776.20

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t8 -o64 -s600 -b512 -F
E:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 64 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1552.06
MBs/sec: 776.03

C:\Users\>E:\sqlio.exe -BH -kR -fsequential -t8 -o128 -s600 -b512 — FE:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads reading for 600 secs from file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 128 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1552.33
MBs/sec: 776.16

Senquential Writes Test_512.txt

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t1 -o1 -s600 -b512 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 1 thread (0) using mask 0x0 (0)
1 thread writing for 600 secs to file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 595.59
MBs/sec: 297.79

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t2 -o1 -s600 -b512 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 2 threads (0-1) using mask 0x0 (0)
2 threads writing for 600 secs to file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1141.76
MBs/sec: 570.88

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t4 -o1 -s600 -b512 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 4 threads (0-3) using mask 0x0 (0)
4 threads writing for 600 secs to file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1552.88
MBs/sec: 776.44

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t8 -o1 -s600 -b512 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 1 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1561.16
MBs/sec: 780.58

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t8 -o2 -s600 -b512 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 2 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1561.38
MBs/sec: 780.69

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t8 -o4 -s600 -b512 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 4 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1561.37
MBs/sec: 780.68

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t8 -o8 -s600 -b512 -FE
:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 8 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1561.33
MBs/sec: 780.66

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t8 -o16 -s600 -b512 -F
E:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 600 secs to file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 16 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1561.35
MBs/sec: 780.67

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t8 -o32 -s120 -b512 -F
E:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 120 secs to file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 32 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1560.77
MBs/sec: 780.38

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t8 -o64 -s120 -b512 -F
E:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 120 secs to file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 64 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1561.13
MBs/sec: 780.56

C:\Users\>E:\sqlio.exe -BH -kW -fsequential -t8 -o128 -s120 -b512 — FE:\param.txt
sqlio v1.5.SG
parameter file used: E:\param.txt
file E:\testfile.dat with 8 threads (0-7) using mask 0x0 (0)
8 threads writing for 120 secs to file E:\testfile.dat
using 512KB sequential IOs
enabling multiple I/Os per thread with 128 outstanding
buffering set to use hardware disk cache (but not file cache)
using specified size: 102400 MB for file: E:\testfile.dat
initialization done
CUMULATIVE DATA:
throughput metrics:
IOs/sec: 1560.98
MBs/sec: 780.49

Well, the miracle did not happen, although we expected this from this device. If we compare it with the same IBM FlashSystem 820 that we had (I’m used to compare it with what we already had in our hands), the Dorado2100 G2 almost 2 times loses in many indicators. If you take into account the price of Dorado2100 G2, the purchase becomes unprofitable (if you want a 10-20TB storage system), however, if you need a small 2.5Tb storage for a small business, you should take a closer look at the Huawei OceanStor Dorado2100 G2 purchase.

As for the price, the recommended price for the 2.5Tb model is $ 75,000. Placing an order within a week from the date of this publication and specifying the keyword “Compiler” and get a discount of up to 20% (the amount of the discount will depend on the total cost of your order).

I want to remind you that you can take this storage system with us in Demo for testing, or we can provide a remote server configured for your needs and with Huawei OceanStor Dorado2100 G2 connected to it. For all questions about Huawei storage, please contact our head of the direction - Voronov Ivan .

By KorP

Source: https://habr.com/ru/post/213617/

All Articles

How we caught sea crucians, or review of Huawei OceanStor Dorado2100 G2

More articles: