We need to test the private interconnect network bandwidth to make sure that it will accommodate our RAC cache fusion workload. Majority of the companies leverage their existing network switches and provide a separate non-routable private VLAN available to only the members of the cluster.

For this particular example, we are testing the bandwidth with 1M and 4M input and output block sizes.

cat scp_performance.ksh
echo == 1M files x 100
dd if=/dev/zero bs=1M count=100 |ssh rhel59dra-priv dd of=/dev/null
echo == 1M files x 1000
dd if=/dev/zero bs=1M count=1000 |ssh rhel59dra-priv dd of=/dev/null

echo == 4M files x 100
dd if=/dev/zero bs=4M count=100 |ssh rhel59dra-priv dd of=/dev/null
echo == 10M files x 100
dd if=/dev/zero bs=10M count=100 |ssh rhel59dra-priv dd of=/dev/null
echo == 100M files x 100
dd if=/dev/zero bs=100M count=100 |ssh rhel59dra-priv dd of=/dev/null

Here a sample output from executing this simple shell script:

$ ./scp_performance.ksh
== 1M files x 100
100+0 records in
100+0 records out
104857600 bytes (105 MB) copied, 1.99392 seconds, 52.6 MB/s
200671+10061 records in
204800+0 records out
104857600 bytes (105 MB) copied, 1.89443 seconds, 55.4 MB/s
== 1M files x 1000
1000+0 records in
1000+0 records out
1048576000 bytes (1.0 GB) copied, 18.505 seconds, 56.7 MB/s
2012814+89686 records in
2048000+0 records out
1048576000 bytes (1.0 GB) copied, 18.4261 seconds, 56.9 MB/s
== 4M files x 100
100+0 records in
100+0 records out
419430400 bytes (419 MB) copied, 7.16756 seconds, 58.5 MB/s
806277+34772 records in
819200+0 records out
419430400 bytes (419 MB) copied, 7.09103 seconds, 59.1 MB/s
== 10M files x 100
100+0 records in
100+0 records out
1048576000 bytes (1.0 GB) copied, 17.959 seconds, 58.4 MB/s
2016332+86632 records in
2048000+0 records out
1048576000 bytes (1.0 GB) copied, 17.9087 seconds, 58.6 MB/s
== 100M files x 100
100+0 records in
100+0 records out
10485760000 bytes (10 GB) copied, 183.415 seconds, 57.2 MB/s
20145249+862669 records in
20480000+0 records out
10485760000 bytes (10 GB) copied, 183.329 seconds, 57.2 MB/s
Posted in RAC
Share this post, let the world know

Comments are closed