Tuesday, 3 January 2017

ZFS ESXi NFS Throughput 30x Faster with Sync Disabled


Server:
N54L, 8GB, RAIDZ1, FreeNAS9.10




  • With Sync as default from FreeNAS


-----------------------------------------------------------------------
CrystalDiskMark 5.2.1 x64 (C) 2007-2017 hiyohiyo
                           Crystal Dew World : http://crystalmark.info/
-----------------------------------------------------------------------
* MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
* KB = 1000 bytes, KiB = 1024 bytes

   Sequential Read (Q= 32,T= 1) :   112.327 MB/s
  Sequential Write (Q= 32,T= 1) :     3.696 MB/s
  Random Read 4KiB (Q= 32,T= 1) :   103.251 MB/s [ 25207.8 IOPS]
 Random Write 4KiB (Q= 32,T= 1) :     0.260 MB/s [    63.5 IOPS]
         Sequential Read (T= 1) :   108.227 MB/s
        Sequential Write (T= 1) :     2.097 MB/s
   Random Read 4KiB (Q= 1,T= 1) :    17.435 MB/s [  4256.6 IOPS]
  Random Write 4KiB (Q= 1,T= 1) :     0.113 MB/s [    27.6 IOPS]

  Test : 1024 MiB [C: 44.7% (17.8/39.9 GiB)] (x5)  [Interval=5 sec]
  Date : 2017/01/03 18:18:14
    OS : Windows Server 2008 R2 Enterprise (Full installation) SP1 [6.1 Build 7601] (x64)
 


  • With Sync=disabled

-----------------------------------------------------------------------
CrystalDiskMark 5.2.1 x64 (C) 2007-2017 hiyohiyo
                           Crystal Dew World : http://crystalmark.info/
-----------------------------------------------------------------------
* MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
* KB = 1000 bytes, KiB = 1024 bytes

   Sequential Read (Q= 32,T= 1) :   114.655 MB/s
  Sequential Write (Q= 32,T= 1) :   115.551 MB/s
  Random Read 4KiB (Q= 32,T= 1) :   103.717 MB/s [ 25321.5 IOPS]
 Random Write 4KiB (Q= 32,T= 1) :    10.037 MB/s [  2450.4 IOPS]
         Sequential Read (T= 1) :   108.637 MB/s
        Sequential Write (T= 1) :   107.385 MB/s
   Random Read 4KiB (Q= 1,T= 1) :    17.580 MB/s [  4292.0 IOPS]
  Random Write 4KiB (Q= 1,T= 1) :     9.360 MB/s [  2285.2 IOPS]

  Test : 1024 MiB [C: 44.7% (17.8/39.9 GiB)] (x5)  [Interval=5 sec]
  Date : 2017/01/03 18:27:55
    OS : Windows Server 2008 R2 Enterprise (Full installation) SP1 [6.1 Build 7601] (x64)