Shuffle filter for Netcdf-4 compression

From: Dave Allured - NOAA Affiliate <dave.allured_at_nyahnyahspammersnyahnyah>
Date: Thu Dec 20 2012 - 17:12:34 MST

NCL team,

Could you please add a setfileoption to enable the HDF5 built-in
shuffle filter? As explained in HDF5 docs, this is a companion to
other compression filters. It seems like the code for this on/off
filter setting should be simple. In the Netcdf C API, this is simply
a separate argument in the deflate function call, so you don't need
any fancy access into the HDF layer. Thanks.

http://www.unidata.ucar.edu/software/netcdf/docs/netcdf-c.html#nc_005fdef_005fvar_005fdeflate

HDF5: "When the shuffle filter is applied to a dataset immediately
prior to the use of a compression filter, the compression ratio
achieved is often superior to that achieved by the use of a
compression filter without the shuffle filter."

http://www.hdfgroup.org/HDF5/doc/RM/RM_H5P.html#Property-SetShuffle

--Dave
_______________________________________________
ncl-talk mailing list
List instructions, subscriber options, unsubscribe:
http://mailman.ucar.edu/mailman/listinfo/ncl-talk
Received on Thu Dec 20 17:12:47 2012

This archive was generated by hypermail 2.1.8 : Fri Dec 21 2012 - 10:43:23 MST