spins2netcdf

A tool for converting SPINS binary outputs into NetCDF files is available from spins2netcdf. The netCDF files are then easily read and visualized within ParaView and VisIt.

Installing

Installation on local MFCF-administered machines (hood, bow, minnewanka, waterton):

• it's already installed for you
  • hood: standard search rules will already have it (/software/spinstools/bin/spins2netcdf)
  • bow, minnewanka, waterton: /usr/local/spinstools/bin/spins2netcdf

Installation on SHARCNET systems (Orca):

$ module load cmake/3.7.2 netcdf/4.3.2 boost/intel12-openmpi162/1.55.0
$ git clone https://git.sharcnet.ca/DP/spins-tools.git
$ cd spins-tools
$ mkdir build
$ cd build
$ cmake -DCMAKE_INSTALL_PREFIX=~ \
  -DNETCDF_INCLUDE_DIR=/opt/sharcnet/netcdf/4.3.2/include \
  -DNETCDF_LIBRARY=/opt/sharcnet/netcdf/4.3.2/lib/libnetcdf.so ..
$ make install

Installation on national platforms (Graham/Cedar) by creating a local copy:

$ module load boost/1.60.0 netcdf/4.4.1.1 netcdf-c++4-mpi
$ git clone https://git.sharcnet.ca/DP/spins-tools.git
$ cd spins-tools
$ mkdir build
$ cd build
$ cmake -DCMAKE_INSTALL_PREFIX=~ \
  -DNETCDF_INCLUDE_DIR=/cvmfs/soft.computecanada.ca/easybuild/software/2017/avx2/MPI/intel2016.4/openmpi2.1/netcdf-mpi/4.4.1.1/include \
 -DNETCDF_LIBRARY=/cvmfs/soft.computecanada.ca/easybuild/software/2017/avx2/MPI/intel2016.4/openmpi2.1/netcdf-mpi/4.4.1.1/lib64/libnetcdf.so \
  -DNETCDF_CXX_INCLUDE_DIR=/cvmfs/soft.computecanada.ca/easybuild/software/2017/avx2/MPI/intel2016.4/openmpi2.1/netcdf-c++4-mpi/4.3.0/include \
  -DNETCDF_CXX_LIBRARY=/cvmfs/soft.computecanada.ca/easybuild/software/2017/avx2/MPI/intel2016.4/openmpi2.1/netcdf-c++4-mpi/4.3.0/lib/libnetcdf_c++4.so ..
$ make install

or Installation on national platforms (Graham/Cedar) using nix:

Note: If nix is used to install spins2netcdf, the nix module must be loaded to enable the use of that package. If nix is not loaded, then spins2netcdf will not be available since it is wrapped up with nix.

$ module load boost/1.60.0 netcdf/4.4.1.1 netcdf-c++4-mpi
$ git clone https://git.sharcnet.ca/DP/spins-tools.git
$ cd spins-tools
$ git pull
$ module load nix
$ nix-env -if spins-tools.nix

Installation on a local machine can be done by following the steps in INSTALL.txt.

Requirements and Usage

spins2netcdf requires a spins.conf in the directory storing the data files to be converted. The current version of SPINS has case files which already uses a spins.conf which satisfies this requirement. Explicitly, the spins.conf requires the following information:

• Nx, Ny, Nz
• Lx, Ly, Lz
• type_x, type_y, type_z
• plot_interval
• mapped_grid (default is false)

On Graham and Orca the module load command presented above in the installation must always be run before running spins2netcdf. To remember this (or rather have it automatically done for you) place the module load command in your .bashrc file. This way it is always run when you log in.

If running on Graham, the login nodes do not have sufficient memory for most jobs so you must log into a compute node with the salloc command. It is suggested to request 4 tasks (cpus) to use make use of the weak parallelization of spins2netcdf.

spins2netcdf collects files of a common suffix (eg. *.0) into a single netcdf file (output_0.nc). To do this for all files and all output indices use,

$ spins2netcdf

If the grid is mapped, then an additional field (zc) is saved as the correct vertical coordinates. When the netcdf file is initially loaded by Paraview or Visit, it will be plotted on a rectilinear grid and will require adjustment onto this new field. See Visualization for details.

Options

A variety of options are available which give further control over the use of spins2netcdf. The most important are:

-f [ --input-fields ]

Sets the fields to be included in the netcdf file

Useful for only selecting a few fields from many

Usage: -frho -fu etc. (place field name immediately after -f)

-i [ --input-indices ]

Sets the indices to be converted

Useful for only converting those outputs that are needed

Usage: -i0 -i5 etc. (place index immediately after -i)

-n [ --num-threads ]

Sets the number of threads to use in conversion

Large files will take a very long time to be read and converted, multiple threads helps to parallelize this

usage: -n 4

spins2netcdf is not efficiently parallelized, so 4 processors is a suggested value

Others can be seen by running spins2netcdf -h . Do not use the mem-map option! It is approximately 5 times slower than the default. The fastest conversion is accomplished with the -k command which does not swap axes into the preferred orientation (z,y,x), but leaves them in the spins format (y,z,x). This results in plots being rotated by 90 degrees in VisIt and ParaView with incorrectly labeled axes. Only use the -k option if you need the additional speedup in conversion and are ok with the extra work of rotating plots in your visualization software.