ESMF regrid problem

From: Will Hobbs <Will.Hobbs_at_nyahnyahspammersnyahnyah>
Date: Tue Jul 08 2014 - 00:40:35 MDT

Mary et al,

I am having problems running out of memory using the ESMF_regrid function. The problem is basically the same as reported last year by a user on March 19th, (Mary's reply is copied below), but I'm just checking to see if there was a resolution?

Many thanks

Will


From: Mary Haley <haley_at_nyahnyahspammersnyahnyah<mailto:haley_at_nyahnyahspammersnyahnyah?Subject=Re:%20ESMF%20regrid>>
Date: Tue Mar 19 2013 - 08:05:06 MDT

Hi Noel,

I see what the problem is, and I'm not sure yet how to fix it.

The issue is in order to do ESMF regridding, we need to write an intermediate NetCDF SCRIP file. This file will have two double variables of size grid_size, which is equal to nlat * nlon.

In your case:

   nlat/nlon = 16,800/43,200
   grid_size = nlat*lon = 725760000
   variable to be written to the file = 725760000*8 = 5,806,080,000 bytes

This is > 4 GB. This violates a NetCDF constraint that individual variables be less than 4 GB.

My first thought is that if you can create a NetCDF-4 file, then you won't be limited by this constraint. The problem is that the ESMF regridding tool we use appears to have a constraint that the intermediate NetCDF files be NetCDF-3 (classic or 64-bit offset) files, and not NetCDF-4.

I will check into this and get back to you.

--Mary


_______________________________________________
ncl-talk mailing list
List instructions, subscriber options, unsubscribe:
http://mailman.ucar.edu/mailman/listinfo/ncl-talk


Received on Tue Jul 08 06:41:00 2014

This archive was generated by hypermail 2.1.8 : Wed Jul 23 2014 - 15:33:46 MDT