Re: Question about wkSpaceTime

From: Dennis Shea <shea_at_nyahnyahspammersnyahnyah>
Date: Thu Nov 14 2013 - 11:53:43 MST

Winston,

FYI: I tried to download the files but I ran out of space
on my download partition. Subsequently, the ftp 'timed out'

I was going to suggest that you use the netCDF operator 'ncrcat'
to extract the variables you want and create a single file
or a small set of files to hold the data. It would look like

%> ncrcat -v var1,var2,.. g30e017.geosgcm_surf*nc4
G30E017.GEOSGCM_SURF.198406-??????.nc4

Unfortunately, 'ncrcat' requires that the 'time'
dimension be classified as "UNLIMITED" and the 'time'
on your files is not classified as such.

ncdump -v time

etcdf g30e017.geosgcm_surf.19850211_0730z {
dimensions:
         lon = 288 ;
         lat = 181 ;
         time = 1 ;
variables:
         int time(time) ;
                 time:long_name = "time" ;
                 time:units = "minutes since 1985-02-11 07:30:00" ;
                 time:time_increment = 30000 ;
                 time:begin_date = 19850211 ;
                 time:begin_time = 73000 ;

In NCL, you can use 'addfiles' but it would likely be more efficient
if a separate file was created.
===
Note: I ran successfully ran the code for ndaywin=96,120,196
on a data set that spanned 1979-2011

Cheers

On 11/13/2013 04:17 PM, Wei Huang wrote:
> For handling NetCDF4 files, you may also check this:
>
> http://www.ncl.ucar.edu/Support/talk_archives/2013/1995.html
>
> Wei
>
> huangwei@ucar.edu
> VETS/CISL
> National Center for Atmospheric Research
> P.O. Box 3000 (1850 Table Mesa Dr.)
> Boulder, CO 80307-3000 USA
> (303) 497-8924
>
>
>
>
>
>
> On Nov 13, 2013, at 3:49 PM, Dennis Shea <shea@ucar.edu> wrote:
>
>> The 'too many files' (~1200) is, I think, a system issue.
>>
>> Note the FAQ # 26 under: File input/output
>>
>> http://www.ncl.ucar.edu/FAQ/
>> ===================================
>> FAQ: I'm running into a problem when opening lots of files with
>> addfile or addfiles ("Too many files open").
>>
>> If you need to open lots of files with addfiles, then call
>> setfileoption as follows, before you call addfiles:
>>
>> setfileoption("nc", "SuppressClose", False)
>>
>> The number of files you can have open at any time is dependent on
>> your system. A general limit seems to be around 1024.
>> ==========================================
>>
>> Let ncl-talk know if this solves your issue.
>>
>> D
>>
>>
>>
>> On 11/13/13 10:23 AM, Winston C. Chao wrote:
>>> Dear Sir,
>>>
>>> I am using the NCL function
>>> wkSpaceTime
>>>
>>> If I set the parameters:
>>> nDayWin = 96 ; Wheeler-Kiladis [WK] temporal window length (days)
>>> spd = 8 ; samples per day
>>>
>>> such that their product (the total number of files used) is greater than
>>> 1200, the function does not work. It works well
>>> if their product is lower than 960.
>>>
>>> Any idea about what needs to be done if the product is greater than 1200?
>>>
>>> I have put my files in our anonymous ftp site and they can be accessed by
>>> "ftp dirac.gsfc.nasa.gov" and then "cd pub/ecu/g30e017plots"
>>>
>>> The filename of the run script is model.ncl.test
>>>
>>> You can test it with
>>> nDayWin = 96 (it should work)
>>> and then with
>>>
>>> nDayWin = 196 (it will fail)
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Winston Chao
>>> _______________________________________________
>>> ncl-talk mailing list
>>> List instructions, subscriber options, unsubscribe:
>>> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>>>
>> _______________________________________________
>> ncl-talk mailing list
>> List instructions, subscriber options, unsubscribe:
>> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>

_______________________________________________
ncl-talk mailing list
List instructions, subscriber options, unsubscribe:
http://mailman.ucar.edu/mailman/listinfo/ncl-talk
Received on Thu Nov 14 11:53:50 2013

This archive was generated by hypermail 2.1.8 : Fri Nov 22 2013 - 09:36:32 MST