Re: writing large files

D,
I get 4*365*231*180*360 = 21.85GB

My script *does* contain a remove before trying to write this file.

I am, however, able to write out a variable thats of size:
4*365*33*180*360 = 1.97GB,
in agreement with your 1st explanation.

G

On 7/6/10 4:02 PM, Dennis Shea wrote:
> On 2nd look:
>
> MB = 4*365*231*180*360 => 360 MB
>
> There should be *no problem* writing this out.
>
> I speculate that you tried a version of the script and after
> creating a reference to the file, it failed for some reason.
>
> Many systems have the NC_CLOBBER set such that it will not aloow
> a file to be overwritten if it already exits.
>
> http://www.ipp.mpg.de/~dpc/netcdf_guide/guide_38.html
>
> As noted at
>
> http://www.ncl.ucar.edu/Applications/o-netcdf.shtml
>
> It is recommended to remove any preexisting file:
>
> diro = "./"
> filo = "simple.nc"
> patho= diro+filo
>
> system("/bin/rm -f "+patho) ; remove any pre-existing file
> ncdf = addfile(patho ,"c") ; open output netCDF file
>
>
> D
>
>
> On 7/6/10 3:44 PM, Dennis Shea wrote:
>> NCL will write *files*> 2GB.
>>
>> However, current versions of NCL only allow *variables*
>> of 2GB or less due to 32-bit addressing.
>>
>> NCL version 6.0.0 is targeted to allow 64-bit addressing.
>> This will allow variables> 2GB.
>>
>> Punch line: your one variable is> 2GB
>>
>> D
>>
>> On 7/6/10 3:35 PM, Gary Bates wrote:
>>> hi,
>>>
>>> I'm running NCL 5.1.1 and would like to write a large file that contains
>>> 1 variable. Ideally, the dimensions of this variable would be 365 x 231
>>> x 180 x 360. I figure this would produce a file of about 22GB.
>>>
>>> Thus far, I've been unable to write a file larger than 2GB --- same
>>> result on a Linux machine or a Mac. I've tried:
>>>
>>> setfileoption("nc","Format","64BitOffset")
>>> setfileoption("nc","Format","LargeFile")
>>> setfileoption("nc","Format","NetCDF4Classic")
>>>
>>> All give same result. Is there something else I need to do to write a
>>> large file?
>>>
>>> Thanks,
>>> Gary Bates
>>> _______________________________________________
>>> ncl-talk mailing list
>>> List instructions, subscriber options, unsubscribe:
>>> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>> _______________________________________________
>> ncl-talk mailing list
>> List instructions, subscriber options, unsubscribe:
>> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
_______________________________________________
ncl-talk mailing list
List instructions, subscriber options, unsubscribe:
http://mailman.ucar.edu/mailman/listinfo/ncl-talk
Received on Tue Jul 6 16:11:12 2010