Re: problem accessing multiple files using fbinread

From: David Brown <dbrown_at_nyahnyahspammersnyahnyah>
Date: Fri, 13 Feb 2009 13:29:33 -0700

Hi Sam,

You need to use the following incantation in your script prior to
opening any files:



Your system has a limit of 1024 open file descriptors, and
subtracting several descriptors that
NCL opens internally for the life of its execution, you are left with
around 1020 files that can
be simultaneously opened. SuppressClose defaults to True because it
improves performance
particularly when writing files, but it does need to be modified when
you have many files to open
at once.

On Feb 13, 2009, at 12:11 PM, Sam Iacobellis wrote:

> Hi,
> I'm trying to run a simple NCL script that reads data using the
> fbinread
> function. I need to access quite a few individual files, around
> 1200 or
> so, each file for a different day of data. After reading about 1020
> files, the run stops and I get an error saying that fbinread could not
> open the file.
> The problem seems not to be with the individual file, but rather
> that it
> is the 1020th file that the script has tried to access. I've
> reordered
> the loop so that the files are accessed in a different order and
> the same
> problem happens for the 1020th file.
> My guess is that the files remain open after I read the data and
> there is
> a limit to the amount of open files. Is there a way to close the file
> after I am finished reading the data?
> Has anyone else come across this problem? I looked through the
> archives,
> but could not find any related information.
> Thanks for any help.
> Sam.
> _______________________________________________
> ncl-talk mailing list
> List instructions, subscriber options, unsubscribe:

ncl-talk mailing list
List instructions, subscriber options, unsubscribe:
Received on Fri Feb 13 2009 - 13:29:33 MST

This archive was generated by hypermail 2.2.0 : Thu Feb 19 2009 - 09:54:51 MST