Re: problem reading multiple netcdf files in ncl v 5.1.0

From: David Brown <dbrown_at_nyahnyahspammersnyahnyah>
Date: Fri, 15 May 2009 15:02:58 -0600

Hi Dave,

The original message that Jamie sent contained an attachment that
exceeded the size limits set for the
mailing list. That is why it was 'lost'.

We believe we have fixed the addfiles bug that Erik reported and it
will be part of a new bug-fix release
that should be ready in a week or so.

The bug Erik reported related to non-unity strides along the
aggregated dimension. Jamie's situation seems
to be different, but perhaps it is related. We will analyze it and
make sure that it is resolved before the new
release.
  -dave

On May 15, 2009, at 2:51 PM, Dave Allured wrote:

> I think this may be the same "addfiles" bug in NCL v5.1.0 that was
> reported by Erik Noble on April 27. According to the NCAR reply,
> "It's a pretty significant bug" and "we are currently fixing".
>
> http://www.ncl.ucar.edu/Support/talk_archives/2009/0809.html
>
> There is a lost ncl-talk message from this morning. I had the
> chance to see Jamie's original symptoms from internal
> correspondence. Originally there were messages like the following
> related to use of the time dimension, after addfiles. This is very
> similar to what Erik reported.
>
> :ncid 31: NetCDF: Index exceeds dimension bound
> ncvargets: ncid 31: NetCDF: Index exceeds dimension bound
> ncvargets: ncid 31: NetCDF: Index exceeds dimension bound
> ncvargets: ncid 31: NetCDF: Index exceeds dimension bound
> etc.
>
> How is work on the original addfiles bug coming along?
>
> Dave Allured
> CU/CIRES Climate Diagnostics Center (CDC)
> http://cires.colorado.edu/science/centers/cdc/
> NOAA/ESRL/PSD, Climate Analysis Branch (CAB)
> http://www.cdc.noaa.gov/psd1/
>
> Jamie Scott wrote:
>> Sorry, I spoke too soon. Changing the ListSetType from "join" to
>> "cat"
>> allows me to read in the first 30 files, but I get a new error when
>> trying to read in the next 30. Again, this script runs fine on
>> ncl 5.0.1, but does not work on ncl 5.1.0. Looks like it's having
>> trouble cleaning up the netCDF file connections....
>>
>> -Jamie
>>
>> modified script:
>>
>>
>>
>> output from ncl:
>>
>> [mac23:/Projects/Air_Sea/jscott] jscott% $NCARG_ROOT/bin/ncl
>> /home/jscott/ncl/WBC/hires.winds.4xd2.mon.mean.ncl
>> Copyright (C) 1995-2009 - All Rights Reserved
>> University Corporation for Atmospheric Research
>> NCAR Command Language Version 5.1.0
>> The use of this software is governed by a License Agreement.
>> See http://www.ncl.ucar.edu/ for more details.
>>
>>
>> Variable: innames
>> Type: string
>> Total Size: 124 bytes
>> 31 values
>> Number of Dimensions: 1
>> Dimensions and sizes: [31]
>> Coordinates:
>> (0) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871001.nc
>> (1) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871002.nc
>> (2) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871003.nc
>> (3) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871004.nc
>> (4) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871005.nc
>> (5) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871006.nc
>> (6) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871007.nc
>> (7) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871008.nc
>> (8) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871009.nc
>> (9) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871010.nc
>> (10) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871011.nc
>> (11) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871012.nc
>> (12) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871013.nc
>> (13) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871014.nc
>> (14) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871015.nc
>> (15) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871016.nc
>> (16) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871017.nc
>> (17) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871018.nc
>> (18) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871019.nc
>> (19) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871020.nc
>> (20) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871021.nc
>> (21) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871022.nc
>> (22) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871023.nc
>> (23) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871024.nc
>> (24) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871025.nc
>> (25) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871026.nc
>> (26) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871027.nc
>> (27) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871028.nc
>> (28) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871029.nc
>> (29) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871030.nc
>> (30) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871031.nc
>> (0)
>> (0) Sea Surface Wind: x-component: min=-46.5873 max=37.9598
>> (0)
>> (0) Sea Surface Wind: y-component: min=-44.5245 max=37.7156
>> (0) 1987 9-------------------------
>> (0)
>> (0) wind speed: min=0 max=29.6
>> (0) Month: 9 Year:1987
>>
>>
>> Variable: innames
>> Type: string
>> Total Size: 120 bytes
>> 30 values
>> Number of Dimensions: 1
>> Dimensions and sizes: [30]
>> Coordinates:
>> (0) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871101.nc
>> (1) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871102.nc
>> (2) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871103.nc
>> (3) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871104.nc
>> (4) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871105.nc
>> (5) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871106.nc
>> (6) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871107.nc
>> (7) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871108.nc
>> (8) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871109.nc
>> (9) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871110.nc
>> (10) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871111.nc
>> (11) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871112.nc
>> (12) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871113.nc
>> (13) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871114.nc
>> (14) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871115.nc
>> (15) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871116.nc
>> (16) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871117.nc
>> (17) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871118.nc
>> (18) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871119.nc
>> (19) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871120.nc
>> (20) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871121.nc
>> (21) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871122.nc
>> (22) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871123.nc
>> (23) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871124.nc
>> (24) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871125.nc
>> (25) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871126.nc
>> (26) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871127.nc
>> (27) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871128.nc
>> (28) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871129.nc
>> (29) /Projects/Air_Sea/jscott/noaa.highres/SeaWinds/uv19871130.nc
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> add_connect: too many connects, cannot add another
>> ncinquire: ncid -1: NetCDF: Not a valid ID
>> fatal:No valid instance of variable u found in file list
>> fatal:Execute: Error occurred at or near line 53 in file
>> /home/jscott/ncl/WBC/hires.winds.4xd2.mon.mean.ncl
>>
>> [mac23:/Projects/Air_Sea/jscott] jscott%
>> On May 15, 2009, at 10:57 AM, Jamie Scott wrote:
>>
>>> I've been testing ncl version 5.1.0 on Mac 0SX 10.5.6 (Darwin Kernel
>>> Version 9.6.0: Mon Nov 24 17:39:01 PST 2008;
>>> root:xnu-1228.9.59~1/RELEASE_PPC)
>>> and discovered a problem reading multple netcdf files. This code
>>> works fine on the same machine in ncl v 5.0.1.
>>>
>>> Here is a portion the output from v 5.1.0 (the rest is attached
>>> in a
>>> file called '5.1.0.err.msg'. (very long!)) :
>>>
>>
>>
>> ---------------------------------------------------------------------
>> ---
>>
>> _______________________________________________
>> ncl-talk mailing list
>> List instructions, subscriber options, unsubscribe:
>> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
> _______________________________________________
> ncl-talk mailing list
> List instructions, subscriber options, unsubscribe:
> http://mailman.ucar.edu/mailman/listinfo/ncl-talk

_______________________________________________
ncl-talk mailing list
List instructions, subscriber options, unsubscribe:
http://mailman.ucar.edu/mailman/listinfo/ncl-talk
Received on Fri May 15 2009 - 15:02:58 MDT

This archive was generated by hypermail 2.2.0 : Tue May 19 2009 - 09:17:29 MDT