Re: ncl_filedump problem in HDF5

From: Dennis Shea <shea_at_nyahnyahspammersnyahnyah>
Date: Tue Apr 20 2010 - 13:58:52 MDT

Soory for the delay, another %#*!&$ meeting ...

The CGD filesystem is accessible to both 32 & 64 bit boxes

ssh -Y tramhill.cgd.ucar.edu [64]
ssh -Y poorman.cgd.ucar.edu [32]

The file system is:

/project/cas/shea/HDF

D

On 04/20/2010 01:15 PM, Wei Huang wrote:
> Dennis,
>
> Can you inform me where these data are?
> (I can log on to those machines).
>
> Thanks,
>
> Wei Huang
> huangwei@ucar.edu
> VETS/CISL
> National Center for Atmospheric Research
> P.O. Box 3000 (1850 Table Mesa Dr.)
> Boulder, CO 80307-3000 USA
> (303) 497-8924
>
>
>
>
>
> On Apr 20, 2010, at 12:16 PM, Dennis Shea wrote:
>
>> On my MAC [Snow Leopard] I can read *ALL* the following files.
>>
>> [1] 1006012 Apr 20 11:52 MLS-Aura_L2GP-O3_v02-22-c01_2008d001.he5
>> [2] 595563 Apr 20 11:52 MLS-Aura_L2GP-IWC_v02-21-c02_2007d210.he5
>> [3] 1684127 Apr 20 11:52
>> MLS-Aura_L2GP-Temperature_v02-20-c01_2006d138.he5
>> [4] 1399868 Apr 20 11:52 MLS-Aura_L2GP-O3_v02-23-c01_2008d001.he5
>> [5] 653775 Apr 20 11:52 TES-Aura_L3-ATM-TEMP_r0000003459_F01_05.he5
>> [6] 188351 Apr 20 11:53
>> OMI-Aura_L3-OMAERUVd_2010m0131_v003-2010m0202t014811.he5
>>
>> %> ncl -V
>>
>> 5.2.0-01Apr2010_0235
>>
>> ====================================================================
>>
>> On CGD's 32-bit poorman
>>
>> %> uname -a
>>
>> Linux poorman.cgd.ucar.edu 2.6.18-164.15.1.el5.centos.plusPAE #1 SMP Wed
>> Mar 17 20:42:15 EDT 2010 i686 i686 i386 GNU/Linux
>>
>> %> ncl -V
>> 5.2.0
>>
>> I can read file [1]-to-[4] and [5]
>>
>> I can not read [5]
>>
>> ======================================================================
>> On CGD's 64-bit tramhill
>>
>> %> uname -a
>>
>> Linux tramhill.cgd.ucar.edu 2.6.18-164.11.1.el5.centos.plus #1 SMP Wed
>> Jan 20 18:49:35 EST 2010 x86_64 x86_64 x86_64 GNU/Linux
>>
>> %> ncl -V
>> 5.2.0
>>
>> I can read file [1]-to-[4]
>> I can not read [5] or [6]
>>
>> ===========================================================================
>>
>> HTH
>> D
>>
>>
>>
>>
>>
>> On 04/20/2010 11:40 AM, Mary Haley wrote:
>>> It's odd that it would be fine on your 64-bit Mac, but not a 64-bit
>>> Linux system.
>>>
>>> Wei, perhaps the HDF-EOS5 or HDF5 software needs to be built with
>>> certain options.
>>>
>>> Can you look into this and let me know, and I'll try building with these
>>> options.
>>> I just use whatever defaults the "configure" program selects.
>>>
>>> --Mary
>>>
>>> On Apr 20, 2010, at 11:37 AM, Dennis Shea wrote:
>>>
>>>> Hi Wei
>>>>
>>>> I think this may be a build issue.
>>>>
>>>> It failed on CGD's 64-bit tramhill.
>>>>
>>>> It ran successfully on CGD's 32-bit box (poorman).
>>>>
>>>> It ran successfully on my MAC running Snow Leopard.
>>>>
>>>> D
>>>>
>>>> On 4/20/10 11:23 AM, Wei Huang wrote:
>>>>> Dennis,
>>>>>
>>>>> I checked this dataset on my Mac, things looks good as below.
>>>>> Do you know what kind of computer user has, or you want me to contact
>>>>> the user?
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Wei Huang
>>>>> huangwei@ucar.edu
>>>>> VETS/CISL
>>>>> National Center for Atmospheric Research
>>>>> P.O. Box 3000 (1850 Table Mesa Dr.)
>>>>> Boulder, CO 80307-3000 USA
>>>>> (303) 497-8924
>>>>>
>>>>> ------------
>>>>> holywell-2:/Users/huangwei/myncl/hdf5_work/write_hdf5 121 >
>>>>> ncl_filedump
>>>>> OMI-Aura_L3-OMAERUVd_20 0m0101_v003-2010m0105t104044.he5
>>>>> Copyright (C) 1995-2010 - All Rights Reserved
>>>>> University Corporation for Atmospheric Research
>>>>> NCAR Command Language Version 5.2.0
>>>>> The use of this software is governed by a License Agreement.
>>>>> See http://www.ncl.ucar.edu/ for more details.
>>>>> Variable: f (file variable)
>>>>>
>>>>> filename: OMI-Aura_L3-OMAERUVd_2010m0101_v003-2010m0105t104044
>>>>> path: OMI-Aura_L3-OMAERUVd_2010m0101_v003-2010m0105t104044.he5
>>>>> file global attributes:
>>>>> Period_Aerosol_NearUV_Grid : Daily
>>>>> EndUTC_Aerosol_NearUV_Grid : 2010-01-02T11:45:00.000000Z
>>>>> StartUTC_Aerosol_NearUV_Grid : 2009-12-31T12:15:00.000000Z
>>>>> PGEVersion_Aerosol_NearUV_Grid : "0.9.50"
>>>>> TAI93At0zOfGranule_Aerosol_NearUV_Grid : 536457607
>>>>> GranuleDayOfYear_Aerosol_NearUV_Grid : 1
>>>>> GranuleYear_Aerosol_NearUV_Grid : 2010
>>>>> GranuleDay_Aerosol_NearUV_Grid : 1
>>>>> GranuleMonth_Aerosol_NearUV_Grid : 1
>>>>> ProcessLevel_Aerosol_NearUV_Grid : 3
>>>>> InstrumentName_Aerosol_NearUV_Grid : OMI
>>>>> OrbitPeriod_Aerosol_NearUV_Grid : <ARRAY of 45 elements>
>>>>> OrbitNumber_Aerosol_NearUV_Grid : <ARRAY of 45 elements>
>>>>> NumberOfLatitudesInGrid_Aerosol_NearUV_Grid : 180
>>>>> NumberOfLongitudesInGrid_Aerosol_NearUV_Grid : 360
>>>>> GridSpanUnit_Aerosol_NearUV_Grid : deg
>>>>> GridSpan_Aerosol_NearUV_Grid : (-180,180,-90,90)
>>>>> GridSpacingUnit_Aerosol_NearUV_Grid : deg
>>>>> GridSpacing_Aerosol_NearUV_Grid : (1.0,1.0)
>>>>> GridOrigin_Aerosol_NearUV_Grid : Center
>>>>> Projection_Aerosol_NearUV_Grid : Geographic
>>>>> GCTPProjectionCode_Aerosol_NearUV_Grid : 0
>>>>> dimensions:
>>>>> XDim_Aerosol_NearUV_Grid = 360
>>>>> YDim_Aerosol_NearUV_Grid = 180
>>>>> variables:
>>>>> double YDim_Aerosol_NearUV_Grid ( YDim_Aerosol_NearUV_Grid )
>>>>> projection : Geographic
>>>>> Units : deg
>>>>> long_name : latitude
>>>>> units : degrees_north
>>>>>
>>>>> double XDim_Aerosol_NearUV_Grid ( XDim_Aerosol_NearUV_Grid )
>>>>> projection : Geographic
>>>>> Units : deg
>>>>> long_name : longitude
>>>>> units : degrees_east
>>>>>
>>>>>
>>>>>
>>>>> On Apr 20, 2010, at 9:49 AM, Dennis Shea wrote:
>>>>>
>>>>>>
>>>>>>
>>>>>> FYI: This was sent to me off line.
>>>>>>
>>>>>> -------- Original Message --------
>>>>>> Subject: Re:Re: [ncl-talk] ncl_filedump problem in HDF5
>>>>>> Date: Tue, 20 Apr 2010 23:47:13 +0800 (CST)
>>>>>> From: eddycarl <eddycarl@126.com>
>>>>>> To: Dennis Shea <shea@ucar.edu>
>>>>>>
>>>>>>
>>>>>>
>>>>>> Well, can we fix this problem? Is it caused by NCL or the data file
>>>>>> format itself?
>>>>>> Thanks!
>>>>>>
>>>>>> Dennis Shea<shea@ucar.edu>£º
>>>>>>> This is a bug.
>>>>>>>
>>>>>>> Other OMI-Aura he5 files can be read. EG:
>>>>>>>
>>>>>>> %> ncl_filedump
>>>>>>> OMI-Aura_L3-OMTO3e_2009m0101_v003-2009m0223t121826.he5
>>>>>>>
>>>>>>> Copyright (C) 1995-2010 - All Rights Reserved
>>>>>>> University Corporation for Atmospheric Research
>>>>>>> NCAR Command Language Version 5.2.0
>>>>>>> The use of this software is governed by a License Agreement.
>>>>>>> See http://www.ncl.ucar.edu/ for more details.
>>>>>>> Variable: f (file variable)
>>>>>>>
>>>>>>> filename: OMI-Aura_L3-OMTO3e_2009m0101_v003-2009m0223t121826
>>>>>>> path: OMI-Aura_L3-OMTO3e_2009m0101_v003-2009m0223t121826.he5
>>>>>>> file global attributes:
>>>>>>> Period_OMI_Column_Amount_O3 : Daily
>>>>>>> EndUTC_OMI_Column_Amount_O3 : 2009-01-02T11:45:00.000000Z
>>>>>>> StartUTC_OMI_Column_Amount_O3 : 2008-12-31T12:15:01.000000Z
>>>>>>> PGEVersion_OMI_Column_Amount_O3 : "0.9.90"
>>>>>>> TAI93At0zOfGranule_OMI_Column_Amount_O3 : 504921607
>>>>>>> GranuleDayOfYear_OMI_Column_Amount_O3 : 1
>>>>>>> [SNIP]
>>>>>>>
>>>>>>> dimensions:
>>>>>>> XDim_OMI_Column_Amount_O3 = 1440
>>>>>>> YDim_OMI_Column_Amount_O3 = 720
>>>>>>> variables:
>>>>>>> double YDim_OMI_Column_Amount_O3 ( YDim_OMI_Column_Amount_O3 )
>>>>>>> projection : Geographic
>>>>>>> Units : deg long_name : latitude
>>>>>>> units : degrees_north
>>>>>>>
>>>>>>> double XDim_OMI_Column_Amount_O3 ( XDim_OMI_Column_Amount_O3 )
>>>>>>> projection : Geographic Units : deg
>>>>>>> long_name : longitude
>>>>>>> units : degrees_east
>>>>>>>
>>>>>>> float RadiativeCloudFraction_OMI_Column_Amount_O3 (
>>>>>>> YDim_OMI_Column_Amoun_O3, XDim_OMI_Column_Amount_O3 )
>>>>>>> MissingValue : -1.267651e+30
>>>>>>> ValidRange : 0
>>>>>>> Offset : 0
>>>>>>> ScaleFactor : 1
>>>>>>> UniqueFieldDefinition : TOMS-OMI-Shared
>>>>>>> Title : Radiative Cloud Fraction = fc*Ic331/Im331
>>>>>>>
>>>>>>> float ColumnAmountO3_OMI_Column_Amount_O3 (
>>>>>>> YDim_OMI_Column_Amount_O3, XDm_OMI_Column_Amount_O3 )
>>>>>>> MissingValue : -1.267651e+30
>>>>>>> ValidRange : 50
>>>>>>> Offset : 0
>>>>>>> ScaleFactor : 1
>>>>>>> UniqueFieldDefinition : TOMS-OMI-Shared
>>>>>>> Title : Best Total Ozone Solution
>>>>>>> units : DU
>>>>>>> Units : DU
>>>>>>> _FillValue : -1.267651e+30
>>>>>>> long_name : ColumnAmountO3
>>>>>>> projection : Geographic
>>>>>>>
>>>>>>> [SNIP]
>>>>>>>
>>>>>>>
>>>>>>> On 4/19/10 9:49 AM, eddycarl wrote:
>>>>>>>> Hi there,
>>>>>>>> I am trying to use ncl_filedump in NCL 5.2.0 to read HDF5 format
>>>>>>>> data,
>>>>>>>> but I got the following error. Anyone helps to solve it please?
>>>>>>>> Thanks!
>>>>>>>> The data used here is the OMI/Aura Near UV Aerosol Optical Depth
>>>>>>>> and
>>>>>>>> Single Scattering Albedo Daily L3 Global 1x1 deg Lat/Lon data.
>>>>>>>>
>>>>>>>> ****** error message ******
>>>>>>>>>> ncl_filedump
>>>>>>>> OMI-Aura_L3-OMAERUVd_2010m0101_v003-2010m0105t104044.he5
>>>>>>>> Copyright (C) 1995-2010 - All Rights Reserved
>>>>>>>> University Corporation for Atmospheric Research
>>>>>>>> NCAR Command Language Version 5.2.0
>>>>>>>> The use of this software is governed by a License Agreement.
>>>>>>>> See http://www.ncl.ucar.edu/ for more details.
>>>>>>>> HDF5-DIAG: Error detected in HDF5 (1.8.4-patch1) thread 0:
>>>>>>>> #000: GDapi.c line 897 in HE5_GDattach(): Grid:"Aerosol NearUV
>>>>>>>> Grid"
>>>>>>>> does not exist within HDF file.
>>>>>>>> major: Object header
>>>>>>>> minor: Object not found
>>>>>>>> #001: H5Gdeprec.c line 299 in H5Gopen1(): unable to open group
>>>>>>>> major: Symbol table
>>>>>>>> minor: Can't open object
>>>>>>>> #002: H5G.c line 947 in H5G_open_name(): group not found
>>>>>>>> major: Symbol table
>>>>>>>> &nbs p; minor: Object not found
>>>>>>>> #003: H5Gloc.c line 468 in H5G_loc_find(): can't find object
>>>>>>>> major: Symbol table
>>>>>>>> minor: Object not found
>>>>>>>> #004: H5Gtraverse.c line 877 in H5G_traverse(): internal path
>>>>>>>> traversal
>>>>>>>> failed
>>>>>>>> major: Symbol table
>>>>>>>> minor: Object not found
>>>>>>>> #005: H5Gtraverse.c line 703 in H5G_traverse_real(): traversal
>>>>>>>> operator
>>>>>>>> failed
>>>>>>>> major: Symbol table
>>>>>>>> minor: Callback failed
>>>>>>>> #006: H5Gloc.c line 423 in H5G_loc_find_cb(): object doesn't exist
>>>>>>>> major: Symbol table
>>>>>>>> minor: Object not found
>>>>>>>> fatal:NclHDFEOS5: An internal HDF error occurred while reading
>>>>>>>> (OMI-Aura_L3-OMAERUVd_2010m0101_v003-2010m0105t104044.he5) can't
>>>>>>>> continue
>>>>>>>> Variable: f (file variable)
>>>>>>>>
>>>>>>>> filename: OMI-Aura_L3-OMAERUVd_2010m0101_v003-2010m0105t104044
>>>>>>>> path: OMI-Aura_L3-OMAERUVd_2010m0101_v003-2010m0105t104044.he5
>>>>>>>> file global attributes:
>>>>>>>> dimensions:
>>>>>>>> variables:
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> ncl-talk mailing list
>>>>>>>> List instructions, subscriber options, unsubscribe:
>>>>>>>> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>>>>>>
>>>>>>
>>>>>>
>>
>>
>> --
>> ======================================================
>> Dennis J. Shea tel: 303-497-1361 |
>> P.O. Box 3000 fax: 303-497-1333 |
>> Climate Analysis Section |
>> Climate & Global Dynamics Div. |
>> National Center for Atmospheric Research |
>> Boulder, CO 80307 |
>> USA email: shea 'at' ucar.edu |
>> ======================================================

-- 
======================================================
Dennis J. Shea                  tel: 303-497-1361    |
P.O. Box 3000                   fax: 303-497-1333    |
Climate Analysis Section                             |
Climate & Global Dynamics Div.                       |
National Center for Atmospheric Research             |
Boulder, CO  80307                                   |
USA                        email: shea 'at' ucar.edu |
======================================================
Received on Tue Apr 20 13:58:54 2010

This archive was generated by hypermail 2.1.8 : Fri Apr 23 2010 - 14:40:07 MDT