Re: Is there an easy way to read...

This is a lot like example "asc3.txt" on the "Read ASCII" example
page. Read the whole file as lines of text, as shown. Use array
expressions, the IND function, and vector subscripting to get only
the data lines:

   filename = "asc3.txt"
   raw_data = asciiread (filename,-1,"string")
   mask_header = (str_get_cols (raw_data, 0, 0) .eq. '#')
   mask_coords = (str_get_cols (raw_data, 21, 28) .eq. 'LATITUDE')
   mask_data = .not. (mask_header .or. mask_coords)
   data = raw_data(ind (mask_data))

Then use str_get_cols as shown in the example, to read the columns
that you want.

--Dave

On 3/25/2011 1:27 PM, Gerald Creager wrote:
> an ascii file with this format:
>
> #YY MM DD hh mm I Bin Depth Dir Speed ErrVL VerVL %Good3 %Good4
> %GoodE EI1 EI2 EI3 EI4 CM1 CM2 CM3 CM4 Flags
> #yr mo dy hr mn - - m degT cm/s cm/s cm/s % % % - - - - - - - - -
> 2010 06 01 00 06 0 0 LATITUDE: 27.55 LONGITUDE: -92.49
> PROFILE_STATUS: 3
> 2010 06 01 00 06 0 1 51.0 249 15.5 -1.0 -2.0 99 99 99 208 197 197
> 203 MM MM MM MM 333393330
> 2010 06 01 00 06 0 2 67.0 270 10.0 -0.5 -1.0 99 99 99 185 177 176
> 184 MM MM MM MM 333393330
> 2010 06 01 00 06 0 3 83.0 204 4.9 2.0 1.0 99 99 99 188 191 178 213
> MM MM MM MM 333393330
> 2010 06 01 00 06 0 4 99.0 261 9.6 -0.5 -0.5 99 99 99 171 213 150 186
> MM MM MM MM 333393330
> 2010 06 01 00 06 0 5 115.0 213 8.3 1.5 -0.5 99 99 99 161 197 135 199
> MM MM MM MM 333393330
> 2010 06 01 00 06 0 6 131.0 249 9.7 -0.5 -1.5 99 99 99 147 165 131
> 183 MM MM MM MM 333393330
> 2010 06 01 00 06 0 7 147.0 279 10.1 0.0 -3.0 99 99 99 137 129 128
> 185 MM MM MM MM 333393330
> 2010 06 01 00 06 0 8 163.0 270 10.5 -1.0 -2.0 99 99 99 129 120 124
> 148 MM MM MM MM 333393330
> 2010 06 01 00 06 0 9 179.0 255 5.7 1.5 -2.0 99 99 99 126 116 117 176
> MM MM MM MM 333393330
> 2010 06 01 00 06 0 10 195.0 242 8.5 2.0 -1.5 99 99 99 124 114 113
> 181 MM MM MM MM 333393330
> 2010 06 01 00 06 0 11 211.0 259 10.2 2.0 -1.5 99 99 99 126 114 115
> 181 MM MM MM MM 333393330
> 2010 06 01 00 06 0 12 227.0 266 7.0 1.5 -3.0 99 99 99 123 115 119
> 158 MM MM MM MM 333393330
> 2010 06 01 00 06 0 13 243.0 299 5.1 2.5 -3.5 99 99 99 116 112 107
> 144 MM MM MM MM 333393330
> 2010 06 01 00 06 0 14 259.0 305 10.4 0.5 -2.0 99 99 99 113 106 101
> 136 MM MM MM MM 333393330
> 2010 06 01 00 06 0 15 275.0 300 12.1 1.5 -2.0 99 99 99 110 99 98 114
> MM MM MM MM 333393330
> 2010 06 01 00 06 0 16 291.0 305 10.4 2.0 -1.5 99 99 99 108 97 95 122
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 17 307.0 319 5.3 1.5 -1.0 99 99 99 99 93 93 118
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 18 323.0 279 6.6 0.0 -0.5 99 99 99 101 88 91 103
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 19 339.0 248 5.4 1.0 0.0 99 99 99 106 86 96 117
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 20 355.0 278 7.6 0.5 0.0 99 99 99 104 86 97 109
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 21 371.0 295 11.6 0.0 0.5 99 99 99 103 88 91 104
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 22 387.0 305 12.2 0.0 0.0 99 99 99 98 87 87 102
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 23 403.0 296 13.9 0.0 0.0 99 99 99 98 85 87 96 MM
> MM MM MM 333393333
> 2010 06 01 00 06 0 24 419.0 282 11.8 0.0 -1.5 99 99 99 100 87 87 96
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 25 435.0 288 11.1 -0.5 -1.5 99 99 99 102 88 90 96
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 26 451.0 290 5.9 -0.5 0.0 99 99 99 95 85 85 90 MM
> MM MM MM 333393333
> 2010 06 01 00 06 0 27 467.0 295 7.2 -1.0 -0.5 99 99 99 92 83 81 90
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 28 483.0 288 9.5 0.0 0.5 99 99 99 91 80 81 88 MM
> MM MM MM 333393333
> 2010 06 01 00 06 0 29 499.0 283 6.7 -1.0 -0.5 99 99 99 88 78 77 85
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 30 515.0 259 7.6 0.0 0.0 99 99 99 85 72 73 79 MM
> MM MM MM 333393333
> 2010 06 01 00 06 0 31 531.0 270 5.0 -0.5 -0.5 99 99 99 79 68 71 73
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 32 547.0 278 7.1 0.0 -0.5 99 99 99 74 62 63 69 MM
> MM MM MM 333393333
> 2010 06 01 00 06 0 33 563.0 277 12.1 0.0 -0.5 99 99 99 74 57 58 64
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 34 579.0 281 12.7 -1.5 -0.5 99 99 99 72 56 59 64
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 35 595.0 281 10.2 -1.0 -1.5 99 99 99 68 54 55 61
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 36 611.0 285 7.8 -0.5 -1.0 99 99 99 64 50 52 58
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 37 627.0 295 7.2 -1.5 -2.0 99 99 99 60 48 49 55
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 38 643.0 312 7.4 -0.5 -1.0 99 99 99 61 48 49 55
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 39 659.0 330 6.9 -0.5 -1.5 99 99 99 58 48 46 55
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 40 675.0 312 6.0 -0.5 -0.5 99 99 99 57 46 46 50
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 41 691.0 307 7.5 -1.0 -1.0 99 99 99 52 41 41 48
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 42 707.0 297 4.5 -1.0 -1.5 99 99 99 50 37 39 43
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 43 723.0 286 3.6 0.0 -1.0 99 99 99 46 37 37 43 MM
> MM MM MM 333393333
> 2010 06 01 00 06 0 44 739.0 326 3.6 -0.5 -1.0 99 99 99 46 34 35 40
> MM MM MM MM 333393333
> 2010 06 01 00 06 0 45 755.0 349 2.5 0.0 0.0 99 99 99 45 33 32 38 MM
> MM MM MM 333393333
> 2010 06 01 00 06 0 46 771.0 56 1.8 0.0 -1.5 99 99 99 42 32 30 41 MM
> MM MM MM 333393333
> 2010 06 01 00 06 0 47 787.0 40 3.9 -1.0 0.0 99 99 99 37 30 26 39 MM
> MM MM MM 333393333
> 2010 06 01 00 06 0 48 803.0 56 1.8 -1.0 -1.0 99 98 99 34 31 23 44 MM
> MM MM MM 333393333
> 2010 06 01 00 16 0 0 LATITUDE: 27.55 LONGITUDE: -92.49
> PROFILE_STATUS: 3
> 2010 06 01 00 16 0 1 51.0 234 12.9 -1.5 1.0 99 99 99 207 198 197 204
> MM MM MM MM 333393330
> 2010 06 01 00 16 0 2 67.0 254 8.9 1.5 -1.5 99 99 99 189 178 178 184
> MM MM MM MM 333393330
> 2010 06 01 00 16 0 3 83.0 210 6.9 2.5 0.5 99 99 99 189 192 178 217
> MM MM MM MM 333393330
> 2010 06 01 00 16 0 4 99.0 278 7.6 0.5 -1.0 99 99 99 168 211 151 189
> MM MM MM MM 333393330
> 2010 06 01 00 16 0 5 115.0 228 6.0 3.5 1.5 99 99 99 152 196 134 200
> MM MM MM MM 333393330
> 2010 06 01 00 16 0 6 131.0 285 17.6 -0.5 -3.0 99 99 99 144 167 130
> 178 MM MM MM MM 333393330
> 2010 06 01 00 16 0 7 147.0 291 11.2 2.0 -2.0 99 99 99 137 127 128
> 179 MM MM MM MM 333393330
> 2010 06 01 00 16 0 8 163.0 263 11.6 -1.0 -1.0 99 99 99 130 119 124
> 144 MM MM MM MM 333393330
>
> and eliminate the extraneous inter-timing position lines, then write
> the sucker out as newcdf?
>
> I know most of this is straightforward. Clipping the extraneous
> lines out is stumping me right now. I AM looking for my O'Reilly
> book on sed/awk, though...
>
> I'm attaching the above segment so it can be seen in it's native
> form. The data are from ADCP platforms, and come one platform to a
> file.
>
> THanks, gerry
>
>
> testcase.adcp
>
>
> #YY MM DD hh mm I Bin Depth Dir Speed ErrVL VerVL %Good3 %Good4 %GoodE EI1 EI2 EI3 EI4 CM1 CM2 CM3 CM4 Flags
> #yr mo dy hr mn - - m degT cm/s cm/s cm/s % % % - - - - - - - - -
> 2010 06 01 00 06 0 0 LATITUDE: 27.55 LONGITUDE: -92.49 PROFILE_STATUS: 3
> 2010 06 01 00 06 0 1 51.0 249 15.5 -1.0 -2.0 99 99 99 208 197 197 203 MM MM MM MM 333393330
> 2010 06 01 00 06 0 2 67.0 270 10.0 -0.5 -1.0 99 99 99 185 177 176 184 MM MM MM MM 333393330
> 2010 06 01 00 06 0 3 83.0 204 4.9 2.0 1.0 99 99 99 188 191 178 213 MM MM MM MM 333393330
> 2010 06 01 00 06 0 4 99.0 261 9.6 -0.5 -0.5 99 99 99 171 213 150 186 MM MM MM MM 333393330
> 2010 06 01 00 06 0 5 115.0 213 8.3 1.5 -0.5 99 99 99 161 197 135 199 MM MM MM MM 333393330
> 2010 06 01 00 06 0 6 131.0 249 9.7 -0.5 -1.5 99 99 99 147 165 131 183 MM MM MM MM 333393330
> 2010 06 01 00 06 0 7 147.0 279 10.1 0.0 -3.0 99 99 99 137 129 128 185 MM MM MM MM 333393330
> 2010 06 01 00 06 0 8 163.0 270 10.5 -1.0 -2.0 99 99 99 129 120 124 148 MM MM MM MM 333393330
> 2010 06 01 00 06 0 9 179.0 255 5.7 1.5 -2.0 99 99 99 126 116 117 176 MM MM MM MM 333393330
> 2010 06 01 00 06 0 10 195.0 242 8.5 2.0 -1.5 99 99 99 124 114 113 181 MM MM MM MM 333393330
> 2010 06 01 00 06 0 11 211.0 259 10.2 2.0 -1.5 99 99 99 126 114 115 181 MM MM MM MM 333393330
> 2010 06 01 00 06 0 12 227.0 266 7.0 1.5 -3.0 99 99 99 123 115 119 158 MM MM MM MM 333393330
> 2010 06 01 00 06 0 13 243.0 299 5.1 2.5 -3.5 99 99 99 116 112 107 144 MM MM MM MM 333393330
> 2010 06 01 00 06 0 14 259.0 305 10.4 0.5 -2.0 99 99 99 113 106 101 136 MM MM MM MM 333393330
> 2010 06 01 00 06 0 15 275.0 300 12.1 1.5 -2.0 99 99 99 110 99 98 114 MM MM MM MM 333393330
> 2010 06 01 00 06 0 16 291.0 305 10.4 2.0 -1.5 99 99 99 108 97 95 122 MM MM MM MM 333393333
> 2010 06 01 00 06 0 17 307.0 319 5.3 1.5 -1.0 99 99 99 99 93 93 118 MM MM MM MM 333393333
> 2010 06 01 00 06 0 18 323.0 279 6.6 0.0 -0.5 99 99 99 101 88 91 103 MM MM MM MM 333393333
> 2010 06 01 00 06 0 19 339.0 248 5.4 1.0 0.0 99 99 99 106 86 96 117 MM MM MM MM 333393333
> 2010 06 01 00 06 0 20 355.0 278 7.6 0.5 0.0 99 99 99 104 86 97 109 MM MM MM MM 333393333
> 2010 06 01 00 06 0 21 371.0 295 11.6 0.0 0.5 99 99 99 103 88 91 104 MM MM MM MM 333393333
> 2010 06 01 00 06 0 22 387.0 305 12.2 0.0 0.0 99 99 99 98 87 87 102 MM MM MM MM 333393333
> 2010 06 01 00 06 0 23 403.0 296 13.9 0.0 0.0 99 99 99 98 85 87 96 MM MM MM MM 333393333
> 2010 06 01 00 06 0 24 419.0 282 11.8 0.0 -1.5 99 99 99 100 87 87 96 MM MM MM MM 333393333
> 2010 06 01 00 06 0 25 435.0 288 11.1 -0.5 -1.5 99 99 99 102 88 90 96 MM MM MM MM 333393333
> 2010 06 01 00 06 0 26 451.0 290 5.9 -0.5 0.0 99 99 99 95 85 85 90 MM MM MM MM 333393333
> 2010 06 01 00 06 0 27 467.0 295 7.2 -1.0 -0.5 99 99 99 92 83 81 90 MM MM MM MM 333393333
> 2010 06 01 00 06 0 28 483.0 288 9.5 0.0 0.5 99 99 99 91 80 81 88 MM MM MM MM 333393333
> 2010 06 01 00 06 0 29 499.0 283 6.7 -1.0 -0.5 99 99 99 88 78 77 85 MM MM MM MM 333393333
> 2010 06 01 00 06 0 30 515.0 259 7.6 0.0 0.0 99 99 99 85 72 73 79 MM MM MM MM 333393333
> 2010 06 01 00 06 0 31 531.0 270 5.0 -0.5 -0.5 99 99 99 79 68 71 73 MM MM MM MM 333393333
> 2010 06 01 00 06 0 32 547.0 278 7.1 0.0 -0.5 99 99 99 74 62 63 69 MM MM MM MM 333393333
> 2010 06 01 00 06 0 33 563.0 277 12.1 0.0 -0.5 99 99 99 74 57 58 64 MM MM MM MM 333393333
> 2010 06 01 00 06 0 34 579.0 281 12.7 -1.5 -0.5 99 99 99 72 56 59 64 MM MM MM MM 333393333
> 2010 06 01 00 06 0 35 595.0 281 10.2 -1.0 -1.5 99 99 99 68 54 55 61 MM MM MM MM 333393333
> 2010 06 01 00 06 0 36 611.0 285 7.8 -0.5 -1.0 99 99 99 64 50 52 58 MM MM MM MM 333393333
> 2010 06 01 00 06 0 37 627.0 295 7.2 -1.5 -2.0 99 99 99 60 48 49 55 MM MM MM MM 333393333
> 2010 06 01 00 06 0 38 643.0 312 7.4 -0.5 -1.0 99 99 99 61 48 49 55 MM MM MM MM 333393333
> 2010 06 01 00 06 0 39 659.0 330 6.9 -0.5 -1.5 99 99 99 58 48 46 55 MM MM MM MM 333393333
> 2010 06 01 00 06 0 40 675.0 312 6.0 -0.5 -0.5 99 99 99 57 46 46 50 MM MM MM MM 333393333
> 2010 06 01 00 06 0 41 691.0 307 7.5 -1.0 -1.0 99 99 99 52 41 41 48 MM MM MM MM 333393333
> 2010 06 01 00 06 0 42 707.0 297 4.5 -1.0 -1.5 99 99 99 50 37 39 43 MM MM MM MM 333393333
> 2010 06 01 00 06 0 43 723.0 286 3.6 0.0 -1.0 99 99 99 46 37 37 43 MM MM MM MM 333393333
> 2010 06 01 00 06 0 44 739.0 326 3.6 -0.5 -1.0 99 99 99 46 34 35 40 MM MM MM MM 333393333
> 2010 06 01 00 06 0 45 755.0 349 2.5 0.0 0.0 99 99 99 45 33 32 38 MM MM MM MM 333393333
> 2010 06 01 00 06 0 46 771.0 56 1.8 0.0 -1.5 99 99 99 42 32 30 41 MM MM MM MM 333393333
> 2010 06 01 00 06 0 47 787.0 40 3.9 -1.0 0.0 99 99 99 37 30 26 39 MM MM MM MM 333393333
> 2010 06 01 00 06 0 48 803.0 56 1.8 -1.0 -1.0 99 98 99 34 31 23 44 MM MM MM MM 333393333
> 2010 06 01 00 16 0 0 LATITUDE: 27.55 LONGITUDE: -92.49 PROFILE_STATUS: 3
> 2010 06 01 00 16 0 1 51.0 234 12.9 -1.5 1.0 99 99 99 207 198 197 204 MM MM MM MM 333393330
> 2010 06 01 00 16 0 2 67.0 254 8.9 1.5 -1.5 99 99 99 189 178 178 184 MM MM MM MM 333393330
> 2010 06 01 00 16 0 3 83.0 210 6.9 2.5 0.5 99 99 99 189 192 178 217 MM MM MM MM 333393330
> 2010 06 01 00 16 0 4 99.0 278 7.6 0.5 -1.0 99 99 99 168 211 151 189 MM MM MM MM 333393330
> 2010 06 01 00 16 0 5 115.0 228 6.0 3.5 1.5 99 99 99 152 196 134 200 MM MM MM MM 333393330
> 2010 06 01 00 16 0 6 131.0 285 17.6 -0.5 -3.0 99 99 99 144 167 130 178 MM MM MM MM 333393330
> 2010 06 01 00 16 0 7 147.0 291 11.2 2.0 -2.0 99 99 99 137 127 128 179 MM MM MM MM 333393330
> 2010 06 01 00 16 0 8 163.0 263 11.6 -1.0 -1.0 99 99 99 130 119 124 144 MM MM MM MM 333393330
>
>
>
>
> _______________________________________________
> ncl-talk mailing list
> List instructions, subscriber options, unsubscribe:
> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
_______________________________________________
ncl-talk mailing list
List instructions, subscriber options, unsubscribe:
http://mailman.ucar.edu/mailman/listinfo/ncl-talk
Received on Fri Mar 25 14:42:32 2011