[IDD #VRK-635010]: idd data

Hi Marck,

re:
> Hi Tom thanks for your cooperation.

No worries.

re:
> One last problem. It might be a gempak issue though not ldm.
> 
> 1. I can't seem to see the model data.
> I am sending you a short-hand version of the log file. I thought
> installing gempak on the ldm machine would solve the problem of
> the ldm machine not seeing the gempak decoders(dcgrib2 etc). LDM
> has full read and write privileges and we copied also the
> /home/gempak/GEMPAK6.10/os/linux64/bin directory that has all
> the decoders.
> The nwx and sat images are fine, since these are files.
> 
> Nov  8 15:12:18 dma ldmd[26809] NOTE: Starting Up (version: 6.11.6; built: 
> Oct 25 2013 10:38:19)
> Nov  8 15:12:18 dma ldmd[26809] NOTE: Using local address 0.0.0.0:388
> Nov  8 15:12:18 dma idd.unidata.ucar.edu[26813] NOTE: Starting Up(6.11.6): 
> idd.unidata.ucar.edu:388 20131108181218.727 TS_ENDT {{IDS|DDPLUS,  ".*"}}
> Nov  8 15:12:18 dma idd.unidata.ucar.edu[26813] NOTE: LDM-6 desired 
> product-class: 20131108181218.728 TS_ENDT {{IDS|DDPLUS,  ".*"},{NONE,  
> "SIG=4c52ddda7668cf12827f01ddce4dd482"}}
> Nov  8 15:12:18 dma idd.unidata.ucar.edu[26815] NOTE: Starting Up(6.11.6): 
> idd.unidata.ucar.edu:388 20131108181218.729 TS_ENDT {{NGRID,  
> "/#(002|003|104|201|202|205|213)"}}
> Nov  8 15:12:18 dma idd.unidata.ucar.edu[26814] NOTE: Starting Up(6.11.6): 
> idd.unidata.ucar.edu:388 20131108181218.729 TS_ENDT {{NIMAGE,  ".*"}}
> Nov  8 15:12:18 dma idd.unidata.ucar.edu[26815] NOTE: LDM-6 desired 
> product-class: 20131108181218.729 TS_ENDT {{NGRID,  
> "/#(002|003|104|201|202|205|213)"},{NONE,  
> "SIG=ebeda054908edd9a1bb5da63ca1d13ba"}}
> Nov  8 15:12:18 dma rtstats[26812] NOTE: Starting Up (26809)
> Nov  8 15:12:18 dma pqact[26811] NOTE: Starting Up
> Nov  8 15:12:18 dma idd.unidata.ucar.edu[26814] NOTE: LDM-6 desired 
> product-class: 20131108181218.730 TS_ENDT {{NIMAGE,  ".*"},{NONE,  
> "SIG=c7d9aafc1d16c622e13ad48dc36a4ccb"}}
> Nov  8 15:12:18 dma pqact[26811] NOTE: Starting from insertion-time 
> 2013-11-08 19:12:13.643705 UTC
> Nov  8 15:12:18 dma pqact[26816] ERROR: No such file or directory
> Nov  8 15:12:18 dma pqact[26816] ERROR: [filel.c:1417] Couldn't execute 
> decoder "decoders/dcnldn"
> Nov  8 15:12:18 dma pqact[26816] NOTE: Exiting
> Nov  8 15:12:18 dma idd.unidata.ucar.edu[26814] NOTE: Upstream LDM-6 on 
> idd.unidata.ucar.edu is willing to be a primary feeder
> Nov  8 15:12:18 dma idd.unidata.ucar.edu[26815] NOTE: Upstream LDM-6 on 
> idd.unidata.ucar.edu is willing to be a primary feeder
> Nov  8 15:12:18 dma idd.unidata.ucar.edu[26813] NOTE: Upstream LDM-6 on 
> idd.unidata.ucar.edu is willing to be a primary feeder
> Nov  8 15:12:19 dma pqact[26811] ERROR: child 26816 exited with status 1 
> (PIPE decoders/dcnldn -m 25000 -b 30 -s minute05 -d gempak/logs/dcnldn.log -e 
> GEMTBL=/home/gempak/GEMPAK6.10/gempak/tables gempak/nldn/YYYY
> MMDDHHNN_nldn.gem)
> Nov  8 15:12:19 dma pqact[26811] ERROR: [filel.c:305] Deleting failed PIPE 
> entry: pid=26816, cmd="decoders/dcnldn -m 25000 -b 30 -s minute05 -d 
> gempak/logs/dcnldn.log -e GEMTBL=/home/gempak/GEMPAK6.10/gempak/tabl
> es gempak/nldn/YYYYMMDDHHNN_nldn.gem"
> Nov  8 15:12:19 dma pqact[26818] ERROR: No such file or directory
> Nov  8 15:12:19 dma pqact[26818] ERROR: [filel.c:1417] Couldn't execute 
> decoder "decoders/dcmetr"
> Nov  8 15:12:19 dma pqact[26818] NOTE: Exiting
> Nov  8 15:12:19 dma pqact[26811] ERROR: child 26818 exited with status 1 
> (PIPE decoders/dcmetr -v 2 -a 500 -m 72 -s sfmetar_sa.tbl -d 
> gempak/logs/dcmetr.log -e GEMTBL=/home/gempak/GEMPAK6.10/gempak/tables gempak/
> surface/YYYYMMDD_sao.gem)
> Nov  8 15:12:19 dma pqact[26811] ERROR: [filel.c:305] Deleting failed PIPE 
> entry: pid=26818, cmd="decoders/dcmetr -v 2 -a 500 -m 72 -s sfmetar_sa.tbl -d 
> gempak/logs/dcmetr.log -e GEMTBL=/home/gempak/GEMPAK6.10/ge
> mpak/tables gempak/surface/YYYYMMDD_sao.gem"
> Nov  8 15:12:19 dma pqact[26819] ERROR: No such file or directory
> Nov  8 15:12:19 dma pqact[26819] ERROR: [filel.c:1417] Couldn't execute 
> decoder "decoders/dcmsfc"
> Nov  8 15:12:19 dma pqact[26819] NOTE: Exiting
> Nov  8 15:12:19 dma pqact[26811] ERROR: child 26819 exited with status 1 
> (PIPE decoders/dcmsfc -b 9 -d gempak/logs/dcmsfc.log -e 
> GEMTBL=/home/gempak/GEMPAK6.10/gempak/tables gempak/ship/YYYYMMDDHH_sb.gem)
> Nov  8 15:12:19 dma pqact[26811] ERROR: [filel.c:305] Deleting failed PIPE 
> entry: pid=26819, cmd="decoders/dcmsfc -b 9 -d gempak/logs/dcmsfc.log -e 
> GEMTBL=/home/gempak/GEMPAK6.10/gempak/tables gempak/ship/YYYYMMD
> DHH_sb.gem"

The invocation of the GEMPAK decoders from the pattern-action file
actions you are using assumes:

- the GEMPAK decoders have been copied into the ~ldm/decoders directory

  This can be seen from the ERROR entries in the LDM log file:
Nov  8 15:12:19 dma pqact[26811] ERROR: child 26818 exited with status 1 (PIPE 
decoders/dcmetr -v 2 -a 500 -m 72 -s sfmetar_sa.tbl -d gempak/logs/dcmetr.log 
-e GEMTBL=/home/gempak/GEMPAK6.10/gempak/tables gempak/surface/YYYYMMDD_sao.gem)

  Note that the products are PIPEd to 'decoders/dcmetr'.  This assumes that the 
current
  working directory in scope when the action is run is ~ldm.  This may not be 
the case
  depending on settings in the ~ldm/etc/registry.xml file.

Given the above, it is likely the case that two or three things need to
be done:

- make sure that the ~ldm/decoders directory is in the PATH for the
  user 'ldm'

  Add the ~ldm/decoders and ~ldm/util directories to the PATH defined
  in the shell-specific definition file (e.g., .cshrc for CShells, 
  .bash_profile for BASH, etc.).  If you need to add these to the
  existing PATH, you will need to "source" the shell-specific
  definition file:

  Cshell
  source ~/.cshrc

  BASH
  . ~/.bash_profile

- copy the GEMPAK decoders from the appropriate GEMPAK bin directory
  to ~ldm/decoders

- edit the ~ldm/etc/registry.xml file and:

  set:
  
  <pqact>
    <config-path>/home/ldm/etc/pqact.conf</config-path>
    <datadir-path>/home/ldm</datadir-path>
  </pqact>

  and:
  <pqsurf>
    <config-path>/home/ldm/etc/pqsurf.conf</config-path>
    <datadir-path>/home/ldm</datadir-path>
  </pqsurf>

  The changes are to the <datadir-path> settings since these
  will define the current working directory in scope when
  pattern-action file actions are run.

By the way, I would have made the changes for you, but I found
that I no longer have SSH access to your machine (i.e., the
password for 'ldm' was changed (a good thing) and evidently
the authorized_keys file in ~ldm/.ssh was modified/deleted
or the read/write permission of the file was changed from
600, or the read/write permission on the ~ldm directory was
changed.

Cheers,

Tom
--
****************************************************************************
Unidata User Support                                    UCAR Unidata Program
(303) 497-8642                                                 P.O. Box 3000
address@hidden                                   Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage                       http://www.unidata.ucar.edu
****************************************************************************


Ticket Details
===================
Ticket ID: VRK-635010
Department: Support IDD
Priority: Normal
Status: Closed