RE: 20030811:BADC IDD feeds

Hi Kevin,

Yes, it looks as it should.

It appears as if during this "snapshot" the data was arriving late.

Sep 23 16:31:30 pqutil  --->   20030923155447.490 is indicating ~36
minutes of latency.


However, currently it appears as if all the data is arriving in seconds..

Please see:

http://www.unidata.ucar.edu/staff/chiz/rtstats/siteindex.shtml?westerly.badc.rl.ac.uk

For real time stats on latency, volume, etc....

The sawtouth jumps indicate clock re-sets/drift..are you using NTP?

Let me know when you are ready to ingest the CONDUIT (NCEPH) high res
model output.

Cheers,

Jeff
---------------------------------------------------------------------
Jeff Weber                                    address@hidden        :
Unidata Program Center                        PH:303-497-8676        :
University Corp for Atmospheric Research      3300 Mitchell Ln       :
http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 80307-3000  :
---------------------------------------------------------------------

On Fri, 26 Sep 2003, Marsh, AKP (Kevin)  wrote:

> Hi Jeff,
> Sorry for the delay in getting back to you. I finally managed to go through
> the configuration steps for the LDM on westerly.badc.rl.ac.uk to access the
> HDS feeds from atm.geo.nsf.gov.
> Ldadmin watch gives:
>
> ETA_84/#216/200309231200/F057/HGT/900 mb/
> Sep 23 16:31:30 pqutil:    22430 20030923155447.490     HDS 12266463  ZHVS91
> KWBE 231200 /mETA_84 !grib/ncep/ETA_84/#216/200309231200/F057/HGT/875 mb/
> Sep 23 16:31:30 pqutil:    22430 20030923155447.729     HDS 12266464  ZHVS85
> KWBE 231200 /mETA_84 !grib/ncep/ETA_84/#216/200309231200/F057/HGT/850 mb/
> Sep 23 16:31:30 pqutil:    22430 20030923155447.970     HDS 12266465  ZHVS80
> KWBE 231200 /mETA_84 !grib/ncep/ETA_84/#216/200309231200/F057/HGT/800 mb/
> Sep 23 16:31:30 pqutil:     9498 20030923155448.062     HDS 42983206  JUSA42
> KWNO 231400 !bufr/
> Sep 23 16:31:30 pqutil:     9498 20030923155448.159     HDS 42983208  JUSA42
> KWNO 231400 !bufr/
> Sep 23 16:31:30 pqutil:     5974 20030923155448.188     HDS 42983209  JUSA42
> KWNO 231400 !bufr/
> Sep 23 16:31:30 pqutil:    22430 20030923155448.210     HDS 12266466  ZHVS82
> KWBE 231200 /mETA_84 !grib/ncep/ETA_84/#216/200309231200/F057/HGT/825 mb/
> Sep 23 16:31:30 pqutil:     9126 20030923155448.238     HDS 42983210  JUSA42
> KWNO 231400 !bufr/
> Sep 23 16:31:30 pqutil:    22430 20030923155448.449     HDS 12266467  ZHVS75
> KWBE 231200 /mETA_84 !grib/ncep/ETA_84/#216/200309231200/F057/HGT/750 mb/
> Sep 23 16:31:30 pqutil:    22430 20030923155448.690     HDS 12266468  ZHVS72
> KWBE 231200 /mETA_84 !grib/ncep/ETA_84/#216/200309231200/F057/HGT/725
> mb/
>
> -does this look ok to you?
>
> Thanks,
> Kevin
>
> -----Original Message-----
> From: Jeff Weber [mailto:address@hidden]
> Sent: 15 August 2003 20:26
> To: Marsh, AKP (Kevin) ; Linda Miller; Tom Yoksas
> Cc: address@hidden
> Subject: RE: 20030811:BADC IDD feeds
>
>
> Kevin,
>
> Thank you for your patience, we just want to make sure we are not violating
> any agreements or conditions...
>
> We have placed an allow for the HDS feed from our machine at the NSF:
>
> atm.geo.nsf.gov
>
> For your machine:
>
> westerly.badc.rl.ac.uk
>
> Once we have successfully ingested this stream we will move up to CONDUIT,
> which contains much greater volume than the HDS feed and will provide an
> even better test of the LDM/IDD capabilities for transmission of these large
> products across the Atlantic.
>
> I suspect we will desire to sub-set the CONDUIT (NCEPH) so that you ingest
> only the global model runs, but I will let you make that decision as we do
> not know where your research is focused.
>
> I saw that after the heat wave, came a few twisters.. quite anomolous
> weather for the UK!!
>
> Cheers,
>
> Jeff
> ---------------------------------------------------------------------
> Jeff Weber                                    address@hidden        :
> Unidata Program Center                        PH:303-497-8676        :
> University Corp for Atmospheric Research      3300 Mitchell Ln       :
> http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 80307-3000  :
> ---------------------------------------------------------------------
>
> On Tue, 12 Aug 2003, Marsh, AKP (Kevin)  wrote:
>
> > Hi Jeff,
> >     Thanks for your reply (I wasn't sure if my emails had made it past
> > our mail server :-) ). We were enjoying the heat for the first few
> > days, but the past week has been too much & we are hoping for a return
> > to our usual rainy conditions (so we can have something else to
> > complain about!).
> >
> > The following may be of assistance. There is background information
> > about the BADC at http://badc.nerc.ac.uk/home/about.html . We are a UK
> > Government funded data centre which provides data to a large number of
> > academic researchers for strictly non-commercial work. Some of the
> > datasets (such as those from the UK Met Office & ECMWF) require the
> > users to sign a condition of use form, agreeing to this.
> >
> > If you need any more information, please get in touch,
> > Thanks
> > Kevin
> >
> >
> >
> > -----Original Message-----
> > From: Jeff Weber [mailto:address@hidden]
> > Sent: 11 August 2003 22:45
> > To: Marsh, AKP (Kevin)
> > Cc: Linda Miller; Tom Yoksas
> > Subject: 20030811:BADC IDD feeds
> >
> >
> > Kevin,
> >
> > I am in receipt of your phone message earlier this morning.
> >
> > Enjoying the heat......?
> >
> > Apologies for the delay, we are working out some concerns regarding
> > data delivery.
> >
> > The issue at hand is regarding WMO Resolution 40:
> >
> > http://www.nws.noaa.gov/im/wmocovr.htm#contents
> >
> > specifically re-introducing data back to the country of origin.
> >
> > The way I read it, if it is for education or research, it is wide
> > open.
> >
> > We are just wrangling through some legalese to allow you access to our
> > data stream.
> >
> > The HDS feed includes data from ECMWF and UKMet, which is what is
> > raising the caution flag...please afford us a tad of patience as we
> > work through this.
> >
> > Thank you,
> >
> > Jeff
> > ---------------------------------------------------------------------
> > Jeff Weber                                    address@hidden        :
> > Unidata Program Center                        PH:303-497-8676        :
> > University Corp for Atmospheric Research      3300 Mitchell Ln       :
> > http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 80307-3000  :
> > ---------------------------------------------------------------------
> >
> > On Wed, 30 Jul 2003, Marsh, AKP (Kevin)  wrote:
> >
> > > Dear Unidata,
> > > I work in the British Atmospheric Data Centre, at the Rutherford
> > > Appleton Laboratory in the UK. We are interested in testing your LDM
> > > software as a tool for obtaining data to to the academic research
> > > community. We would like to test our LDM installation on
> > > westerly.badc.rl.ac.uk using an upstream feed, and then investigate
> > > the use of LDM to extract data from the UK Met Office (perhaps as a
> > > UK IDD centre). Could you please tell me who the upstream feed will
> > > be. Our site information is:
> > >
> > > * Site Name  British Atmospheric Data Centre, RAL, Oxford, UK
> > >
> > >
> > > * Site Administrator Kevin Marsh
> > >
> > >
> > > * Email Address address@hidden <mailto:address@hidden>
> > >
> > >
> > > * Phone Number +44 (0)1235 446521
> > >
> > >
> > > * Fully Qualified Hostname of the IDD Node (i.e., the computer that
> > > will run the LDM) westerly.badc.rl.ac.uk (130.246.191.167)
> > >
> > > Please contact me if you require further information,
> > > Many Thanks,
> > > Kevin Marsh
> > > BADC
> > >
> >
>