MADIS DR RUN-TIME STATUS for Thu Mar 30 09:32:02 GMT 2023 on vm-lnx-madis-recovery1a
     INFO Node name: vm-lnx-madis-recovery1a
     PASS METAR processing tbl exists:  128320 Mar 28 17:30 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/NonFedAWOSStation.tbl
     PASS Station update flag exists:  0 May  3  2019 /usr1/ldm/madis/dr/decode/awips/fxa/GO-UPDATE-STATIONS
     PASS Metar station table exists:  1121683 May  3  2019 /usr1/ldm/madis/dr/sfc/iqc1/fslparms/lsfc.tbl
     PASS Accept/reject|autorej files exists: AO: 3 IQC: 3 NON-SFC: 
     PASS Persistent processes exists: pqact (1+): 1 ldmd (1+): 13 DECODE (4): 5
     PASS Dcmetr check: CNT-LDAD.raw: 1196
     PASS Load resource check: 60% of the time M15 < 9 Samples: 572 %<60:  100% #10=+ 0 #9 0 #8 0 #7 0
     PASS Open file resource check: < 5000 Max files: 1681 #<1000: 554 #<10000 572
     FAIL Process count check: < 1000 Max Processes: 1016G
     PASS AO Throughput test: <20 delayed %Delayed: 0% #Sample: 8 #Delayed: 0
     PASS IQC Throughput test: <30 delayed #Delayed: 0 Competed timely:  69    
     PASS No '0' length Station table files in data: #: 0
     PASS No '0' length Station table files in master: #: 0
     PASS No netcdf-4.1 netCDF lib connection for routerStoreNetCDF:
     PASS Shefdecoder check 20230329_0700: #CPYRMA: 8 #NJWXNET: 631 #NERRS: 0
  COMPARE UNIQUE mesonet provider cnt for 20230329_0700: 28
     PASS DR_SendFile2LDM is updating MADIS netcdf common data directories 
  COMPARE DECODE STN TBLS           149  Newest:     2991 Mar 29 15:00 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/PSU-ACAQStation.txt  Oldest:     1568 Aug 21  2019 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/AWS-KSNetStation.txt
  COMPARE PRE-DECODE STN TBLS       149  Newest:     2991 Mar 29 15:00 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/master/PSU-ACAQStation.txt  Oldest:     1568 Aug 21  2019 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/master/AWS-KSNetStation.txt
  COMPARE Compare rough file sizes for same hour on known good system. Hour: 20230329_07
-rw-r--r--. 1    315420 Mar 29 08:50 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/crn/netCDF/20230329_0700
-rw-r--r--. 1    141360 Mar 29 09:50 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/hcn/netCDF/20230329_0700
-rw-r--r--. 1   3073908 Mar 30 02:46 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/hydro/netCDF/20230329_0700
-rwxr-xr-x. 1 284967424 Mar 30 07:40 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/mesonet/netCDF/20230329_0700
-rw-r--r--. 1    129868 Mar 30 08:55 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/nepp/netCDF/20230329_0700
-rw-r--r--. 1   9117300 Mar 29 12:50 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/rwis/netCDF/20230329_0700
-rw-r--r--. 1   1835284 Mar 29 15:51 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/snow/netCDF/20230329_0700
-rw-r--r--. 1   5340828 Mar 29 08:07 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/urbanet/netCDF/20230329_0700
-rw-r--r--. 1    782404 Mar 29 11:17 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/buoy/20230329_0700
-rw-r--r--. 1    301036 Mar 30 07:26 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/crn/20230329_0700
-rw-r--r--. 1     69692 Mar 30 07:26 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/hcn/20230329_0700
-rw-r--r--. 1   2154636 Mar 30 07:27 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/hydro/20230329_0700
-rw-r--r--. 1 191374068 Mar 30 07:26 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/mesonet/20230329_0700
-rw-r--r--. 1   5877236 Mar 29 11:17 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/metar/20230329_0700
-rw-r--r--. 1     72928 Mar 30 07:26 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/nepp/20230329_0700
-rw-r--r--. 1   3674612 Mar 30 07:26 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/urbanet/20230329_0700
-rw-r--r--. 1    154196 Mar 29 08:18 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/buoy/20230329_0700
-rw-r--r--. 1    136960 Mar 30 07:25 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/crn/20230329_0700
-rw-r--r--. 1     69692 Mar 30 07:25 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/hcn/20230329_0700
-rw-r--r--. 1   2027916 Mar 30 07:25 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/hydro/20230329_0700
-rw-r--r--. 1 112946124 Mar 30 07:25 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/mesonet/20230329_0700
-rw-r--r--. 1     72928 Mar 30 07:25 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/nepp/20230329_0700
-rw-r--r--. 1   1684932 Mar 30 07:25 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/urbanet/20230329_0700
-rw-r--r--. 1    206452 Mar 29 09:36 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/buoy/20230329_0700
-rw-r--r--. 1    106468 Mar 30 07:43 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/crn/20230329_0700
-rw-r--r--. 1    171772 Mar 30 07:43 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/hcn/20230329_0700
-rw-r--r--. 1   1373580 Mar 30 07:43 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/hydro/20230329_0700
-rw-r--r--. 1  76984428 Mar 30 07:42 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/mesonet/20230329_0700
-rw-r--r--. 1   2107436 Mar 29 11:37 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/metar/20230329_0700
-rw-r--r--. 1     72928 Mar 30 07:43 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/nepp/20230329_0700
-rw-r--r--. 1   6201612 Mar 30 07:43 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/urbanet/20230329_0700
-rw-r--r--. 1    292788 Mar 29 11:31 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/buoy/20230329_0700
-rw-r--r--. 1    125344 Mar 30 07:38 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/crn/20230329_0700
-rw-r--r--. 1    187084 Mar 30 07:38 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/hcn/20230329_0700
-rw-r--r--. 1   1487628 Mar 30 07:38 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/hydro/20230329_0700
-rw-r--r--. 1  98687496 Mar 30 07:38 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/mesonet/20230329_0700
-rw-r--r--. 1   1915652 Mar 29 11:31 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/metar/20230329_0700
-rw-r--r--. 1     72928 Mar 30 07:38 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/nepp/20230329_0700
-rw-r--r--. 1   7260292 Mar 30 07:38 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/urbanet/20230329_0700
-rw-r--r--. 1    237124 Mar 29 09:46 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/buoy/20230329_0700
-rw-r--r--. 1    116632 Mar 30 07:52 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/crn/20230329_0700
-rw-r--r--. 1     69692 Mar 30 07:52 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/hcn/20230329_0700
-rw-r--r--. 1   1532556 Mar 30 07:52 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/hydro/20230329_0700
-rw-r--r--. 1  95885400 Mar 30 07:52 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/mesonet/20230329_0700
-rw-r--r--. 1   1720940 Mar 29 09:46 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/metar/20230329_0700
-rw-r--r--. 1    177472 Mar 30 07:52 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/nepp/20230329_0700
-rw-r--r--. 1   3584172 Mar 30 07:52 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/urbanet/20230329_0700
-rw-r--r--. 1    434620 Mar 30 08:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/crn/20230329_0700
-rw-r--r--. 1    202396 Mar 30 08:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hcn/20230329_0700
-rw-r--r--. 1   4288140 Mar 30 08:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hydro/20230329_0700
-rw-r--r--. 1 506680140 Mar 30 08:07 /usr1/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20230329_0700
-rw-r--r--. 1    177472 Mar 30 08:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/nepp/20230329_0700
-rw-r--r--. 1  16139372 Mar 30 08:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20230329_0700
  COMPARE Compare rough file sizes for same hour on known good system. Hour: 20230329_0700
-rw-r--r--. 1   1115252 Mar 30 08:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/buoy/20230329_0700
-rw-r--r--. 1    434620 Mar 30 08:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/crn/20230329_0700
-rw-r--r--. 1    202396 Mar 30 08:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hcn/20230329_0700
-rw-r--r--. 1  18931952 Mar 30 08:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hfmetar/20230329_0700
-rw-r--r--. 1   5865228 Mar 30 08:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hydro/20230329_0700
-rw-r--r--. 1 777779056 Mar 30 08:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/mesonet/20230329_0700
-rw-r--r--. 1  11904524 Mar 30 08:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/metar/20230329_0700
-rw-r--r--. 1    177472 Mar 30 08:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/nepp/20230329_0700
-rw-r--r--. 1  16139372 Mar 30 08:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/urbanet/20230329_0700
-rw-r--r--. 1    434620 Mar 30 08:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/crn/20230329_0700
-rw-r--r--. 1    202396 Mar 30 08:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hcn/20230329_0700
-rw-r--r--. 1   4288140 Mar 30 08:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hydro/20230329_0700
-rw-r--r--. 1 506680140 Mar 30 08:07 /usr1/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20230329_0700
-rw-r--r--. 1    177472 Mar 30 08:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/nepp/20230329_0700
-rw-r--r--. 1  16139372 Mar 30 08:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20230329_0700
  COMPARE Compare rough file sizes for same hour on known good system. Hour: 20230329_0600
-rw-r--r--. 1   1293604 Mar 30 07:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/buoy/20230329_0600
-rw-r--r--. 1    436072 Mar 30 07:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/crn/20230329_0600
-rw-r--r--. 1    202396 Mar 30 07:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hcn/20230329_0600
-rw-r--r--. 1  18927284 Mar 30 07:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hfmetar/20230329_0600
-rw-r--r--. 1   8196876 Mar 30 07:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hydro/20230329_0600
-rw-r--r--. 1 775709500 Mar 30 07:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/mesonet/20230329_0600
-rw-r--r--. 1  11733236 Mar 30 07:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/metar/20230329_0600
-rw-r--r--. 1    180376 Mar 30 07:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/nepp/20230329_0600
-rw-r--r--. 1  16104792 Mar 30 07:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/urbanet/20230329_0600
-rw-r--r--. 1    436072 Mar 30 07:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/crn/20230329_0600
-rw-r--r--. 1    202396 Mar 30 07:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hcn/20230329_0600
-rw-r--r--. 1   6523020 Mar 30 07:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hydro/20230329_0600
-rw-r--r--. 1 504932124 Mar 30 07:07 /usr1/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20230329_0600
-rw-r--r--. 1    180376 Mar 30 07:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/nepp/20230329_0600
-rw-r--r--. 1  16104792 Mar 30 07:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20230329_0600