MADIS DR RUN-TIME STATUS for Thu Mar 30 14:32:01 GMT 2023 on vm-lnx-madis-recovery1a
     INFO Node name: vm-lnx-madis-recovery1a
     PASS METAR processing tbl exists:  128320 Mar 28 17:30 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/NonFedAWOSStation.tbl
     PASS Station update flag exists:  0 May  3  2019 /usr1/ldm/madis/dr/decode/awips/fxa/GO-UPDATE-STATIONS
     PASS Metar station table exists:  1121683 May  3  2019 /usr1/ldm/madis/dr/sfc/iqc1/fslparms/lsfc.tbl
     PASS Accept/reject|autorej files exists: AO: 3 IQC: 3 NON-SFC: 
     PASS Persistent processes exists: pqact (1+): 1 ldmd (1+): 17 DECODE (4): 5
     PASS Dcmetr check: CNT-LDAD.raw: 1373
     PASS Load resource check: 60% of the time M15 < 9 Samples: 872 %<60:  100% #10=+ 0 #9 0 #8 0 #7 0
     PASS Open file resource check: < 5000 Max files: 1681 #<1000: 851 #<10000 872
     FAIL Process count check: < 1000 Max Processes: 1016G
     PASS AO Throughput test: <20 delayed %Delayed: 0% #Sample: 13 #Delayed: 0
     PASS IQC Throughput test: <30 delayed #Delayed: 0 Competed timely:  119    
     PASS No '0' length Station table files in data: #: 0
     PASS No '0' length Station table files in master: #: 0
     PASS No netcdf-4.1 netCDF lib connection for routerStoreNetCDF:
     PASS Shefdecoder check 20230329_1200: #CPYRMA: 7 #NJWXNET: 1060 #NERRS: 0
  COMPARE UNIQUE mesonet provider cnt for 20230329_1200: 28
     PASS DR_SendFile2LDM is updating MADIS netcdf common data directories 
  COMPARE DECODE STN TBLS           149  Newest:     2991 Mar 29 15:00 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/PSU-ACAQStation.txt  Oldest:     1568 Aug 21  2019 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/AWS-KSNetStation.txt
  COMPARE PRE-DECODE STN TBLS       149  Newest:     2991 Mar 29 15:00 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/master/PSU-ACAQStation.txt  Oldest:     1568 Aug 21  2019 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/master/AWS-KSNetStation.txt
  COMPARE Compare rough file sizes for same hour on known good system. Hour: 20230329_12
-rw-r--r--. 1    185892 Mar 29 14:50 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/crn/netCDF/20230329_1200
-rw-r--r--. 1    118572 Mar 29 14:50 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/hcn/netCDF/20230329_1200
-rw-r--r--. 1  10043280 Mar 30 14:16 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/hydro/netCDF/20230329_1200
-rwxr-xr-x. 1 288605520 Mar 30 12:40 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/mesonet/netCDF/20230329_1200
-rw-r--r--. 1    124128 Mar 30 13:55 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/nepp/netCDF/20230329_1200
-rw-r--r--. 1   9104920 Mar 29 14:07 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/rwis/netCDF/20230329_1200
-rw-r--r--. 1   4449084 Mar 30 14:16 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/snow/netCDF/20230329_1200
-rw-r--r--. 1   4749540 Mar 29 13:07 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/urbanet/netCDF/20230329_1200
-rw-r--r--. 1    861924 Mar 29 16:18 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/buoy/20230329_1200
-rw-r--r--. 1    231340 Mar 30 12:26 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/crn/20230329_1200
-rw-r--r--. 1     69692 Mar 30 12:26 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/hcn/20230329_1200
-rw-r--r--. 1   5827212 Mar 30 12:26 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/hydro/20230329_1200
-rw-r--r--. 1 192518184 Mar 30 12:26 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/mesonet/20230329_1200
-rw-r--r--. 1   6041204 Mar 29 16:18 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/metar/20230329_1200
-rw-r--r--. 1     72928 Mar 30 12:26 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/nepp/20230329_1200
-rw-r--r--. 1   3650672 Mar 30 12:26 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/urbanet/20230329_1200
-rw-r--r--. 1    153060 Mar 29 13:18 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/buoy/20230329_1200
-rw-r--r--. 1     80332 Mar 30 12:24 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/crn/20230329_1200
-rw-r--r--. 1     69692 Mar 30 12:24 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/hcn/20230329_1200
-rw-r--r--. 1   4304268 Mar 30 12:24 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/hydro/20230329_1200
-rw-r--r--. 1 113488536 Mar 30 12:24 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/mesonet/20230329_1200
-rw-r--r--. 1   2321180 Mar 29 16:19 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/metar/20230329_1200
-rw-r--r--. 1     72928 Mar 30 12:24 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/nepp/20230329_1200
-rw-r--r--. 1   1687592 Mar 30 12:24 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/urbanet/20230329_1200
-rw-r--r--. 1    199636 Mar 29 14:37 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/buoy/20230329_1200
-rw-r--r--. 1     78880 Mar 30 12:42 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/crn/20230329_1200
-rw-r--r--. 1    147528 Mar 30 12:42 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/hcn/20230329_1200
-rw-r--r--. 1   3951756 Mar 30 12:42 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/hydro/20230329_1200
-rw-r--r--. 1  77764008 Mar 30 12:42 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/mesonet/20230329_1200
-rw-r--r--. 1   2130860 Mar 29 14:37 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/metar/20230329_1200
-rw-r--r--. 1     72928 Mar 30 12:42 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/nepp/20230329_1200
-rw-r--r--. 1   4560392 Mar 30 12:42 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/urbanet/20230329_1200
-rw-r--r--. 1    288244 Mar 29 16:32 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/buoy/20230329_1200
-rw-r--r--. 1     97756 Mar 30 12:38 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/crn/20230329_1200
-rw-r--r--. 1    156460 Mar 30 12:38 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/hcn/20230329_1200
-rw-r--r--. 1   4292748 Mar 30 12:38 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/hydro/20230329_1200
-rw-r--r--. 1 100969140 Mar 30 12:38 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/mesonet/20230329_1200
-rw-r--r--. 1   2000564 Mar 29 14:31 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/metar/20230329_1200
-rw-r--r--. 1     72928 Mar 30 12:38 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/nepp/20230329_1200
-rw-r--r--. 1   5882412 Mar 30 12:38 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/urbanet/20230329_1200
-rw-r--r--. 1    234852 Mar 29 14:47 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/buoy/20230329_1200
-rw-r--r--. 1     97756 Mar 30 12:54 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/crn/20230329_1200
-rw-r--r--. 1     69692 Mar 30 12:54 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/hcn/20230329_1200
-rw-r--r--. 1   3730572 Mar 30 12:54 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/hydro/20230329_1200
-rw-r--r--. 1  99528564 Mar 30 12:54 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/mesonet/20230329_1200
-rw-r--r--. 1   1720940 Mar 29 14:47 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/metar/20230329_1200
-rw-r--r--. 1    167308 Mar 30 12:54 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/nepp/20230329_1200
-rw-r--r--. 1   3581512 Mar 30 12:54 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/urbanet/20230329_1200
-rw-r--r--. 1    251668 Mar 30 13:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/crn/20230329_1200
-rw-r--r--. 1    167944 Mar 30 13:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hcn/20230329_1200
-rw-r--r--. 1  15042060 Mar 30 13:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hydro/20230329_1200
-rw-r--r--. 1 513160536 Mar 30 13:07 /usr1/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20230329_1200
-rw-r--r--. 1    167308 Mar 30 13:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/nepp/20230329_1200
-rw-r--r--. 1  14293332 Mar 30 13:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20230329_1200
  COMPARE Compare rough file sizes for same hour on known good system. Hour: 20230329_1200
-rw-r--r--. 1   1261796 Mar 30 13:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/buoy/20230329_1200
-rw-r--r--. 1    251668 Mar 30 13:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/crn/20230329_1200
-rw-r--r--. 1    167944 Mar 30 13:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hcn/20230329_1200
-rw-r--r--. 1  18961516 Mar 30 13:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hfmetar/20230329_1200
-rw-r--r--. 1  16631820 Mar 30 13:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hydro/20230329_1200
-rw-r--r--. 1 808181032 Mar 30 13:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/mesonet/20230329_1200
-rw-r--r--. 1  12137300 Mar 30 13:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/metar/20230329_1200
-rw-r--r--. 1    167308 Mar 30 13:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/nepp/20230329_1200
-rw-r--r--. 1  14293332 Mar 30 13:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/urbanet/20230329_1200
-rw-r--r--. 1    251668 Mar 30 13:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/crn/20230329_1200
-rw-r--r--. 1    167944 Mar 30 13:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hcn/20230329_1200
-rw-r--r--. 1  15042060 Mar 30 13:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hydro/20230329_1200
-rw-r--r--. 1 513160536 Mar 30 13:07 /usr1/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20230329_1200
-rw-r--r--. 1    167308 Mar 30 13:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/nepp/20230329_1200
-rw-r--r--. 1  14293332 Mar 30 13:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20230329_1200
  COMPARE Compare rough file sizes for same hour on known good system. Hour: 20230329_1100
-rw-r--r--. 1   1143652 Mar 30 12:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/buoy/20230329_1100
-rw-r--r--. 1    460756 Mar 30 12:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/crn/20230329_1100
-rw-r--r--. 1    278956 Mar 30 12:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hcn/20230329_1100
-rw-r--r--. 1  18947512 Mar 30 12:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hfmetar/20230329_1100
-rw-r--r--. 1  14849676 Mar 30 12:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hydro/20230329_1100
-rw-r--r--. 1 782065836 Mar 30 12:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/mesonet/20230329_1100
-rw-r--r--. 1  12185612 Mar 30 12:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/metar/20230329_1100
-rw-r--r--. 1    180376 Mar 30 12:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/nepp/20230329_1100
-rw-r--r--. 1  16123412 Mar 30 12:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/urbanet/20230329_1100
-rw-r--r--. 1    460756 Mar 30 12:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/crn/20230329_1100
-rw-r--r--. 1    278956 Mar 30 12:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hcn/20230329_1100
-rw-r--r--. 1  12281868 Mar 30 12:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hydro/20230329_1100
-rw-r--r--. 1 512407308 Mar 30 12:07 /usr1/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20230329_1100
-rw-r--r--. 1    180376 Mar 30 12:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/nepp/20230329_1100
-rw-r--r--. 1  16123412 Mar 30 12:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20230329_1100