LDAS Test Results

Test Name Status Date System Version Tester gcc 4.1.1
Data Socket PASS 08/15/2008 ldas-dev 1.9.395 Mary Lei  
Compared to 1.7.0 (07/27/05)
New Avg Old Avg Analysis Overall Rate (MB/s) 33.311480 16.461761 102.36% Faster Overall Wall Time (s) 0.061746 0.188255 204.89% Faster Overall CPU Time (s) 0.030103 0.114284 279.64% Faster

Compared to 1.8.0 (11/18/05)
New Avg Old Avg Analysis Overall Rate (MB/s) 33.311480 17.283886 92.73% Faster Overall Wall Time (s) 0.061746 0.168998 173.70% Faster Overall CPU Time (s) 0.030103 0.105771 251.36% Faster

Compared to 1.9.0 (07/18/05)
New Avg Old Avg Analysis Overall Rate (MB/s) 33.311480 17.557928 89.72% Faster Overall Wall Time (s) 0.061746 0.162579 163.30% Faster Overall CPU Time (s) 0.030103 0.102934 241.94% Faster

Database Insertion PASS 08/15/2008 ldas-dev 1.9.395 Mary Lei   
Compared to 1.9.0 (2007.07.18)
New AvgOld AvgAnalysis
Overall Rate (MB/s)5470.5970755011.199049109.17% Faster
Overall Wall Time (s)0.0484900.06743371.91% Faster
Compared to 1.8.0 (2005.10.31)
New AvgOld AvgAnalysis
Overall Rate (MB/s)5470.5970755281.696207103.58% Faster
Overall Wall Time (s)0.0484900.04920798.54% Faster
Compared to 1.7.0 (2005.07.27)
New AvgOld AvgAnalysis
Overall Rate (MB/s)5470.5970757206.827671 75.91% Slower
Overall Wall Time (s)0.0484900.039537122.65% Slower
Database Exception / Misc PASS 08/15/2008 ldas-dev
(gateway/metaserver)
1.9.395 Mary Lei  
descMetaData PASS 08/15/2008 ldas-dev 1.9.395 Mary Lei  
DMT loop PASS 08/18/2008 ldas-dev 1.9.393 Mary Lei  metadata got stuck a lot and had to be manually rebooted.
Frame Accessors PASS ? 08/29/2008 ldas-dev 1.9.408 Mary Lei 114 failed in test suite #1 and part of #2 due to frame core dump. See PR821 for a current list of unsupported accessors.
Frame Gaps PASS ? 08/15/2008 ldas-dev 1.9.395 Mary Lei  Also failed due to frame core dump. Skipped tests involving wrapper: frgap-16.tcl:49/245 frgap-18:47/235 frgap-48.tcl:33/165 frgap-80:33/165
Frame dt Check PASS 08/29/2008 ldas-dev 1.9.408 Mary Lei  
Frame Multi-Type/Size PASS ? 08/15/2008 ldas-dev 1.9.395 Mary Lei  First half failed due to frame core dump
db* Matrix PASS 08/29/2008 ldas-dev 1.9.408 Mary Lei wrapper tests are all skipped. They were found to leak up to 100KB/Job in datacondAPI before.
Wrapper State SKIP 08/15/2008 ldas-dev 1.9.395 Mary Lei  Skipped due to non-functional wrapper in centos build
data/putStandAlone Loops PASS 08/18/2008 ldas-dev 1.9.393 Mary Lei  metadata get stuck quite frequently and a gcore was generated by the monitor script. Another time it had to be manually restarted to be freed from thread kill loop.
Memory Check PASS 08/15/2008 ldas-dev 1.9.395 Mary Lei  
data/putStandAlone FAIL 01/04/2008 ldas-dev (beowulf) 1.9.164 Mary Lei Script hangs with first job using standalone wrapper. burstwrapper dso not included. Sometimes see a difference in inspiral job between standalone and pipeline: effective_distance had a value of 0.0 in summ_value table when it should be 1.8066820
Small round-off differeneces in burst DSOs (slope, tfclusters).
putStandAlone Exception PASS 08/15/2008 ldas-dev
(gateway/metaserver)
1.9.395 Mary Lei Skipped wrapper jobs. The script is repeated 3 times without any ill effects.
Compression PASS 08/15/2008 ldas-dev 1.9.395 Mary Lei  
DC to Frame PASS 08/29/2008 ldas-dev 1.9.408 Mary Lei  
Datacond MDC PASS 08/15/2008 ldas-dev 1.9.395 Mary Lei All 419 tests passed but no emails were received as email is being turned off on dev. Need to close mail client before running test. Expected: Total emails 419, 137 expected to pass, 282 expected to fail, got 0 unexpected results.
FrProc Read/Write PASS 08/29/2008 ldas-dev 1.9.408 Mary Lei  
createRDS FAIL 08/15/2008 ldas-dev 1.9.395 Mary Lei frame core dumped."Walked" through 1 hour of playground S3 data for LHO and LLO.
createRDS - merged FAIL 08/15/2008 ldas-dev 1.9.395 Mary Lei frame core dumped"Walked" through 1 hour of playground S3 data for LHO and LLO.
createRDS - level 2 FAIL 08/15/2008 ldas-dev 1.9.395 Mary Lei  
RDS verification PASS 08/15/2008 ldas-dev 1.9.395 Mary Lei All passed. RDS Verification test verifies level 1, 2, multiframe, concat frame and multiconcat frames.
RDS in dataPipeline FAIL 08/18/2008 ldas-dev 1.9.393 Mary Lei  frame core dumped.
Level 2 RDS in dataPipeline FAIL 08/18/2008 ldas-dev 1.9.388 Mary Lei  frame core dumped.
Merged RDS in dataPipeline PASS 08/18/2008 ldas-dev 1.9.388 Mary Lei  frame core dumped.
NDAS in dataPipeline SKIP 08/15/2008 ldas-dev 1.9.395 Mary Lei All skipped. New largest difference with gcc 4.1.1 is 2.540225e-01 ( 1.4326955e-05-1.1097734e-05/mean )
Error is attributed to linear filter in frameAPI which pre-fetches many more seconds of data from NDAS frames than from raw frames.
Lal/Wrapper Version: test-2004-02-23
Regression tests PASS 08/29/2008 ldas-dev ( sunbuild ) 1.9.408 Mary Lei  The only ones failed: pr2136.tcl pr2122.tcl pr2121.tcl pr2088.tcl pr1997.tcl pr1916.tcl pr1820.tcl pr1773.tcl require a functional wrapper. pr3222.tcl pr3076.tcl pr2953.tcl pr2823.tcl pr2807.tcl pr2125.tcl pr2122.tcl ran under SystemTest format rather than 'make regression' by user install. Running these system tests in parallel with make regression may cause some errors due to file already exist etc. in some tests. See regression log
Link Check PASS ? 08/15/2008 ldas-dev 1.9.395 Mary Lei List of bad links
Alternate report
Different from last week
Diskcache mangle PASS 08/15/2008 ldas-dev 1.9.395 Mary Lei  Expected caches to differ for /archive, /data and /scratch files that are changing.
Complex data in frames PASS 08/29/2008 ldas-dev 1.9.408 Mary Lei  
Test lsync.tcl and shared objects PASS 08/15/2008 ldas-dev
(gateway/opterondata-dev)
1.9.395 Mary Lei 10 of 10 passed with 6 mount points. This test is only run without /archive and /data in the mount points as these file systems are constantly having files added and lsync would never finish scanning. caches matched only when I issued a rebuild cache request at diskcache. Expected caches to differ only for some RDSVerify frame directories that does not have timestamp in diskcache. Must be run when there are no active updates to /archive. Otherwise a run does not come to an end. Wait for 20 iterations of directory scanning before comparing cache contents. Expected lsync.cache to agree with .frame.cache for the same mount points and excluded directories.
Test geo frames PASS 08/29/2008 ldas-dev 1.9.408 Mary Lei channel G1:DER_H_QUALITY only has 1 data point so cannot resample; G1:DER_H_HP-EP ok
Test all user commands via tcl socket PASS 08/29/2008 ldas-dev 1.9.408 Mary Lei getFrameElement passes. Run TEST ALL CMDS from cmonClient with tcl socket as globus socket does not flush, causing abortJob cmd to not able to get jobId to abort
Frame to ilwd test PASS 08/15/2008 ldas-dev 1.9.395 Mary Lei  Tests passed but result comparsion failed as last test has no stats to compare. Generated the stats comparsion manually. 50-100% faster than results of 0428.