LDAS Test Results

Test Name Status Date System Version Tester gcc 4.1.1
Data Socket PASS 11/09/2007 ldas-dev 1.9.109 Mary Lei Compared to 1.7.0 (07/27/05)
New Avg Old Avg Analysis Overall Rate (MB/s) 33.176080 32.369568 2.49% Faster Overall Wall Time (s) 0.064647 0.076264 17.97% Faster Overall CPU Time (s) 0.035205 0.039792 13.03% Faster

Compared to 1.8.0 (11/18/05)
New Avg Old Avg Analysis Overall Rate (MB/s) 33.176080 28.361693 16.97% Faster Overall Wall Time (s) 0.064647 0.085896 32.87% Faster Overall CPU Time (s) 0.035205 0.046672 32.57% Faster

Compared to 1.9.0 (07/18/05)
New Avg Old Avg Analysis Overall Rate (MB/s) 32.646519 32.850093 0.62% Slower Overall Wall Time (s) 0.063011 0.062700 0.49% Slower Overall CPU Time (s) 0.030930 0.029884 3.38% Slower

Database Insertion PASS ? 11/09/2007 ldas-dev 1.9.109 Mary Lei  dims 10,100,1000 failed with metadataAPI core dumps
Compared to 1.9.0 (2007.07.18)
New AvgOld AvgAnalysis
Overall Rate (MB/s)2788.5555074338.173667 64.28% Slower
Overall Wall Time (s)0.0519430.026711194.46% Slower
Compared to 1.8.0 (2005.10.31)
New AvgOld AvgAnalysis
Overall Rate (MB/s)2788.5555074174.013600 66.81% Slower
Overall Wall Time (s)0.0519430.023089224.97% Slower
Compared to 1.7.0 (2005.07.27)
New AvgOld AvgAnalysis
Overall Rate (MB/s)2788.5555076053.700589 46.06% Slower
Overall Wall Time (s)0.0519430.018733277.28% Slower
Database Exception / Misc PASS 11/09/2007 ldas-dev (metaserver) 1.9.109 Mary Lei  Includes 'Unofficial DSO test'
descMetaData PASS 11/09/2007 ldas-dev (metaserver) 1.9.109 Mary Lei  
DMT loop PASS 11/12/2007 ldas-dev 1.9.109 Mary Lei  
Frame Accessors PASS 11/09/2007 ldas-dev 1.9.109 Mary Lei Expected: Total 203 Passed 177 Skipped 0 Failed 26
See PR821 for a current list of unsupported accessors.
Frame Gaps PASS 11/09/2007 ldas-dev 1.9.109 Mary Lei  
Frame dt Check PASS 11/09/2007 ldas-dev 1.9.109 Mary Lei  
Frame Multi-Type/Size PASS 11/09/2007 ldas-dev 1.9.109 Mary Lei Expected 6 failures in tests.
db* Matrix PASS 11/09/2007 ldas-dev 1.9.109 Mary Lei They were found to leak up to 100KB/Job in datacondAPI before.
Wrapper State PASS 11/09/2007 ldas-dev 1.9.109 Mary Lei  
data/putStandAlone Loops PASS 11/12/2007 ldas-dev 1.9.109 Mary Lei  
Memory Check PASS 11/12/2007 ldas-dev 1.9.109 Mary Lei  
data/putStandAlone PASS 11/09/2007 ldas-dev (beowulf) 1.9.109 Mary Lei burstwrapper dso not included. Sometimes see a difference in inspiral job between standalone and pipeline: effective_distance had a value of 0.0 in summ_value table when it should be 1.8066820
Small round-off differeneces in burst DSOs (slope, tfclusters).
putStandAlone Exception PASS 11/09/2007 ldas-dev (metaserver) 1.9.109 Mary Lei 2 process test failed first time; passed on re-run. Dependent on object arrival. The script is repeated 3 times without any ill effects.
Compression PASS 11/09/2007 ldas-dev 1.9.109 Mary Lei Expected no failures.
DC to Frame PASS 11/09/2007 ldas-dev 1.9.109 Mary Lei  
Datacond MDC PASS 11/09/2007 ldas-dev 1.9.109 Mary Lei Ran all 419 jobs but datacondMDC.tcl terminated waiting for emails. All emails validated ok. Expected: Total emails 419, 137 expected to pass, 282 expected to fail, got 0 unexpected results.
FrProc Read/Write PASS 11/09/2007 ldas-dev 1.9.109 Mary Lei  
createRDS PASS 11/09/2007 ldas-dev 1.9.109 Mary Lei "Ran OK with new script createRDSTEST_S3.tcl. Walked" through 1 hour of playground S3 and S5 data for LHO and LLO.
createRDS - merged PASS 11/09/2007 ldas-dev 1.9.109 Mary Lei "Ran OK with new script createRDSTEST_S3.tcl. Walked" through 1 hour of playground S3 data for LHO and LLO.
createRDS - level 2 PASS 11/09/2007 ldas-dev 1.9.109 Mary Lei  Ran OK with new script createRDSTEST_S3.tcl.
RDS verification PASS 11/09/2007 ldas-dev 1.9.109 Mary Lei Runs within 2 hours due to use of cacheGetFrames to check if cache update is complete so no excessive idle time. Fails if cache is being rebuild. Took about 11 hours to run Tested with S5 data. RDS Verification test verifies level 1, 2, multiframe, concat frame and multiconcat frames.
RDS in dataPipeline PASS 11/12/2007 ldas-dev 1.9.109 Mary Lei  
Level 2 RDS in dataPipeline PASS 11/12/2007 ldas-dev 1.9.109 Mary Lei  
Merged RDS in dataPipeline PASS 11/12/2007 ldas-dev 1.9.109 Mary Lei  
NDAS in dataPipeline PASS 11/09/2007 ldas-dev 1.9.109 Mary Lei New largest difference with gcc 4.1.1 is 2.540225e-01 ( 1.4326955e-05-1.1097734e-05/mean )
Error is attributed to linear filter in frameAPI which pre-fetches many more seconds of data from NDAS frames than from raw frames.
Lal/Wrapper Version: test-2004-02-23
Regression tests PASS 11/09/2007 ldas-dev ( sunbuild ) 1.9.109 Mary Lei For pr2953 to cleanup each time, must run as user ldas instead of install. Others run as install. 
Link Check PASS ? 11/09/2007 ldas-dev 1.9.109 Mary Lei List of bad links
Alternate report
Different from last week
Diskcache mangle PASS 11/12/2007 ldas-dev 1.9.109 Mary Lei  Expected caches to differ for /archive, /data and /scratch files that are changing.
Complex data in frames PASS 11/09/2007 ldas-dev 1.9.109 Mary Lei  Passed after setenv MANAGER_REPLY_TIMEOUT 1200000 or else jobs get timed out
Test lsync.tcl and shared objects PASS 11/09/2007 ldas-dev (dataserver-dev) 1.9.109 Mary Lei This test is only run without /archive and /data in the mount points as these file systems are constantly having files added and lsync would never finish scanning. caches matched only when I issued a rebuild cache request at diskcache. Expected caches to differ only for some RDSVerify frame directories that does not have timestamp in diskcache. Must be run when there are no active updates to /archive. Otherwise a run does not come to an end. Wait for 20 iterations of directory scanning before comparing cache contents. Expected lsync.cache to agree with .frame.cache for the same mount points and excluded directories.
Test geo frames PASS 11/09/2007 ldas-dev 1.9.109 Mary Lei channel G1:DER_H_QUALITY only has 1 data point so cannot resample; G1:DER_H_HP-EP ok
Test all user commands via tcl socket PASS 11/09/2007 ldas-test 1.9.109 Mary Lei Run TEST ALL CMDS from cmonClient with tcl socket as globus socket does not flush, causing abortJob cmd to not able to get jobId to abort
Frame to ilwd test PASS 11/09/2007 ldas-dev 1.9.109 Mary Lei   generally faster up to 50%