LDAS Test Results

Test Name Status Date System Version Tester gcc 4.1.1
Data Socket FAIL 12/03/2007 ldas-dev 1.9.133 Mary Lei Cannot run as connections results in authenication error. Compared to 1.7.0 (07/27/05)
New Avg Old Avg Analysis Overall Rate (MB/s) 32.980026 32.369568 1.89% Faster Overall Wall Time (s) 0.065053 0.076264 17.23% Faster Overall CPU Time (s) 0.035304 0.039792 12.71% Faster

Compared to 1.8.0 (11/18/05)
New Avg Old Avg Analysis Overall Rate (MB/s) 32.980026 28.361693 16.28% Faster Overall Wall Time (s) 0.065053 0.085896 32.04% Faster Overall CPU Time (s) 0.035304 0.046672 32.20% Faster

Compared to 1.9.0 (07/18/05)
New Avg Old Avg Analysis Overall Rate (MB/s) 32.895183 32.850093 0.14% Faster Overall Wall Time (s) 0.063158 0.062700 0.73% Slower Overall CPU Time (s) 0.030483 0.029884 1.97% Slower

Database Insertion PASS ? 11/30/2007 ldas-dev 1.9.130 Mary Lei  dims 10,100,1000 failed with metadataAPI core dumps
Compared to 1.9.0 (2007.07.18)
New AvgOld AvgAnalysis
Overall Rate (MB/s)2843.0070354408.823378 64.48% Slower
Overall Wall Time (s)0.2258820.109711205.89% Slower
Compared to 1.8.0 (2005.10.31)
New AvgOld AvgAnalysis
Overall Rate (MB/s)2843.0070354957.501756 57.35% Slower
Overall Wall Time (s)0.2258820.078333288.36% Slower
Compared to 1.7.0 (2005.07.27)
New AvgOld AvgAnalysis
Overall Rate (MB/s)2843.0070356691.935578 42.48% Slower
Overall Wall Time (s)0.2258820.063600355.16% Slower
Database Exception / Misc PASS 11/30/2007 ldas-dev (metaserver) 1.9.130 Mary Lei  Includes 'Unofficial DSO test'
descMetaData PASS 11/30/2007 ldas-dev (metaserver) 1.9.130 Mary Lei  
DMT loop PASS 12/03/2007 ldas-dev 1.9.130 Mary Lei  
Frame Accessors PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei Expected: Total 203 Passed 177 Skipped 0 Failed 26
See PR821 for a current list of unsupported accessors.
Frame Gaps PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei  
Frame dt Check PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei  
Frame Multi-Type/Size PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei Expected 6 failures in tests.
db* Matrix PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei They were found to leak up to 100KB/Job in datacondAPI before.
Wrapper State PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei  
data/putStandAlone Loops PASS 12/03/2007 ldas-dev 1.9.130 Mary Lei  
Memory Check PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei  
data/putStandAlone PASS 11/30/2007 ldas-dev (beowulf) 1.9.130 Mary Lei burstwrapper dso not included. Sometimes see a difference in inspiral job between standalone and pipeline: effective_distance had a value of 0.0 in summ_value table when it should be 1.8066820
Small round-off differeneces in burst DSOs (slope, tfclusters).
putStandAlone Exception PASS 11/30/2007 ldas-dev (metaserver) 1.9.130 Mary Lei 2 process test failed first time; passed on re-run. Dependent on object arrival. The script is repeated 3 times without any ill effects.
Compression PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei Expected no failures.
DC to Frame PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei  
Datacond MDC PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei mlei: 36 emails lost. Need to close mail client before running test. Phil: verified all emails spooled. Expected: Total emails 419, 137 expected to pass, 282 expected to fail, got 0 unexpected results.
FrProc Read/Write PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei  
createRDS PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei "Ran OK with new script createRDSTEST_S3.tcl. Walked" through 1 hour of playground S3 and S5 data for LHO and LLO.
createRDS - merged PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei "Ran OK with new script createRDSTEST_S3.tcl. Walked" through 1 hour of playground S3 data for LHO and LLO.
createRDS - level 2 PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei  Ran OK with new script createRDSTEST_S3.tcl.
RDS verification PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei Runs within 2 hours due to use of cacheGetFrames to check if cache update is complete so no excessive idle time. Fails if cache is being rebuild. Took about 11 hours to run Tested with S5 data. RDS Verification test verifies level 1, 2, multiframe, concat frame and multiconcat frames.
RDS in dataPipeline PASS 12/03/2007 ldas-dev 1.9.130 Mary Lei  
Level 2 RDS in dataPipeline PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei  
Merged RDS in dataPipeline PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei  
NDAS in dataPipeline PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei New largest difference with gcc 4.1.1 is 2.540225e-01 ( 1.4326955e-05-1.1097734e-05/mean )
Error is attributed to linear filter in frameAPI which pre-fetches many more seconds of data from NDAS frames than from raw frames.
Lal/Wrapper Version: test-2004-02-23
Regression tests PASS 11/30/2007 ldas-dev ( sunbuild ) 1.9.130 Mary Lei For pr2953 to cleanup each time, must run as user ldas instead of install. Others run as install. 
Link Check PASS ? 11/30/2007 ldas-dev 1.9.130 Mary Lei List of bad links
Alternate report
Different from last week
Diskcache mangle PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei  Expected caches to differ for /archive, /data and /scratch files that are changing.
Complex data in frames PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei  Passed after setenv MANAGER_REPLY_TIMEOUT 1200000 or else jobs get timed out
Test lsync.tcl and shared objects PASS ?? 12/03/2007 ldas-dev (dataserver-dev) 1.9.133 Mary Lei Ok when run on diskcache host but Rexec gets a huge cache diffs. More script debugging needed. This test is only run without /archive and /data in the mount points as these file systems are constantly having files added and lsync would never finish scanning. caches matched only when I issued a rebuild cache request at diskcache. Expected caches to differ only for some RDSVerify frame directories that does not have timestamp in diskcache. Must be run when there are no active updates to /archive. Otherwise a run does not come to an end. Wait for 20 iterations of directory scanning before comparing cache contents. Expected lsync.cache to agree with .frame.cache for the same mount points and excluded directories.
Test geo frames PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei channel G1:DER_H_QUALITY only has 1 data point so cannot resample; G1:DER_H_HP-EP ok
Test all user commands via tcl socket PASS 11/30/2007 ldas-test 1.9.130 Mary Lei Run TEST ALL CMDS from cmonClient with tcl socket as globus socket does not flush, causing abortJob cmd to not able to get jobId to abort
Frame to ilwd test PASS 11/30/2007 ldas-dev 1.9.130 Mary Lei