LDAS Test Results

d
Test Name Status Date System Version Tester gcc 4.1.1
Data Socket PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei Compared to 1.6.0 (05/24/05)
New Avg Old Avg Analysis Overall Rate (MB/s) 18.865245 14.785482 27.59% Faster Overall Wall Time (s) 0.160892 0.181250 12.65% Faster Overall CPU Time (s) 0.123646 0.113374 8.31% Slower

Compared to 1.7.0 (07/27/05)
New Avg Old Avg Analysis Overall Rate (MB/s) 18.865245 16.605638 13.61% Faster Overall Wall Time (s) 0.160892 0.184687 14.79% Faster Overall CPU Time (s) 0.123646 0.113941 7.85% Slower

Compared to 1.8.0 (11/18/05)
New Avg Old Avg Analysis Overall Rate (MB/s) 18.865245 18.177442 3.78% Faster Overall Wall Time (s) 0.160892 0.148803 7.51% Slower Overall CPU Time (s) 0.123646 0.097015 21.54% Slower

Database Insertion PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei Compared to 1.6.0 (05/24/05)
New Avg Old Avg Analysis Overall Rate (row/s) 3819.892506 7182.562921 46.82% Slower Overall Wall Time (s) 0.086939 0.043134 50.39% Slower

Compared to 1.7.0 (07/27/05)
New Avg Old Avg Analysis Overall Rate (row/s) 3819.892506 7206.827671 47.00% Slower Overall Wall Time (s) 0.086939 0.039537 54.52% Slower

Compared to 1.8.0 (11/18/05)
New Avg Old Avg Analysis Overall Rate (row/s) 3819.892506 5281.696207 27.68% Slower Overall Wall Time (s) 0.086939 0.049207 43.40% Slower
Database Exception / Misc FAIL 01/12/2007 ldas-dev (metaserver) 1.8.427 Mary Lei  
descMetaData PASS 01/12/2007 ldas-dev (metaserver) 1.8.427 Mary Lei  
DMT loop PASS 01/16/2007 ldas-dev 1.8.427 Mary Lei  
Frame Accessors PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei fracc6.tcl modiifed for tRrange; Expected: Total 203 Passed 177 Skipped 0 Failed 26
See PR821 for a current list of unsupported accessors.
Frame Gaps PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei  
Frame dt Check PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei  
Frame Multi-Type/Size PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei Expected 6 failures in tests.
db* Matrix PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei They were found to leak up to 100KB/Job in datacondAPI before.
Wrapper State PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei  
data/putStandAlone Loops PASS 01/16/2007 ldas-dev 1.8.427 Mary Lei  
Memory Check PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei  
data/putStandAlone PASS 01/12/2007 ldas-dev (beowulf) 1.8.427 Mary Lei burstwrapper dso not included. Sometimes see a difference in inspiral job between standalone and pipeline: effective_distance had a value of 0.0 in summ_value table when it should be 1.8066820
Small round-off differeneces in burst DSOs (slope, tfclusters).
data/putStandAlone - Grid FAIL 09/22/2006 ldas-dev 1.8.312 Mary Lei No 64 bit DSo and wrapperAPI. Expect to work for the DSOs that run successfully on Solaris (inspiral, stochastic, tfclusters, slope, kpd).
putStandAlone Exception PASS 01/12/2007 ldas-dev (metaserver) 1.8.427 Mary Lei One of the 3 tests generated a different response in eventmon. The script was repeated 3 times without any ill effects.
Compression PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei Expected no failures.
DC to Frame PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei FrVerify has been fixed to not flag metadata error for site Z.
Datacond MDC PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei Lost 2 emails but jobs completed as expected. Expected: Total emails 419, 137 expected to pass, 282 expected to fail, got 0 unexpected results.
FrProc Read/Write PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei  
createRDS PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei "Walked" through 1 hour of playground S3 data for LHO and LLO.
createRDS - merged PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei "Walked" through 1 hour of playground S3 data for LHO and LLO.
createRDS - level 2 PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei  
RDS verification FAIL 01/12/2007 ldas-dev 1.8.427 Mary Lei New RDS Verification test verifies level 1, 2, multiframe, concat frame and multiconcat frames.
RDS in dataPipeline PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei  
Level 2 RDS in dataPipeline PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei  
Merged RDS in dataPipeline PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei  
NDAS in dataPipeline PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei New largest difference with gcc 4.1.1 is 2.541234e-01 ( 1.4317439e-05-1.1089225e-05/mean )
Error is attributed to linear filter in frameAPI which pre-fetches many more seconds of data from NDAS frames than from raw frames.
Lal/Wrapper Version: test-2004-02-23
Unofficial DSO PASS 01/12/2007 ldas-dev 1.8.427Mary Lei  
Regression tests FAIL 01/12/2006 ldas-dev ( sunbuild ) 1.8.427 Mary Lei  failed with some frames e.g. FrCheck and FrDump
Link Check PASS ? 01/12/2007 ldas-dev 1.8.427 Mary Lei List of bad links
Alternate report
Different from last week
Diskcache mangle PASS ? 01/16/2007 ldas-dev 1.8.427 Mary Lei Need fix: cleared out the files so I cannot get result. Files differ only for frame files in /scratcch S3_RDS directories from createRDS loop test.
Walk through locked segments PASS 01/24/2005 ldas-test 1.4.0 Mary Lei The inspiral DSO was used to query all locked segments of S2 data for three ifos (L1 H1 H2). 7827 jobs went through (expected).
Job failures in mpi and frame were due to datacond being busy and was restarted by manager
4 errors due to missing frames in diskcache (expected).
Complex data in frames PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei  
Test lsync.tcl and shared objects FAIL 01/12/2007 ldas-dev (dataserver-dev) 1.8.427 Mary Lei libdiskscan.so has unresolved symbol _ZN10GenericAPI5LStatERKSsR4stat. Expected caches to differ only for some RDSVerify frame directories that does not have timestamp in diskcache. Must be run when there are no active updates to /archive. Otherwise a run does not come to an end. Wait for 20 iterations of directory scanning before comparing cache contents. Expected lsync.cache to agree with .frame.cache for the same mount points and excluded directories.
Test geo frames PASS 01/12/2006 ldas-dev 1.8.427 Mary Lei Turned off metadata checking. channel G1:DER_H_QUALITY only has 1 data point so cannot resample; G1:DER_H_HP-EP ok
Test all user commands via tclglobus socket PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei Expected burstwrapper dataPipeline to fail in DSO. Need S2 frames for inspiral. Normally run TEST ALL CMDS from cmonClient with GSI channel
Test all nodes and search users PASS 09/30/2005 ldas-dev 1.7.52 Mary Lei Needs to convert this test to globus sockets. Sometimes failed to get all logs from mpi or wrapper. Check Users Nodes from cmonClient. Expected all dataPipelines/wrapper jobs to complete. Sometimes may fail to locate last wrapper log.
Frame to ilwd test PASS 01/12/2007 ldas-dev 1.8.427 Mary Lei  
SFT or trivial DSO only N/A