The wrapper API on beowulf at Caltech-Dev

Legend:
green ball Normal status or debugging message
yellow ball Notable condition which may be a non-fatal error
orange ball Error condition not fatal to job
red ball Error condition fatal to job
blue ball Notable condition which is not an error
purple ball Currently undefined
email Condition requires email notification of the responsible administrator of this API
telephone Condition requires phone notification of the responsible administrator of this API

Link: API Status Page for Caltech-Dev

04/28/2008-11:19:16 AM PDT 04/28/2008-06:19:16 PM GMT 893441970 LDAS-DEV92854896 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 2905 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search13' nodes: '{beowulf n0} {beowulf n0} {beowulf n0}')}
04/28/2008-11:19:34 AM PDT 04/28/2008-06:19:34 PM GMT 893441988 LDAS-DEV92854898 mpi::newJobCallback {3311 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 3310 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search14' nodes: '{beowulf n0}')}
04/28/2008-11:19:53 AM PDT 04/28/2008-06:19:53 PM GMT 893442007 LDAS-DEV92854901 mpi::newJobCallback {3715 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 3714 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search15' nodes: '{beowulf n0}')}
04/28/2008-11:20:15 AM PDT 04/28/2008-06:20:15 PM GMT 893442029 LDAS-DEV92854903 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 4117 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search16' nodes: '{beowulf n0}')}
04/28/2008-11:20:26 AM PDT 04/28/2008-06:20:26 PM GMT 893442040 LDAS-DEV92854904 mpi::newJobCallback {4521 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 4520 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search01' nodes: '{beowulf n0}')}
04/28/2008-11:20:38 AM PDT 04/28/2008-06:20:38 PM GMT 893442052 LDAS-DEV92854905 mpi::newJobCallback {4924 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 4923 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search02' nodes: '{beowulf n0}')}
04/28/2008-11:21:14 AM PDT 04/28/2008-06:21:14 PM GMT 893442088 LDAS-DEV92854908 mpi::newJobCallback {5328 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 5327 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search03' nodes: '{beowulf n0}')}
04/28/2008-11:21:42 AM PDT 04/28/2008-06:21:42 PM GMT 893442116 LDAS-DEV92854912 mpi::newJobCallback {5732 /ldas/bin/wrapperAPI running on n0 (o) 5733 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 5731 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search04' nodes: '{beowulf n0} {beowulf n0}')}
04/28/2008-11:21:53 AM PDT 04/28/2008-06:21:53 PM GMT 893442127 LDAS-DEV92854910 mpi::newJobCallback {6141 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 6140 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search05' nodes: '{beowulf n0}')}
04/28/2008-11:22:18 AM PDT 04/28/2008-06:22:18 PM GMT 893442152 LDAS-DEV92854913 mpi::newJobCallback {6775 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 6774 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search06' nodes: '{beowulf n0}')}
04/28/2008-11:22:18 AM PDT 04/28/2008-06:22:18 PM GMT 893442152 LDAS-DEV92854914 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 6761 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search07' nodes: '{beowulf n0} {beowulf n0} {beowulf n0}')}
04/28/2008-11:22:43 AM PDT 04/28/2008-06:22:43 PM GMT 893442177 LDAS-DEV92854915 mpi::newJobCallback {7357 /ldas/bin/wrapperAPI running on n0 (o) 7358 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 7356 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search08' nodes: '{beowulf n0} {beowulf n0}')}
04/28/2008-11:22:55 AM PDT 04/28/2008-06:22:55 PM GMT 893442189 LDAS-DEV92854917 mpi::newJobCallback {7762 /ldas/bin/wrapperAPI running on n0 (o) 7763 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 7761 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search09' nodes: '{beowulf n0} {beowulf n0}')}
05/02/2008-10:56:29 AM PDT 05/02/2008-05:56:29 PM GMT 893786203 LDAS-DEV92972490 mpi::newJobCallback {15909 /ldas/bin/wrapperAPI running on n0 (o) 15910 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 15908 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search01' nodes: '{beowulf n0} {beowulf n0}')}
05/02/2008-10:56:45 AM PDT 05/02/2008-05:56:45 PM GMT 893786219 LDAS-DEV92972491 mpi::newJobCallback {16314 /ldas/bin/wrapperAPI running on n0 (o) 16315 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 16313 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search02' nodes: '{beowulf n0} {beowulf n0}')}
05/02/2008-10:59:03 AM PDT 05/02/2008-05:59:03 PM GMT 893786357 LDAS-DEV92972497 mpi::newJobCallback {16724 /ldas/bin/wrapperAPI running on n0 (o) 16725 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 16723 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search03' nodes: '{beowulf n0} {beowulf n0}')}
05/02/2008-10:59:22 AM PDT 05/02/2008-05:59:22 PM GMT 893786376 LDAS-DEV92972499 mpi::newJobCallback {17129 /ldas/bin/wrapperAPI running on n0 (o) 17130 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 17128 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search04' nodes: '{beowulf n0} {beowulf n0}')}
05/02/2008-10:59:41 AM PDT 05/02/2008-05:59:41 PM GMT 893786395 LDAS-DEV92972500 mpi::newJobCallback {17533 /ldas/bin/wrapperAPI running on n0 (o) 17534 /ldas/bin/wrapperAPI running on n0 (o) 17535 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 17533 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search05' nodes: '{beowulf n0} {beowulf n0}')}
05/02/2008-11:00:01 AM PDT 05/02/2008-06:00:01 PM GMT 893786415 LDAS-DEV92972501 mpi::newJobCallback {17939 /ldas/bin/wrapperAPI running on n0 (o) 17940 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 17938 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search06' nodes: '{beowulf n0} {beowulf n0}')}
05/02/2008-11:00:44 AM PDT 05/02/2008-06:00:44 PM GMT 893786458 LDAS-DEV92972502 mpi::newJobCallback {18344 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 18343 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search07' nodes: '{beowulf n0}')}
05/02/2008-11:01:20 AM PDT 05/02/2008-06:01:20 PM GMT 893786494 LDAS-DEV92972503 mpi::newJobCallback {18757 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 18756 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search08' nodes: '{beowulf n0}')}
05/02/2008-11:02:06 AM PDT 05/02/2008-06:02:06 PM GMT 893786540 LDAS-DEV92972504 mpi::newJobCallback {19161 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 19160 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search09' nodes: '{beowulf n0}')}
05/02/2008-11:02:53 AM PDT 05/02/2008-06:02:53 PM GMT 893786587 LDAS-DEV92972505 mpi::newJobCallback {19565 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 19564 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search10' nodes: '{beowulf n0}')}
05/02/2008-11:03:45 AM PDT 05/02/2008-06:03:45 PM GMT 893786639 LDAS-DEV92972506 mpi::newJobCallback {19969 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 19968 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search11' nodes: '{beowulf n0}')}
05/02/2008-11:04:46 AM PDT 05/02/2008-06:04:46 PM GMT 893786700 LDAS-DEV92972515 mpi::newJobCallback {20373 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 20372 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search12' nodes: '{beowulf n0}')}
05/02/2008-11:07:33 AM PDT 05/02/2008-06:07:33 PM GMT 893786867 LDAS-DEV92972529 mpi::newJobCallback {20779 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 20778 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search13' nodes: '{beowulf n0}')}
05/02/2008-11:08:18 AM PDT 05/02/2008-06:08:18 PM GMT 893786912 LDAS-DEV92972534 mpi::newJobCallback {21183 /ldas/bin/wrapperAPI running on n0 (o) 21184 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 21182 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search14' nodes: '{beowulf n0} {beowulf n0}')}
05/02/2008-11:09:05 AM PDT 05/02/2008-06:09:05 PM GMT 893786959 LDAS-DEV92972535 mpi::newJobCallback {21589 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 21588 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search15' nodes: '{beowulf n0}')}
05/02/2008-11:09:36 AM PDT 05/02/2008-06:09:36 PM GMT 893786990 LDAS-DEV92972537 mpi::newJobCallback {21993 /ldas/bin/wrapperAPI running on n0 (o) 21994 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 21992 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search16' nodes: '{beowulf n0} {beowulf n0}')}
05/02/2008-11:24:47 AM PDT 05/02/2008-06:24:47 PM GMT 893787901 LDAS-DEV92972696 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 22413 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search01' nodes: '{beowulf n0} {beowulf n0} {beowulf n0}')}
05/02/2008-11:25:03 AM PDT 05/02/2008-06:25:03 PM GMT 893787917 LDAS-DEV92972697 mpi::newJobCallback {22820 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 22819 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search02' nodes: '{beowulf n0}')}
05/02/2008-11:25:24 AM PDT 05/02/2008-06:25:24 PM GMT 893787938 LDAS-DEV92972698 mpi::newJobCallback {23223 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 23222 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search03' nodes: '{beowulf n0}')}
05/02/2008-11:25:42 AM PDT 05/02/2008-06:25:42 PM GMT 893787956 LDAS-DEV92972699 mpi::newJobCallback {23626 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 23625 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search04' nodes: '{beowulf n0}')}
05/02/2008-11:25:58 AM PDT 05/02/2008-06:25:58 PM GMT 893787972 LDAS-DEV92972700 mpi::newJobCallback {24029 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 24028 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search05' nodes: '{beowulf n0}')}
05/02/2008-11:26:16 AM PDT 05/02/2008-06:26:16 PM GMT 893787990 LDAS-DEV92972701 mpi::newJobCallback {24433 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 24432 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search06' nodes: '{beowulf n0}')}
05/02/2008-11:26:55 AM PDT 05/02/2008-06:26:55 PM GMT 893788029 LDAS-DEV92972702 mpi::newJobCallback {24836 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 24835 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search07' nodes: '{beowulf n0}')}
05/02/2008-11:27:16 AM PDT 05/02/2008-06:27:16 PM GMT 893788050 LDAS-DEV92972703 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 25240 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search08' nodes: '{beowulf n0} {beowulf n0} {beowulf n0}')}
05/02/2008-11:27:38 AM PDT 05/02/2008-06:27:38 PM GMT 893788072 LDAS-DEV92972704 mpi::newJobCallback {25648 /ldas/bin/wrapperAPI running on n0 (o) 25649 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 25647 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search09' nodes: '{beowulf n0} {beowulf n0}')}
05/09/2008-10:32:25 AM PDT 05/09/2008-05:32:25 PM GMT 894389559 LDAS-DEV93230982 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 20688 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search01' nodes: '{beowulf n0} {beowulf n0}')}
05/09/2008-10:32:45 AM PDT 05/09/2008-05:32:45 PM GMT 894389579 LDAS-DEV93230983 mpi::newJobCallback {21094 /ldas/bin/wrapperAPI running on n0 (o) 21095 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 21093 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search02' nodes: '{beowulf n0} {beowulf n0}')}
05/09/2008-10:35:09 AM PDT 05/09/2008-05:35:09 PM GMT 894389723 LDAS-DEV93230990 mpi::newJobCallback {21502 /ldas/bin/wrapperAPI running on n0 (o) 21503 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 21501 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search03' nodes: '{beowulf n0} {beowulf n0}')}
05/09/2008-10:35:28 AM PDT 05/09/2008-05:35:28 PM GMT 894389742 LDAS-DEV93230991 mpi::newJobCallback {21908 /ldas/bin/wrapperAPI running on n0 (o) 21909 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 21907 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search04' nodes: '{beowulf n0} {beowulf n0}')}
05/09/2008-10:35:44 AM PDT 05/09/2008-05:35:44 PM GMT 894389758 LDAS-DEV93230992 mpi::newJobCallback {22313 /ldas/bin/wrapperAPI running on n0 (o) 22314 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 22312 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search05' nodes: '{beowulf n0} {beowulf n0}')}
05/09/2008-10:36:04 AM PDT 05/09/2008-05:36:04 PM GMT 894389778 LDAS-DEV93230993 mpi::newJobCallback {22718 /ldas/bin/wrapperAPI running on n0 (o) 22719 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 22717 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search06' nodes: '{beowulf n0} {beowulf n0}')}
05/09/2008-10:37:00 AM PDT 05/09/2008-05:37:00 PM GMT 894389834 LDAS-DEV93230994 mpi::newJobCallback {23123 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 23122 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search07' nodes: '{beowulf n0}')}
05/09/2008-10:37:22 AM PDT 05/09/2008-05:37:22 PM GMT 894389856 LDAS-DEV93230995 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 23525 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search08' nodes: '{beowulf n0}')}
05/09/2008-10:37:43 AM PDT 05/09/2008-05:37:43 PM GMT 894389877 LDAS-DEV93230996 mpi::newJobCallback {23929 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 23928 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search09' nodes: '{beowulf n0}')}
05/09/2008-10:38:03 AM PDT 05/09/2008-05:38:03 PM GMT 894389897 LDAS-DEV93230998 mpi::newJobCallback {24333 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 24332 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search10' nodes: '{beowulf n0}')}
05/09/2008-10:38:23 AM PDT 05/09/2008-05:38:23 PM GMT 894389917 LDAS-DEV93230999 mpi::newJobCallback {24736 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 24735 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search11' nodes: '{beowulf n0}')}
05/09/2008-10:39:24 AM PDT 05/09/2008-05:39:24 PM GMT 894389978 LDAS-DEV93231006 mpi::newJobCallback {25141 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 25140 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search12' nodes: '{beowulf n0}')}
05/09/2008-10:42:43 AM PDT 05/09/2008-05:42:43 PM GMT 894390177 LDAS-DEV93231020 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 25545 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search13' nodes: '{beowulf n0}')}
05/09/2008-10:43:21 AM PDT 05/09/2008-05:43:21 PM GMT 894390215 LDAS-DEV93231027 mpi::newJobCallback {25951 /ldas/bin/wrapperAPI running on n0 (o) 25952 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 25950 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search14' nodes: '{beowulf n0} {beowulf n0}')}
05/09/2008-10:44:09 AM PDT 05/09/2008-05:44:09 PM GMT 894390263 LDAS-DEV93231028 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 26355 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search15' nodes: '{beowulf n0}')}
05/09/2008-10:44:44 AM PDT 05/09/2008-05:44:44 PM GMT 894390298 LDAS-DEV93231030 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 26760 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search16' nodes: '{beowulf n0} {beowulf n0}')}
05/09/2008-10:49:42 AM PDT 05/09/2008-05:49:42 PM GMT 894390596 LDAS-DEV93231125 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 27170 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search01' nodes: '{beowulf n0} {beowulf n0} {beowulf n0}')}
05/09/2008-10:50:00 AM PDT 05/09/2008-05:50:00 PM GMT 894390614 LDAS-DEV93231138 mpi::newJobCallback {27577 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 27576 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search02' nodes: '{beowulf n0}')}
05/09/2008-10:50:21 AM PDT 05/09/2008-05:50:21 PM GMT 894390635 LDAS-DEV93231146 mpi::newJobCallback {27981 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 27980 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search03' nodes: '{beowulf n0}')}
05/09/2008-10:50:39 AM PDT 05/09/2008-05:50:39 PM GMT 894390653 LDAS-DEV93231155 mpi::newJobCallback {28384 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 28383 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search04' nodes: '{beowulf n0}')}
05/09/2008-10:50:56 AM PDT 05/09/2008-05:50:56 PM GMT 894390670 LDAS-DEV93231161 mpi::newJobCallback {28787 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 28786 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search05' nodes: '{beowulf n0}')}
05/09/2008-10:51:13 AM PDT 05/09/2008-05:51:13 PM GMT 894390687 LDAS-DEV93231169 mpi::newJobCallback {29190 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 29189 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search06' nodes: '{beowulf n0}')}
05/09/2008-10:51:47 AM PDT 05/09/2008-05:51:47 PM GMT 894390721 LDAS-DEV93231177 mpi::newJobCallback {29594 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 29593 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search07' nodes: '{beowulf n0}')}
05/09/2008-10:52:10 AM PDT 05/09/2008-05:52:10 PM GMT 894390744 LDAS-DEV93231185 mpi::newJobCallback {29999 /ldas/bin/wrapperAPI running on n0 (o) 30000 /ldas/bin/wrapperAPI running on n0 (o) 30001 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 29998 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search08' nodes: '{beowulf n0} {beowulf n0} {beowulf n0}')}
05/09/2008-10:52:44 AM PDT 05/09/2008-05:52:44 PM GMT 894390778 LDAS-DEV93231187 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 30405 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search09' nodes: '{beowulf n0} {beowulf n0}')}
05/19/2008-11:18:58 AM PDT 05/19/2008-06:18:58 PM GMT 895256352 LDAS-DEV93548504 mpi::newJobCallback {21450 /ldas/bin/wrapperAPI running on n0 (o) 21451 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 21449 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search01' nodes: '{beowulf n0} {beowulf n0}')}
05/19/2008-11:19:45 AM PDT 05/19/2008-06:19:45 PM GMT 895256399 LDAS-DEV93548509 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 21855 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search02' nodes: '{beowulf n0} {beowulf n0}')}
05/19/2008-11:26:42 AM PDT 05/19/2008-06:26:42 PM GMT 895256816 LDAS-DEV93548565 mpi::newJobCallback {22268 /ldas/bin/wrapperAPI running on n0 (o) 22269 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 22267 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search03' nodes: '{beowulf n0} {beowulf n0}')}
05/19/2008-11:27:57 AM PDT 05/19/2008-06:27:57 PM GMT 895256891 LDAS-DEV93548574 mpi::newJobCallback {22675 /ldas/bin/wrapperAPI running on n0 (o) 22676 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 22674 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search04' nodes: '{beowulf n0} {beowulf n0}')}
05/19/2008-11:29:11 AM PDT 05/19/2008-06:29:11 PM GMT 895256965 LDAS-DEV93548587 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 23080 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search05' nodes: '{beowulf n0} {beowulf n0}')}
05/19/2008-11:30:15 AM PDT 05/19/2008-06:30:15 PM GMT 895257029 LDAS-DEV93548597 mpi::newJobCallback {23486 /ldas/bin/wrapperAPI running on n0 (o) 23487 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 23485 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search06' nodes: '{beowulf n0} {beowulf n0}')}
05/19/2008-11:33:01 AM PDT 05/19/2008-06:33:01 PM GMT 895257195 LDAS-DEV93548606 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 23893 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search07' nodes: '{beowulf n0}')}
05/19/2008-11:35:33 AM PDT 05/19/2008-06:35:33 PM GMT 895257347 LDAS-DEV93548629 mpi::newJobCallback {24299 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 24298 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search08' nodes: '{beowulf n0}')}
05/19/2008-11:38:39 AM PDT 05/19/2008-06:38:39 PM GMT 895257533 LDAS-DEV93548664 mpi::newJobCallback {24705 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 24704 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search09' nodes: '{beowulf n0}')}
05/19/2008-12:06:49 PM PDT 05/19/2008-07:06:49 PM GMT 895259223 LDAS-DEV93548914 mpi::newJobCallback {25148 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 25147 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search10' nodes: '{beowulf n0}')}
05/19/2008-12:09:05 PM PDT 05/19/2008-07:09:05 PM GMT 895259359 LDAS-DEV93548932 mpi::newJobCallback {25554 /ldas/bin/wrapperAPI running on n0 (o) 25555 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 25553 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search11' nodes: '{beowulf n0} {beowulf n0}')}
05/19/2008-12:11:46 PM PDT 05/19/2008-07:11:46 PM GMT 895259520 LDAS-DEV93548944 mpi::newJobCallback {25961 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 25960 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search12' nodes: '{beowulf n0}')}
05/19/2008-12:13:02 PM PDT 05/19/2008-07:13:02 PM GMT 895259596 LDAS-DEV93548972 mpi::newJobCallback {26366 /ldas/bin/wrapperAPI running on n0 (o) 26367 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 26365 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search13' nodes: '{beowulf n0} {beowulf n0}')}
05/19/2008-01:27:54 PM PDT 05/19/2008-08:27:54 PM GMT 895264088 LDAS-DEV93549714 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 26858 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search14' nodes: '{beowulf n0} {beowulf n0} {beowulf n0}')}
05/19/2008-01:28:19 PM PDT 05/19/2008-08:28:19 PM GMT 895264113 LDAS-DEV93549734 mpi::newJobCallback {27269 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 27268 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search15' nodes: '{beowulf n0}')}
05/19/2008-01:29:06 PM PDT 05/19/2008-08:29:06 PM GMT 895264160 LDAS-DEV93549738 mpi::newJobCallback {27673 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 27672 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search16' nodes: '{beowulf n0}')}
05/19/2008-01:29:44 PM PDT 05/19/2008-08:29:44 PM GMT 895264198 LDAS-DEV93549745 mpi::newJobCallback {28076 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 28075 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search01' nodes: '{beowulf n0}')}
05/19/2008-01:30:31 PM PDT 05/19/2008-08:30:31 PM GMT 895264245 LDAS-DEV93549750 mpi::newJobCallback {28480 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 28479 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search02' nodes: '{beowulf n0}')}
05/19/2008-01:31:04 PM PDT 05/19/2008-08:31:04 PM GMT 895264278 LDAS-DEV93549759 mpi::newJobCallback {28883 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 28882 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search03' nodes: '{beowulf n0}')}
05/19/2008-01:33:27 PM PDT 05/19/2008-08:33:27 PM GMT 895264421 LDAS-DEV93549765 mpi::newJobCallback {29289 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 29288 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search04' nodes: '{beowulf n0}')}
05/19/2008-01:34:08 PM PDT 05/19/2008-08:34:08 PM GMT 895264462 LDAS-DEV93549782 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 29694 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search05' nodes: '{beowulf n0} {beowulf n0} {beowulf n0}')}
05/19/2008-01:35:03 PM PDT 05/19/2008-08:35:03 PM GMT 895264517 LDAS-DEV93549791 mpi::newJobCallback {30102 /ldas/bin/wrapperAPI running on n0 (o) 30103 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 30101 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search06' nodes: '{beowulf n0} {beowulf n0}')}
05/21/2008-11:09:05 AM PDT 05/21/2008-06:09:05 PM GMT 895428559 LDAS-DEV93571682 mpi::newJobCallback {24824 /ldas/bin/wrapperAPI running on n0 (o) 24825 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 24823 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search01' nodes: '{beowulf n0} {beowulf n0}')}
05/21/2008-11:09:40 AM PDT 05/21/2008-06:09:40 PM GMT 895428594 LDAS-DEV93571683 mpi::newJobCallback {25230 /ldas/bin/wrapperAPI running on n0 (o) 25231 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 25229 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search02' nodes: '{beowulf n0} {beowulf n0}')}
05/21/2008-11:10:11 AM PDT 05/21/2008-06:10:11 PM GMT 895428625 LDAS-DEV93571684 mpi::newJobCallback {25636 /ldas/bin/wrapperAPI running on n0 (o) 25637 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 25635 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search03' nodes: '{beowulf n0} {beowulf n0}')}
05/21/2008-11:10:49 AM PDT 05/21/2008-06:10:49 PM GMT 895428663 LDAS-DEV93571685 mpi::newJobCallback {26042 /ldas/bin/wrapperAPI running on n0 (o) 26043 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 26041 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search04' nodes: '{beowulf n0} {beowulf n0}')}
05/21/2008-11:12:09 AM PDT 05/21/2008-06:12:09 PM GMT 895428743 LDAS-DEV93571687 mpi::newJobCallback {26447 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 26446 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search05' nodes: '{beowulf n0}')}
05/21/2008-11:13:26 AM PDT 05/21/2008-06:13:26 PM GMT 895428820 LDAS-DEV93571688 mpi::newJobCallback {26851 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 26850 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search06' nodes: '{beowulf n0}')}
05/21/2008-11:15:07 AM PDT 05/21/2008-06:15:07 PM GMT 895428921 LDAS-DEV93571695 mpi::newJobCallback {27256 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 27255 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search07' nodes: '{beowulf n0}')}
05/21/2008-11:20:50 AM PDT 05/21/2008-06:20:50 PM GMT 895429264 LDAS-DEV93571711 mpi::newJobCallback {27665 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 27664 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search08' nodes: '{beowulf n0}')}
05/21/2008-11:22:02 AM PDT 05/21/2008-06:22:02 PM GMT 895429336 LDAS-DEV93571716 mpi::newJobCallback {28070 /ldas/bin/wrapperAPI running on n0 (o) 28071 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 28069 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search09' nodes: '{beowulf n0} {beowulf n0}')}
05/21/2008-11:23:43 AM PDT 05/21/2008-06:23:43 PM GMT 895429437 LDAS-DEV93571717 mpi::newJobCallback {28475 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 28474 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search10' nodes: '{beowulf n0}')}
05/21/2008-11:49:40 AM PDT 05/21/2008-06:49:40 PM GMT 895430994 LDAS-DEV93571871 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 28905 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search11' nodes: '{beowulf n0} {beowulf n0} {beowulf n0}')}
05/21/2008-11:50:14 AM PDT 05/21/2008-06:50:14 PM GMT 895431028 LDAS-DEV93571873 mpi::newJobCallback {29311 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 29310 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search12' nodes: '{beowulf n0}')}
05/21/2008-11:50:36 AM PDT 05/21/2008-06:50:36 PM GMT 895431050 LDAS-DEV93571874 mpi::newJobCallback {29715 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 29714 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search13' nodes: '{beowulf n0}')}
05/21/2008-11:51:02 AM PDT 05/21/2008-06:51:02 PM GMT 895431076 LDAS-DEV93571875 mpi::newJobCallback {30118 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 30117 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search14' nodes: '{beowulf n0}')}
05/21/2008-11:51:21 AM PDT 05/21/2008-06:51:21 PM GMT 895431095 LDAS-DEV93571876 mpi::newJobCallback {30522 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 30521 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search15' nodes: '{beowulf n0}')}
05/21/2008-11:52:22 AM PDT 05/21/2008-06:52:22 PM GMT 895431156 LDAS-DEV93571877 mpi::newJobCallback {30926 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 30925 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search16' nodes: '{beowulf n0}')}
05/21/2008-11:52:46 AM PDT 05/21/2008-06:52:46 PM GMT 895431180 LDAS-DEV93571878 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 31331 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search01' nodes: '{beowulf n0} {beowulf n0} {beowulf n0}')}
05/21/2008-11:53:11 AM PDT 05/21/2008-06:53:11 PM GMT 895431205 LDAS-DEV93571879 mpi::newJobCallback {31738 /ldas/bin/wrapperAPI running on n0 (o) 31739 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 31737 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search02' nodes: '{beowulf n0} {beowulf n0}')}
05/30/2008-10:21:30 AM PDT 05/30/2008-05:21:30 PM GMT 896203304 LDAS-DEV93822528 mpi::newJobCallback {15500 /ldas/bin/wrapperAPI running on n0 (o) 15501 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 15499 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search01' nodes: '{beowulf n0} {beowulf n0}')}
05/30/2008-10:21:57 AM PDT 05/30/2008-05:21:57 PM GMT 896203331 LDAS-DEV93822530 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 15905 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search02' nodes: '{beowulf n0} {beowulf n0}')}
05/30/2008-10:22:20 AM PDT 05/30/2008-05:22:20 PM GMT 896203354 LDAS-DEV93822531 mpi::newJobCallback {16311 /ldas/bin/wrapperAPI running on n0 (o) 16312 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 16310 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search03' nodes: '{beowulf n0} {beowulf n0}')}
05/30/2008-10:22:46 AM PDT 05/30/2008-05:22:46 PM GMT 896203380 LDAS-DEV93822532 mpi::newJobCallback {16716 /ldas/bin/wrapperAPI running on n0 (o) 16717 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 16715 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search04' nodes: '{beowulf n0} {beowulf n0}')}
05/30/2008-10:23:29 AM PDT 05/30/2008-05:23:29 PM GMT 896203423 LDAS-DEV93822533 mpi::newJobCallback {17121 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 17120 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search05' nodes: '{beowulf n0}')}
05/30/2008-10:24:15 AM PDT 05/30/2008-05:24:15 PM GMT 896203469 LDAS-DEV93822535 mpi::newJobCallback {17525 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 17524 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search06' nodes: '{beowulf n0}')}
05/30/2008-10:25:00 AM PDT 05/30/2008-05:25:00 PM GMT 896203514 LDAS-DEV93822536 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 17927 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search07' nodes: '{beowulf n0}')}
05/30/2008-10:25:46 AM PDT 05/30/2008-05:25:46 PM GMT 896203560 LDAS-DEV93822537 mpi::newJobCallback {18333 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 18332 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search08' nodes: '{beowulf n0}')}
05/30/2008-10:26:29 AM PDT 05/30/2008-05:26:29 PM GMT 896203603 LDAS-DEV93822538 mpi::newJobCallback {18736 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 18735 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search09' nodes: '{beowulf n0}')}
05/30/2008-10:27:40 AM PDT 05/30/2008-05:27:40 PM GMT 896203674 LDAS-DEV93822545 mpi::newJobCallback {19140 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 19139 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search10' nodes: '{beowulf n0}')}
05/30/2008-10:31:44 AM PDT 05/30/2008-05:31:44 PM GMT 896203918 LDAS-DEV93822560 mpi::newJobCallback {19548 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 19547 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search11' nodes: '{beowulf n0}')}
05/30/2008-10:32:41 AM PDT 05/30/2008-05:32:41 PM GMT 896203975 LDAS-DEV93822566 mpi::newJobCallback {19952 /ldas/bin/wrapperAPI running on n0 (o) 19953 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 19951 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search12' nodes: '{beowulf n0} {beowulf n0}')}
05/30/2008-10:33:29 AM PDT 05/30/2008-05:33:29 PM GMT 896204023 LDAS-DEV93822567 mpi::newJobCallback {20357 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 20356 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search13' nodes: '{beowulf n0}')}
05/30/2008-10:37:48 AM PDT 05/30/2008-05:37:48 PM GMT 896204282 LDAS-DEV93822576 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 20766 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search14' nodes: '{beowulf n0} {beowulf n0} {beowulf n0}')}
05/30/2008-10:38:15 AM PDT 05/30/2008-05:38:15 PM GMT 896204309 LDAS-DEV93822578 mpi::newJobCallback {21172 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 21171 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search15' nodes: '{beowulf n0}')}
05/30/2008-10:38:34 AM PDT 05/30/2008-05:38:34 PM GMT 896204328 LDAS-DEV93822579 mpi::newJobCallback {21575 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 21574 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search16' nodes: '{beowulf n0}')}
05/30/2008-10:38:54 AM PDT 05/30/2008-05:38:54 PM GMT 896204348 LDAS-DEV93822580 mpi::newJobCallback {21979 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 21978 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search01' nodes: '{beowulf n0}')}
05/30/2008-10:39:13 AM PDT 05/30/2008-05:39:13 PM GMT 896204367 LDAS-DEV93822581 mpi::newJobCallback {22382 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 22381 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search02' nodes: '{beowulf n0}')}
05/30/2008-10:39:52 AM PDT 05/30/2008-05:39:52 PM GMT 896204406 LDAS-DEV93822586 mpi::newJobCallback {22785 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 22784 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search03' nodes: '{beowulf n0}')}
05/30/2008-10:40:14 AM PDT 05/30/2008-05:40:14 PM GMT 896204428 LDAS-DEV93822588 mpi::newJobCallback {----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 23190 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search04' nodes: '{beowulf n0} {beowulf n0} {beowulf n0}')}
05/30/2008-10:40:36 AM PDT 05/30/2008-05:40:36 PM GMT 896204450 LDAS-DEV93822589 mpi::newJobCallback {23597 /ldas/bin/wrapperAPI running on n0 (o) 23598 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 23596 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search05' nodes: '{beowulf n0} {beowulf n0}')}
05/30/2008-10:43:10 AM PDT 05/30/2008-05:43:10 PM GMT 896204604 LDAS-DEV93822604 mpi::newJobCallback {24005 /ldas/bin/wrapperAPI running on n0 (o) 24006 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 24004 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search06' nodes: '{beowulf n0} {beowulf n0}')}
05/30/2008-10:43:33 AM PDT 05/30/2008-05:43:33 PM GMT 896204627 LDAS-DEV93822606 mpi::newJobCallback {24410 /ldas/bin/wrapperAPI running on n0 (o) 24411 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 24409 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search07' nodes: '{beowulf n0} {beowulf n0}')}
05/30/2008-10:43:53 AM PDT 05/30/2008-05:43:53 PM GMT 896204647 LDAS-DEV93822612 mpi::newJobCallback {24816 /ldas/bin/wrapperAPI running on n0 (o) 24817 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 24815 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search08' nodes: '{beowulf n0} {beowulf n0}')}
05/30/2008-10:44:34 AM PDT 05/30/2008-05:44:34 PM GMT 896204688 LDAS-DEV93822616 mpi::newJobCallback {25220 /ldas/bin/wrapperAPI running on n0 (o) ----------------------------------------------------------------------------- The selected RPI failed to initialize during MPI_INIT. This is a fatal error; I must abort. This occurred on host beowulf (n0). The PID of failed process was 25219 (MPI_COMM_WORLD rank: 0) ----------------------------------------------------------------------------- (user: 'search09' nodes: '{beowulf n0}')}