climateprediction.net home page
Task 16296488

Task 16296488

Name hadcm3n_87ib_1980_40_008516234_0
Workunit 8663746
Created 26 Feb 2014, 16:19:16 UTC
Sent 26 Feb 2014, 16:25:28 UTC
Report deadline 28 May 2014, 23:52:39 UTC
Received 22 Mar 2014, 18:27:29 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1321066
Run time 9 days 20 hours 36 min 24 sec
CPU time 9 days 17 hours 21 min 1 sec
Validate state Invalid
Credit 6,842.88
Device peak FLOPS 3.08 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/jobs/specsw after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/jobs/speclw after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B757CDA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4152, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B769DDA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4152, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B7624DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4152, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B76A1DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4152, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B7579DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4152, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ib_1980_40_008516234/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B75F6DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4152, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
22 Mar 2014 04:59:25 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 570,240 847,334 1.4859
21 Mar 2014 00:33:56 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 544,320 808,323 1.4850
20 Mar 2014 03:29:48 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 518,400 769,323 1.4840
18 Mar 2014 02:42:35 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 492,480 730,440 1.4832
17 Mar 2014 01:54:24 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 466,560 692,027 1.4833
13 Mar 2014 11:23:31 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 440,640 653,554 1.4832
09 Mar 2014 16:26:29 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 414,720 614,056 1.4807
09 Mar 2014 07:45:38 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 388,800 575,512 1.4802
08 Mar 2014 10:15:21 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 362,880 536,446 1.4783
07 Mar 2014 06:57:40 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 336,960 497,740 1.4771
06 Mar 2014 20:59:27 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 311,040 457,986 1.4724
05 Mar 2014 18:53:02 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 285,120 419,116 1.4700
04 Mar 2014 22:55:25 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 259,200 380,320 1.4673
03 Mar 2014 22:27:17 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 233,280 339,816 1.4567
03 Mar 2014 11:17:56 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 207,360 301,537 1.4542
02 Mar 2014 16:34:20 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 181,440 264,049 1.4553
02 Mar 2014 03:37:20 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 155,520 226,321 1.4553
01 Mar 2014 16:49:31 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 129,600 188,740 1.4563
01 Mar 2014 06:08:58 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 103,680 150,514 1.4517
28 Feb 2014 22:37:49 1316601 16296488 hadcm3n_87ib_1980_40_008516234_0 77,760 111,841 1.4383


©2024 climateprediction.net