climateprediction.net home page
Task 16296502

Task 16296502

Name hadcm3n_87ip_1980_40_008516248_0
Workunit 8663760
Created 26 Feb 2014, 16:19:22 UTC
Sent 26 Feb 2014, 16:25:28 UTC
Report deadline 28 May 2014, 23:52:39 UTC
Received 22 Mar 2014, 18:27:29 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1321066
Run time 15 days 7 hours 45 min 4 sec
CPU time 15 days 2 hours 10 min 44 sec
Validate state Invalid
Credit 10,575.36
Device peak FLOPS 3.08 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/jobs/specsw after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/jobs/speclw after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B7684DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4151, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B7577DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4151, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B7771DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4151, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B7679DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4151, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B757EDA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4151, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ip_1980_40_008516248/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B75D9DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4151, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
22 Mar 2014 05:59:35 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 881,280 1,313,219 1.4901
21 Mar 2014 01:34:12 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 855,360 1,274,178 1.4896
20 Mar 2014 04:30:01 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 829,440 1,235,162 1.4892
19 Mar 2014 06:16:18 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 803,520 1,196,184 1.4887
18 Mar 2014 18:34:43 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 777,600 1,157,089 1.4880
17 Mar 2014 19:17:01 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 751,680 1,118,717 1.4883
16 Mar 2014 23:22:57 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 725,760 1,080,382 1.4886
16 Mar 2014 11:47:27 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 699,840 1,041,947 1.4888
16 Mar 2014 00:45:47 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 673,920 1,002,910 1.4882
15 Mar 2014 13:46:49 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 648,000 964,038 1.4877
15 Mar 2014 02:49:45 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 622,080 925,350 1.4875
14 Mar 2014 05:03:18 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 596,160 886,357 1.4868
13 Mar 2014 17:44:32 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 570,240 847,636 1.4865
12 Mar 2014 22:05:36 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 544,320 808,592 1.4855
12 Mar 2014 04:26:49 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 518,400 769,593 1.4846
11 Mar 2014 16:55:35 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 492,480 730,819 1.4840
10 Mar 2014 16:37:20 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 466,560 691,769 1.4827
09 Mar 2014 14:27:07 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 440,640 652,752 1.4814
09 Mar 2014 07:45:38 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 414,720 614,123 1.4808
08 Mar 2014 18:20:31 1316601 16296502 hadcm3n_87ip_1980_40_008516248_0 388,800 575,312 1.4797


©2024 climateprediction.net