<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
/home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001464
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001464
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001464
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001476
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001476
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001476
Zipping up the intermediate file: /home/kari/projects/climateprediction.net/oifs_43r3_ps_0771_2013050100_123_982_12199415_1_r1009835292_56.zip
Uploading the intermediate file: upload_file_56.zip
20:40:10 STEP 1489 H=1489:00 +CPU= 13.029
20:40:23 STEP 1490 H=1490:00 +CPU= 13.416
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:40:46 STEP 1491 H=1491:00 +CPU= 20.912
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:41:02 STEP 1492 H=1492:00 +CPU= 13.476
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:41:17 STEP 1493 H=1493:00 +CPU= 13.000
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:41:40 STEP 1494 H=1494:00 +CPU= 21.298
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:41:55 STEP 1495 H=1495:00 +CPU= 13.144
20:42:09 STEP 1496 H=1496:00 +CPU= 13.250
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:42:33 STEP 1497 H=1497:00 +CPU= 20.168
20:42:47 STEP 1498 H=1498:00 +CPU= 13.572
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:43:02 STEP 1499 H=1499:00 +CPU= 13.223
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:43:28 STEP 1500 H=1500:00 +CPU= 23.265
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001500
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001500
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001500
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:43:43 STEP 1501 H=1501:00 +CPU= 13.504
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:43:59 STEP 1502 H=1502:00 +CPU= 13.746
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:44:21 STEP 1503 H=1503:00 +CPU= 20.348
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:44:37 STEP 1504 H=1504:00 +CPU= 13.421
20:44:50 STEP 1505 H=1505:00 +CPU= 13.280
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:45:15 STEP 1506 H=1506:00 +CPU= 20.892
20:45:29 STEP 1507 H=1507:00 +CPU= 13.236
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:45:44 STEP 1508 H=1508:00 +CPU= 13.454
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:46:08 STEP 1509 H=1509:00 +CPU= 21.221
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:46:23 STEP 1510 H=1510:00 +CPU= 13.702
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:46:39 STEP 1511 H=1511:00 +CPU= 13.665
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:47:06 STEP 1512 H=1512:00 +CPU= 24.861
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001512
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001512
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001512
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001488
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001488
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001488
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001500
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001500
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001500
Zipping up the intermediate file: /home/kari/projects/climateprediction.net/oifs_43r3_ps_0771_2013050100_123_982_12199415_1_r1009835292_57.zip
Uploading the intermediate file: upload_file_57.zip
20:47:22 STEP 1513 H=1513:00 +CPU= 13.567
20:47:36 STEP 1514 H=1514:00 +CPU= 13.780
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:47:58 STEP 1515 H=1515:00 +CPU= 20.651
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:48:14 STEP 1516 H=1516:00 +CPU= 13.865
20:48:28 STEP 1517 H=1517:00 +CPU= 13.567
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:48:53 STEP 1518 H=1518:00 +CPU= 21.101
20:49:06 STEP 1519 H=1519:00 +CPU= 12.913
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:49:22 STEP 1520 H=1520:00 +CPU= 13.313
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:49:44 STEP 1521 H=1521:00 +CPU= 20.159
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:49:59 STEP 1522 H=1522:00 +CPU= 13.314
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:50:14 STEP 1523 H=1523:00 +CPU= 13.013
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:50:39 STEP 1524 H=1524:00 +CPU= 22.457
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001524
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001524
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001524
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:50:54 STEP 1525 H=1525:00 +CPU= 12.961
20:51:07 STEP 1526 H=1526:00 +CPU= 13.396
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:51:30 STEP 1527 H=1527:00 +CPU= 20.266
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:51:45 STEP 1528 H=1528:00 +CPU= 13.335
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:52:00 STEP 1529 H=1529:00 +CPU= 13.292
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:52:24 STEP 1530 H=1530:00 +CPU= 20.914
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:52:39 STEP 1531 H=1531:00 +CPU= 13.435
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:52:55 STEP 1532 H=1532:00 +CPU= 13.604
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:53:18 STEP 1533 H=1533:00 +CPU= 20.763
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:53:33 STEP 1534 H=1534:00 +CPU= 13.525
20:53:46 STEP 1535 H=1535:00 +CPU= 13.311
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:54:15 STEP 1536 H=1536:00 +CPU= 24.343
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001536
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001536
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001536
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001512
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001512
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001512
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001524
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001524
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001524
Zipping up the intermediate file: /home/kari/projects/climateprediction.net/oifs_43r3_ps_0771_2013050100_123_982_12199415_1_r1009835292_58.zip
Uploading the intermediate file: upload_file_58.zip
20:54:28 STEP 1537 H=1537:00 +CPU= 12.942
Uploading trickle at timestep: 5529600
20:54:42 STEP 1538 H=1538:00 +CPU= 13.523
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:55:04 STEP 1539 H=1539:00 +CPU= 20.509
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:55:20 STEP 1540 H=1540:00 +CPU= 13.800
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:55:36 STEP 1541 H=1541:00 +CPU= 13.733
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:56:00 STEP 1542 H=1542:00 +CPU= 21.794
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:56:16 STEP 1543 H=1543:00 +CPU= 13.494
20:56:30 STEP 1544 H=1544:00 +CPU= 13.962
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:56:55 STEP 1545 H=1545:00 +CPU= 20.922
20:57:08 STEP 1546 H=1546:00 +CPU= 13.566
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:57:24 STEP 1547 H=1547:00 +CPU= 13.387
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:57:49 STEP 1548 H=1548:00 +CPU= 23.075
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001548
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001548
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001548
20:58:04 STEP 1549 H=1549:00 +CPU= 13.020
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:58:20 STEP 1550 H=1550:00 +CPU= 13.567
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:58:42 STEP 1551 H=1551:00 +CPU= 20.347
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:58:58 STEP 1552 H=1552:00 +CPU= 13.571
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:59:13 STEP 1553 H=1553:00 +CPU= 13.245
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:59:36 STEP 1554 H=1554:00 +CPU= 21.044
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
20:59:52 STEP 1555 H=1555:00 +CPU= 13.323
21:00:06 STEP 1556 H=1556:00 +CPU= 14.029
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:00:29 STEP 1557 H=1557:00 +CPU= 21.012
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:00:46 STEP 1558 H=1558:00 +CPU= 14.467
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:01:01 STEP 1559 H=1559:00 +CPU= 13.704
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:01:28 STEP 1560 H=1560:00 +CPU= 24.294
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001560
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001560
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001560
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001536
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001536
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001536
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001548
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001548
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001548
Zipping up the intermediate file: /home/kari/projects/climateprediction.net/oifs_43r3_ps_0771_2013050100_123_982_12199415_1_r1009835292_59.zip
Uploading the intermediate file: upload_file_59.zip
21:01:43 STEP 1561 H=1561:00 +CPU= 13.187
21:01:56 STEP 1562 H=1562:00 +CPU= 13.283
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:02:19 STEP 1563 H=1563:00 +CPU= 20.284
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:02:34 STEP 1564 H=1564:00 +CPU= 13.325
21:02:47 STEP 1565 H=1565:00 +CPU= 12.939
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:03:12 STEP 1566 H=1566:00 +CPU= 20.589
21:03:25 STEP 1567 H=1567:00 +CPU= 13.328
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:03:41 STEP 1568 H=1568:00 +CPU= 13.625
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:04:04 STEP 1569 H=1569:00 +CPU= 20.534
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:04:19 STEP 1570 H=1570:00 +CPU= 13.548
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:04:34 STEP 1571 H=1571:00 +CPU= 13.073
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:04:59 STEP 1572 H=1572:00 +CPU= 22.515
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001572
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001572
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001572
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:05:14 STEP 1573 H=1573:00 +CPU= 12.915
21:05:27 STEP 1574 H=1574:00 +CPU= 13.302
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:05:52 STEP 1575 H=1575:00 +CPU= 20.496
21:06:06 STEP 1576 H=1576:00 +CPU= 13.701
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:06:21 STEP 1577 H=1577:00 +CPU= 13.309
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:06:44 STEP 1578 H=1578:00 +CPU= 21.211
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:07:00 STEP 1579 H=1579:00 +CPU= 13.308
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:07:16 STEP 1580 H=1580:00 +CPU= 13.915
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:07:39 STEP 1581 H=1581:00 +CPU= 20.689
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:07:54 STEP 1582 H=1582:00 +CPU= 13.568
21:08:08 STEP 1583 H=1583:00 +CPU= 13.810
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:08:37 STEP 1584 H=1584:00 +CPU= 24.312
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001584
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001584
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001584
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001560
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001560
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001560
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001572
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001572
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001572
Zipping up the intermediate file: /home/kari/projects/climateprediction.net/oifs_43r3_ps_0771_2013050100_123_982_12199415_1_r1009835292_60.zip
Uploading the intermediate file: upload_file_60.zip
21:08:50 STEP 1585 H=1585:00 +CPU= 12.914
21:09:03 STEP 1586 H=1586:00 +CPU= 13.461
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:09:26 STEP 1587 H=1587:00 +CPU= 20.925
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:09:42 STEP 1588 H=1588:00 +CPU= 13.777
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:09:57 STEP 1589 H=1589:00 +CPU= 13.028
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:10:20 STEP 1590 H=1590:00 +CPU= 20.689
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:10:35 STEP 1591 H=1591:00 +CPU= 13.185
21:10:49 STEP 1592 H=1592:00 +CPU= 13.446
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:11:14 STEP 1593 H=1593:00 +CPU= 21.365
21:11:28 STEP 1594 H=1594:00 +CPU= 13.825
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:11:44 STEP 1595 H=1595:00 +CPU= 13.452
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:12:08 STEP 1596 H=1596:00 +CPU= 22.511
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001596
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001596
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001596
21:12:24 STEP 1597 H=1597:00 +CPU= 13.033
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:12:39 STEP 1598 H=1598:00 +CPU= 13.244
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:13:01 STEP 1599 H=1599:00 +CPU= 20.141
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:13:16 STEP 1600 H=1600:00 +CPU= 13.271
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:13:31 STEP 1601 H=1601:00 +CPU= 12.880
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:13:54 STEP 1602 H=1602:00 +CPU= 20.425
21:14:07 STEP 1603 H=1603:00 +CPU= 13.166
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:14:22 STEP 1604 H=1604:00 +CPU= 13.363
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:14:45 STEP 1605 H=1605:00 +CPU= 20.204
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:15:00 STEP 1606 H=1606:00 +CPU= 13.358
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:15:16 STEP 1607 H=1607:00 +CPU= 13.512
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:15:42 STEP 1608 H=1608:00 +CPU= 24.019
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001608
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001608
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001608
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001584
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001584
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001584
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001596
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001596
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001596
Zipping up the intermediate file: /home/kari/projects/climateprediction.net/oifs_43r3_ps_0771_2013050100_123_982_12199415_1_r1009835292_61.zip
Uploading the intermediate file: upload_file_61.zip
21:15:57 STEP 1609 H=1609:00 +CPU= 13.059
21:16:10 STEP 1610 H=1610:00 +CPU= 13.161
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:16:32 STEP 1611 H=1611:00 +CPU= 20.144
21:16:46 STEP 1612 H=1612:00 +CPU= 13.196
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:17:01 STEP 1613 H=1613:00 +CPU= 12.896
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:17:23 STEP 1614 H=1614:00 +CPU= 20.543
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:17:38 STEP 1615 H=1615:00 +CPU= 12.922
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:17:53 STEP 1616 H=1616:00 +CPU= 13.178
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:18:16 STEP 1617 H=1617:00 +CPU= 20.548
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:18:32 STEP 1618 H=1618:00 +CPU= 13.645
21:18:45 STEP 1619 H=1619:00 +CPU= 13.210
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:19:12 STEP 1620 H=1620:00 +CPU= 22.721
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001620
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001620
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001620
21:19:25 STEP 1621 H=1621:00 +CPU= 13.205
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:19:41 STEP 1622 H=1622:00 +CPU= 13.421
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:20:03 STEP 1623 H=1623:00 +CPU= 20.192
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:20:18 STEP 1624 H=1624:00 +CPU= 13.401
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:20:33 STEP 1625 H=1625:00 +CPU= 12.925
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:20:56 STEP 1626 H=1626:00 +CPU= 20.651
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:21:11 STEP 1627 H=1627:00 +CPU= 13.232
21:21:25 STEP 1628 H=1628:00 +CPU= 13.313
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:21:47 STEP 1629 H=1629:00 +CPU= 20.115
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:22:02 STEP 1630 H=1630:00 +CPU= 13.363
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:22:18 STEP 1631 H=1631:00 +CPU= 13.157
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:22:44 STEP 1632 H=1632:00 +CPU= 24.209
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001632
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001632
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001632
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001608
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001608
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001608
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001620
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001620
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001620
Zipping up the intermediate file: /home/kari/projects/climateprediction.net/oifs_43r3_ps_0771_2013050100_123_982_12199415_1_r1009835292_62.zip
Uploading the intermediate file: upload_file_62.zip
21:22:59 STEP 1633 H=1633:00 +CPU= 12.977
21:23:12 STEP 1634 H=1634:00 +CPU= 13.119
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:23:35 STEP 1635 H=1635:00 +CPU= 20.398
21:23:48 STEP 1636 H=1636:00 +CPU= 13.414
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:24:03 STEP 1637 H=1637:00 +CPU= 12.932
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:24:26 STEP 1638 H=1638:00 +CPU= 20.210
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:24:40 STEP 1639 H=1639:00 +CPU= 12.748
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:24:56 STEP 1640 H=1640:00 +CPU= 13.087
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:25:18 STEP 1641 H=1641:00 +CPU= 19.923
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:25:33 STEP 1642 H=1642:00 +CPU= 13.202
21:25:46 STEP 1643 H=1643:00 +CPU= 13.265
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:26:13 STEP 1644 H=1644:00 +CPU= 22.649
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001644
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001644
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001644
21:26:27 STEP 1645 H=1645:00 +CPU= 13.504
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:26:42 STEP 1646 H=1646:00 +CPU= 13.580
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:27:05 STEP 1647 H=1647:00 +CPU= 20.557
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:27:20 STEP 1648 H=1648:00 +CPU= 13.514
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:27:36 STEP 1649 H=1649:00 +CPU= 13.222
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:27:59 STEP 1650 H=1650:00 +CPU= 21.173
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:28:15 STEP 1651 H=1651:00 +CPU= 13.349
21:28:28 STEP 1652 H=1652:00 +CPU= 13.273
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:28:52 STEP 1653 H=1653:00 +CPU= 20.269
21:29:06 STEP 1654 H=1654:00 +CPU= 13.596
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:29:21 STEP 1655 H=1655:00 +CPU= 13.454
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:29:48 STEP 1656 H=1656:00 +CPU= 24.381
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001656
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001656
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001656
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001632
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001632
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001632
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001644
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001644
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001644
Zipping up the intermediate file: /home/kari/projects/climateprediction.net/oifs_43r3_ps_0771_2013050100_123_982_12199415_1_r1009835292_63.zip
Uploading the intermediate file: upload_file_63.zip
21:30:03 STEP 1657 H=1657:00 +CPU= 13.283
21:30:17 STEP 1658 H=1658:00 +CPU= 13.611
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:30:40 STEP 1659 H=1659:00 +CPU= 20.375
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:30:55 STEP 1660 H=1660:00 +CPU= 13.300
21:31:08 STEP 1661 H=1661:00 +CPU= 12.854
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:31:32 STEP 1662 H=1662:00 +CPU= 20.225
21:31:45 STEP 1663 H=1663:00 +CPU= 12.729
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:32:00 STEP 1664 H=1664:00 +CPU= 13.294
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:32:23 STEP 1665 H=1665:00 +CPU= 20.235
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:32:38 STEP 1666 H=1666:00 +CPU= 13.407
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:32:53 STEP 1667 H=1667:00 +CPU= 12.878
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:33:18 STEP 1668 H=1668:00 +CPU= 22.720
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001668
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001668
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001668
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:33:33 STEP 1669 H=1669:00 +CPU= 12.957
21:33:47 STEP 1670 H=1670:00 +CPU= 13.607
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:34:11 STEP 1671 H=1671:00 +CPU= 20.192
21:34:24 STEP 1672 H=1672:00 +CPU= 13.368
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:34:39 STEP 1673 H=1673:00 +CPU= 13.017
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:35:02 STEP 1674 H=1674:00 +CPU= 20.419
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:35:17 STEP 1675 H=1675:00 +CPU= 12.785
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:35:32 STEP 1676 H=1676:00 +CPU= 13.101
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:35:54 STEP 1677 H=1677:00 +CPU= 19.811
21:36:07 STEP 1678 H=1678:00 +CPU= 13.063
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:36:22 STEP 1679 H=1679:00 +CPU= 13.209
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:36:51 STEP 1680 H=1680:00 +CPU= 24.167
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001680
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001680
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001680
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001656
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001656
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001656
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001668
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001668
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001668
Zipping up the intermediate file: /home/kari/projects/climateprediction.net/oifs_43r3_ps_0771_2013050100_123_982_12199415_1_r1009835292_64.zip
Uploading the intermediate file: upload_file_64.zip
21:37:04 STEP 1681 H=1681:00 +CPU= 12.836
21:37:17 STEP 1682 H=1682:00 +CPU= 13.184
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:37:39 STEP 1683 H=1683:00 +CPU= 20.098
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:37:54 STEP 1684 H=1684:00 +CPU= 13.110
21:38:08 STEP 1685 H=1685:00 +CPU= 13.261
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:38:33 STEP 1686 H=1686:00 +CPU= 21.308
21:38:46 STEP 1687 H=1687:00 +CPU= 13.411
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:39:02 STEP 1688 H=1688:00 +CPU= 13.527
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:39:24 STEP 1689 H=1689:00 +CPU= 19.946
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:39:39 STEP 1690 H=1690:00 +CPU= 13.211
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:39:54 STEP 1691 H=1691:00 +CPU= 12.863
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:40:18 STEP 1692 H=1692:00 +CPU= 22.086
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001692
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001692
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001692
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:40:33 STEP 1693 H=1693:00 +CPU= 12.820
21:40:46 STEP 1694 H=1694:00 +CPU= 13.103
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:41:10 STEP 1695 H=1695:00 +CPU= 19.709
21:41:23 STEP 1696 H=1696:00 +CPU= 13.004
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:41:38 STEP 1697 H=1697:00 +CPU= 12.638
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:42:00 STEP 1698 H=1698:00 +CPU= 20.064
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:42:15 STEP 1699 H=1699:00 +CPU= 12.639
21:42:28 STEP 1700 H=1700:00 +CPU= 13.156
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:42:52 STEP 1701 H=1701:00 +CPU= 19.665
21:43:05 STEP 1702 H=1702:00 +CPU= 13.172
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:43:20 STEP 1703 H=1703:00 +CPU= 13.163
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:43:46 STEP 1704 H=1704:00 +CPU= 23.837
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001704
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001704
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001704
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001680
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001680
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001680
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001692
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001692
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001692
Zipping up the intermediate file: /home/kari/projects/climateprediction.net/oifs_43r3_ps_0771_2013050100_123_982_12199415_1_r1009835292_65.zip
Uploading the intermediate file: upload_file_65.zip
21:44:01 STEP 1705 H=1705:00 +CPU= 12.860
21:44:14 STEP 1706 H=1706:00 +CPU= 13.162
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:44:37 STEP 1707 H=1707:00 +CPU= 20.305
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:44:52 STEP 1708 H=1708:00 +CPU= 13.316
21:45:05 STEP 1709 H=1709:00 +CPU= 12.861
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:45:28 STEP 1710 H=1710:00 +CPU= 20.413
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:45:42 STEP 1711 H=1711:00 +CPU= 12.823
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:45:57 STEP 1712 H=1712:00 +CPU= 13.032
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:46:20 STEP 1713 H=1713:00 +CPU= 20.116
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:46:35 STEP 1714 H=1714:00 +CPU= 13.018
21:46:47 STEP 1715 H=1715:00 +CPU= 12.676
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:47:14 STEP 1716 H=1716:00 +CPU= 22.077
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001716
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001716
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001716
21:47:27 STEP 1717 H=1717:00 +CPU= 12.950
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:47:42 STEP 1718 H=1718:00 +CPU= 13.061
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:48:03 STEP 1719 H=1719:00 +CPU= 19.583
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:48:18 STEP 1720 H=1720:00 +CPU= 12.994
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:48:33 STEP 1721 H=1721:00 +CPU= 12.624
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:48:55 STEP 1722 H=1722:00 +CPU= 19.941
21:49:08 STEP 1723 H=1723:00 +CPU= 12.723
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:49:23 STEP 1724 H=1724:00 +CPU= 12.977
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:49:45 STEP 1725 H=1725:00 +CPU= 19.844
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:50:00 STEP 1726 H=1726:00 +CPU= 13.378
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:50:15 STEP 1727 H=1727:00 +CPU= 13.137
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:50:42 STEP 1728 H=1728:00 +CPU= 23.932
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001728
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001728
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001728
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001704
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001704
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001704
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001716
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001716
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001716
Zipping up the intermediate file: /home/kari/projects/climateprediction.net/oifs_43r3_ps_0771_2013050100_123_982_12199415_1_r1009835292_66.zip
Uploading the intermediate file: upload_file_66.zip
21:50:54 STEP 1729 H=1729:00 +CPU= 12.664
21:51:07 STEP 1730 H=1730:00 +CPU= 12.967
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:51:32 STEP 1731 H=1731:00 +CPU= 20.237
21:51:45 STEP 1732 H=1732:00 +CPU= 13.205
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:52:00 STEP 1733 H=1733:00 +CPU= 12.859
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:52:22 STEP 1734 H=1734:00 +CPU= 20.360
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:52:37 STEP 1735 H=1735:00 +CPU= 12.773
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:52:52 STEP 1736 H=1736:00 +CPU= 13.037
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:53:14 STEP 1737 H=1737:00 +CPU= 19.806
21:53:27 STEP 1738 H=1738:00 +CPU= 13.123
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:53:42 STEP 1739 H=1739:00 +CPU= 12.641
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:54:06 STEP 1740 H=1740:00 +CPU= 21.879
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001740
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001740
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001740
21:54:21 STEP 1741 H=1741:00 +CPU= 12.844
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:54:36 STEP 1742 H=1742:00 +CPU= 12.994
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
[EC_DRHOOK:G:1:1:4455:4455] [20230119:215456:1674158096:17037.453] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 2550MB (heap), 4419MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:G:1:1:4455:4455] [20230119:215456:1674158096:17037.454] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:G:1:1:4455:4455] [20230119:215456:1674158096:17037.454] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:G:1:1:4455:4455] [20230119:215456:1674158096:17037.454] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0xda4a], nsigs = 1
[EC_DRHOOK:G:1:1:4455:4455] [20230119:215456:1674158096:17037.454] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:G:1:1:4455:4455] [20230119:215456:1674158096:17037.454] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 2598 MB (maxheap), 4419 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:G:1:1:4455:4455] [20230119:215456:1674158096:17037.454] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : MASTER
[EC_DRHOOK:G:1:1:4455:4455] [20230119:215456:1674158096:17037.454] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT0
[EC_DRHOOK:G:1:1:4455:4455] [20230119:215456:1674158096:17037.454] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT1
[EC_DRHOOK:G:1:1:4455:4455] [20230119:215456:1674158096:17037.454] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT2
[EC_DRHOOK:G:1:1:4455:4455] [20230119:215456:1674158096:17037.454] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT3
[EC_DRHOOK:G:1:1:4455:4455] [20230119:215456:1674158096:17037.454] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT4
[EC_DRHOOK:G:1:1:4455:4455] [20230119:215456:1674158096:17037.454] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : WVCOUPLE
[EC_DRHOOK:G:1:1:4455:4455] [20230119:215456:1674158096:17037.454] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : WAVEMDL
[EC_DRHOOK:G:1:1:4455:4455] [20230119:215456:1674158096:17037.454] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : WAMODEL
[EC_DRHOOK:G:1:1:4455:4455] [20230119:215456:1674158096:17037.454] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : >OMP-WAMODEL 2 (1431)
[EC_DRHOOK:G:1:1:4455:4455] [20230119:215456:1674158096:17037.454] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : IMPLSCH
[EC_DRHOOK:G:1:1:4455:4455] [20230119:215456:1674158096:17037.454] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : SINPUT
[EC_DRHOOK:G:1:1:4455:4455] [20230119:215456:1674158096:17037.454] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : SINPUT_JAN
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2013050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0771
(argv4) batchid: 982
(argv5) wuid: 12199415
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /home/kari/slots/1
Project directory is: /home/kari/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415
..mkdir for temp folder for results failed
Copying: /home/kari/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /home/kari/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /home/kari/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_f11ecfb73330c7ac9d7903391415a955 to: /home/kari/slots/1/oifs_43r3_ps_0771_2013050100_123_982_12199415.zip
Unzipping the namelist zip file: /home/kari/slots/1/oifs_43r3_ps_0771_2013050100_123_982_12199415.zip
ic_ancil_file: ic_ancil_12199415
ifsdata_file: ifsdata_12199415
climate_data_file: clim_data_12199415
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_f2f69d8a5843d60b337692ea89ecc9c3 to: /home/kari/slots/1/ic_ancil_12199415.zip
Unzipping the IC ancils zip file: /home/kari/slots/1/ic_ancil_12199415.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_7f74d90660c0628cd716d132edf07375 to: /home/kari/slots/1/ifsdata/ifsdata_12199415.zip
Unzipping the ifsdata_zip file: /home/kari/slots/1/ifsdata/ifsdata_12199415.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /home/kari/slots/1/159l_2/clim_data_12199415.zip
Unzipping the climate data zip file: /home/kari/slots/1/159l_2/clim_data_12199415.zip
Checking for progress XML file: /home/kari/slots/1/progress_file_12199415.xml
Opened progress file ok : /home/kari/slots/1/progress_file_12199415.xml
-- Model is restarting --
Adjusting last_iter, 1743, to previous model restart step.
Creating progress file: /home/kari/slots/1/progress_file_12199415.xml
last_cpu_time: 38594
upload_file_number: 67
last_iter: 1727
last_upload: 6220800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0771_2013050100_123_982_12199415_1_r1009835292
The child process has been launched with process id: 4731
Executing the command: /home/kari/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:G:1:1:4731:4731] [20230120:230108:1674248468:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:01:36 STEP 1728 H=1728:00 +CPU= 22.631
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:01:51 STEP 1729 H=1729:00 +CPU= 12.410
23:02:04 STEP 1730 H=1730:00 +CPU= 12.812
23:02:23 STEP 1731 H=1731:00 +CPU= 19.427
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:02:38 STEP 1732 H=1732:00 +CPU= 12.824
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:02:53 STEP 1733 H=1733:00 +CPU= 12.527
23:03:13 STEP 1734 H=1734:00 +CPU= 19.865
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:03:27 STEP 1735 H=1735:00 +CPU= 12.739
23:03:41 STEP 1736 H=1736:00 +CPU= 13.098
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:04:02 STEP 1737 H=1737:00 +CPU= 19.455
23:04:15 STEP 1738 H=1738:00 +CPU= 12.894
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:04:30 STEP 1739 H=1739:00 +CPU= 12.610
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:04:53 STEP 1740 H=1740:00 +CPU= 21.593
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001740
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001740
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001740
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:05:08 STEP 1741 H=1741:00 +CPU= 12.680
23:05:21 STEP 1742 H=1742:00 +CPU= 12.883
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:05:43 STEP 1743 H=1743:00 +CPU= 19.431
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:05:58 STEP 1744 H=1744:00 +CPU= 13.091
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:06:13 STEP 1745 H=1745:00 +CPU= 13.283
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:06:39 STEP 1746 H=1746:00 +CPU= 23.271
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:06:53 STEP 1747 H=1747:00 +CPU= 12.786
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:07:09 STEP 1748 H=1748:00 +CPU= 13.192
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:07:31 STEP 1749 H=1749:00 +CPU= 20.134
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:08:01 STEP 1750 H=1750:00 +CPU= 27.184
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:08:32 STEP 1751 H=1751:00 +CPU= 26.272
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:09:08 STEP 1752 H=1752:00 +CPU= 30.789
Moving to projects directory: /home/kari/slots/1/ICMGGhq0f+001752
Moving to projects directory: /home/kari/slots/1/ICMSHhq0f+001752
Moving to projects directory: /home/kari/slots/1/ICMUAhq0f+001752
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001728
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001728
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001728
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMGGhq0f+001740
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMSHhq0f+001740
Adding to the zip: /home/kari/projects/climateprediction.net/oifs_43r3_ps_12199415/ICMUAhq0f+001740
Zipping up the intermediate file: /home/kari/projects/climateprediction.net/oifs_43r3_ps_0771_2013050100_123_982_12199415_1_r1009835292_67.zip
Uploading the intermediate file: upload_file_67.zip
23:09:21 STEP 1753 H=1753:00 +CPU= 13.002
23:09:34 STEP 1754 H=1754:00 +CPU= 13.311
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:09:57 STEP 1755 H=1755:00 +CPU= 20.794
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:10:13 STEP 1756 H=1756:00 +CPU= 13.857
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:10:30 STEP 1757 H=1757:00 +CPU= 14.865
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
23:10:53 STEP 1758 H=1758:00 +CPU= 21.258
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Abort request received from BOINC client, ending the child process
</stderr_txt>
]]>
