Name | oifs_43r3_bl_a0b3_2016092300_15_991_12207186_0 |
Workunit | 12207186 |
Created | 13 Feb 2023, 12:45:02 UTC |
Sent | 14 Feb 2023, 1:51:15 UTC |
Report deadline | 15 Apr 2023, 1:51:15 UTC |
Received | 15 Feb 2023, 8:14:27 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 1 (0x00000001) Unknown error code |
Computer ID | 1534812 |
Run time | 6 hours 12 min 41 sec |
CPU time | 6 hours 12 min 41 sec |
Validate state | Invalid |
Credit | 1,209.60 |
Device peak FLOPS | 4.17 GFLOPS |
Application version | OpenIFS 43r3 Baroclinic Lifecycle v1.11 x86_64-pc-linux-gnu |
Peak working set size | 5,614.12 MB |
Peak swap size | 5,930.79 MB |
Peak disk usage | 1,378.54 MB |
Stderr | <core_client_version>7.20.5</core_client_version> <![CDATA[ <message> process exited with code 1 (0x1, -255)</message> <stderr_txt> PU= 22.398 05:27:57 STEP 603 H= 150:45 +CPU= 22.391 05:28:19 STEP 604 H= 151:00 +CPU= 22.790 05:28:42 STEP 605 H= 151:15 +CPU= 22.514 05:29:04 STEP 606 H= 151:30 +CPU= 22.512 05:29:27 STEP 607 H= 151:45 +CPU= 22.560 05:29:50 STEP 608 H= 152:00 +CPU= 22.768 05:30:12 STEP 609 H= 152:15 +CPU= 22.448 05:30:35 STEP 610 H= 152:30 +CPU= 22.811 05:30:58 STEP 611 H= 152:45 +CPU= 23.115 05:31:26 STEP 612 H= 153:00 +CPU= 27.948 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000612 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000612 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000612 05:31:49 STEP 613 H= 153:15 +CPU= 23.166 05:32:12 STEP 614 H= 153:30 +CPU= 22.617 05:32:34 STEP 615 H= 153:45 +CPU= 22.555 05:32:57 STEP 616 H= 154:00 +CPU= 23.066 05:33:20 STEP 617 H= 154:15 +CPU= 22.630 05:33:43 STEP 618 H= 154:30 +CPU= 22.635 05:34:05 STEP 619 H= 154:45 +CPU= 22.599 05:34:29 STEP 620 H= 155:00 +CPU= 23.400 05:34:52 STEP 621 H= 155:15 +CPU= 23.015 05:35:14 STEP 622 H= 155:30 +CPU= 22.804 05:35:37 STEP 623 H= 155:45 +CPU= 22.986 05:36:08 STEP 624 H= 156:00 +CPU= 30.842 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000624 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000624 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000624 05:36:31 STEP 625 H= 156:15 +CPU= 22.985 05:36:54 STEP 626 H= 156:30 +CPU= 22.559 05:37:16 STEP 627 H= 156:45 +CPU= 22.532 05:37:39 STEP 628 H= 157:00 +CPU= 22.902 05:38:02 STEP 629 H= 157:15 +CPU= 22.466 05:38:24 STEP 630 H= 157:30 +CPU= 22.429 05:38:47 STEP 631 H= 157:45 +CPU= 22.426 05:39:09 STEP 632 H= 158:00 +CPU= 22.831 05:39:32 STEP 633 H= 158:15 +CPU= 22.389 05:39:54 STEP 634 H= 158:30 +CPU= 22.449 05:40:17 STEP 635 H= 158:45 +CPU= 22.437 05:40:45 STEP 636 H= 159:00 +CPU= 27.773 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000636 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000636 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000636 05:41:07 STEP 637 H= 159:15 +CPU= 22.641 05:41:30 STEP 638 H= 159:30 +CPU= 22.590 05:41:52 STEP 639 H= 159:45 +CPU= 22.642 05:42:15 STEP 640 H= 160:00 +CPU= 23.067 05:42:38 STEP 641 H= 160:15 +CPU= 22.953 05:43:01 STEP 642 H= 160:30 +CPU= 22.567 05:43:24 STEP 643 H= 160:45 +CPU= 23.331 05:43:48 STEP 644 H= 161:00 +CPU= 23.315 05:44:10 STEP 645 H= 161:15 +CPU= 22.792 05:44:34 STEP 646 H= 161:30 +CPU= 23.074 05:44:56 STEP 647 H= 161:45 +CPU= 22.518 05:45:24 STEP 648 H= 162:00 +CPU= 27.796 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000648 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000648 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000648 05:45:46 STEP 649 H= 162:15 +CPU= 22.551 05:46:09 STEP 650 H= 162:30 +CPU= 22.614 05:46:32 STEP 651 H= 162:45 +CPU= 22.695 05:46:55 STEP 652 H= 163:00 +CPU= 23.138 05:47:18 STEP 653 H= 163:15 +CPU= 22.705 05:47:40 STEP 654 H= 163:30 +CPU= 22.640 05:48:03 STEP 655 H= 163:45 +CPU= 22.488 05:48:26 STEP 656 H= 164:00 +CPU= 23.053 05:48:49 STEP 657 H= 164:15 +CPU= 22.825 05:49:11 STEP 658 H= 164:30 +CPU= 22.763 05:49:34 STEP 659 H= 164:45 +CPU= 23.046 05:50:03 STEP 660 H= 165:00 +CPU= 28.138 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000660 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000660 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000660 05:50:25 STEP 661 H= 165:15 +CPU= 22.849 05:50:48 STEP 662 H= 165:30 +CPU= 22.723 05:51:11 STEP 663 H= 165:45 +CPU= 22.839 05:51:34 STEP 664 H= 166:00 +CPU= 23.116 05:51:57 STEP 665 H= 166:15 +CPU= 22.549 05:52:19 STEP 666 H= 166:30 +CPU= 22.660 05:52:42 STEP 667 H= 166:45 +CPU= 23.039 05:53:05 STEP 668 H= 167:00 +CPU= 23.026 05:53:28 STEP 669 H= 167:15 +CPU= 22.852 05:53:51 STEP 670 H= 167:30 +CPU= 22.924 05:54:14 STEP 671 H= 167:45 +CPU= 22.711 05:54:45 STEP 672 H= 168:00 +CPU= 31.117 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000672 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000672 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000672 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000576 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000576 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000576 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000588 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000588 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000588 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000600 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000600 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000600 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000612 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000612 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000612 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000624 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000624 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000624 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000636 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000636 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000636 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000648 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000648 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000648 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000660 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000660 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000660 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0b3_2016092300_15_991_12207186_0_r912618472_6.zip Uploading the intermediate file: upload_file_6.zip 05:55:08 STEP 673 H= 168:15 +CPU= 22.653 05:55:30 STEP 674 H= 168:30 +CPU= 22.506 05:55:53 STEP 675 H= 168:45 +CPU= 22.525 05:56:16 STEP 676 H= 169:00 +CPU= 22.943 05:56:38 STEP 677 H= 169:15 +CPU= 22.482 05:57:01 STEP 678 H= 169:30 +CPU= 22.518 05:57:23 STEP 679 H= 169:45 +CPU= 22.454 05:57:46 STEP 680 H= 170:00 +CPU= 22.821 05:58:08 STEP 681 H= 170:15 +CPU= 22.489 05:58:31 STEP 682 H= 170:30 +CPU= 22.481 05:58:53 STEP 683 H= 170:45 +CPU= 22.491 05:59:21 STEP 684 H= 171:00 +CPU= 28.101 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000684 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000684 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000684 05:59:44 STEP 685 H= 171:15 +CPU= 22.821 06:00:07 STEP 686 H= 171:30 +CPU= 22.883 06:00:30 STEP 687 H= 171:45 +CPU= 22.854 06:00:54 STEP 688 H= 172:00 +CPU= 23.529 06:01:16 STEP 689 H= 172:15 +CPU= 22.826 06:01:39 STEP 690 H= 172:30 +CPU= 22.923 06:02:02 STEP 691 H= 172:45 +CPU= 22.785 06:02:25 STEP 692 H= 173:00 +CPU= 22.991 06:02:48 STEP 693 H= 173:15 +CPU= 23.155 06:03:11 STEP 694 H= 173:30 +CPU= 22.828 06:03:34 STEP 695 H= 173:45 +CPU= 22.650 06:04:02 STEP 696 H= 174:00 +CPU= 27.855 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000696 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000696 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000696 06:04:24 STEP 697 H= 174:15 +CPU= 22.516 06:04:46 STEP 698 H= 174:30 +CPU= 22.380 06:05:09 STEP 699 H= 174:45 +CPU= 22.416 06:05:32 STEP 700 H= 175:00 +CPU= 22.656 06:05:54 STEP 701 H= 175:15 +CPU= 22.407 06:06:16 STEP 702 H= 175:30 +CPU= 22.401 06:06:39 STEP 703 H= 175:45 +CPU= 22.399 06:07:02 STEP 704 H= 176:00 +CPU= 22.795 06:07:24 STEP 705 H= 176:15 +CPU= 22.696 06:07:47 STEP 706 H= 176:30 +CPU= 22.396 06:08:09 STEP 707 H= 176:45 +CPU= 22.417 06:08:37 STEP 708 H= 177:00 +CPU= 27.659 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000708 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000708 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000708 06:08:59 STEP 709 H= 177:15 +CPU= 22.404 06:09:22 STEP 710 H= 177:30 +CPU= 22.399 06:09:44 STEP 711 H= 177:45 +CPU= 22.447 06:10:07 STEP 712 H= 178:00 +CPU= 22.904 06:10:30 STEP 713 H= 178:15 +CPU= 22.888 06:10:53 STEP 714 H= 178:30 +CPU= 22.923 06:11:15 STEP 715 H= 178:45 +CPU= 22.575 06:11:39 STEP 716 H= 179:00 +CPU= 23.275 06:12:01 STEP 717 H= 179:15 +CPU= 22.582 06:12:24 STEP 718 H= 179:30 +CPU= 22.564 06:12:46 STEP 719 H= 179:45 +CPU= 22.602 06:13:17 STEP 720 H= 180:00 +CPU= 31.035 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000720 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000720 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000720 06:13:40 STEP 721 H= 180:15 +CPU= 22.622 06:14:03 STEP 722 H= 180:30 +CPU= 22.567 06:14:25 STEP 723 H= 180:45 +CPU= 22.648 06:14:48 STEP 724 H= 181:00 +CPU= 23.090 06:15:11 STEP 725 H= 181:15 +CPU= 22.526 06:15:33 STEP 726 H= 181:30 +CPU= 22.486 06:15:56 STEP 727 H= 181:45 +CPU= 22.630 06:16:19 STEP 728 H= 182:00 +CPU= 22.890 06:16:41 STEP 729 H= 182:15 +CPU= 22.546 06:17:04 STEP 730 H= 182:30 +CPU= 22.550 06:17:26 STEP 731 H= 182:45 +CPU= 22.473 06:17:54 STEP 732 H= 183:00 +CPU= 27.941 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000732 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000732 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000732 06:18:17 STEP 733 H= 183:15 +CPU= 22.634 06:18:40 STEP 734 H= 183:30 +CPU= 22.657 06:19:02 STEP 735 H= 183:45 +CPU= 22.559 06:19:25 STEP 736 H= 184:00 +CPU= 23.281 06:19:48 STEP 737 H= 184:15 +CPU= 22.619 06:20:12 STEP 738 H= 184:30 +CPU= 23.392 06:20:35 STEP 739 H= 184:45 +CPU= 23.117 06:20:58 STEP 740 H= 185:00 +CPU= 23.464 06:21:21 STEP 741 H= 185:15 +CPU= 22.860 06:21:44 STEP 742 H= 185:30 +CPU= 22.743 06:22:06 STEP 743 H= 185:45 +CPU= 22.639 06:22:34 STEP 744 H= 186:00 +CPU= 27.973 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000744 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000744 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000744 06:22:57 STEP 745 H= 186:15 +CPU= 22.646 06:23:19 STEP 746 H= 186:30 +CPU= 22.420 06:23:42 STEP 747 H= 186:45 +CPU= 22.532 06:24:05 STEP 748 H= 187:00 +CPU= 22.921 06:24:27 STEP 749 H= 187:15 +CPU= 22.479 06:24:50 STEP 750 H= 187:30 +CPU= 22.601 06:25:13 STEP 751 H= 187:45 +CPU= 22.665 06:25:36 STEP 752 H= 188:00 +CPU= 23.518 06:25:59 STEP 753 H= 188:15 +CPU= 22.565 06:26:22 STEP 754 H= 188:30 +CPU= 22.958 06:26:44 STEP 755 H= 188:45 +CPU= 22.570 06:27:12 STEP 756 H= 189:00 +CPU= 27.995 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000756 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000756 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000756 06:27:35 STEP 757 H= 189:15 +CPU= 22.848 06:27:58 STEP 758 H= 189:30 +CPU= 22.691 06:28:21 STEP 759 H= 189:45 +CPU= 22.787 06:28:44 STEP 760 H= 190:00 +CPU= 23.011 06:29:07 STEP 761 H= 190:15 +CPU= 22.986 06:29:29 STEP 762 H= 190:30 +CPU= 22.560 06:29:52 STEP 763 H= 190:45 +CPU= 22.580 06:30:15 STEP 764 H= 191:00 +CPU= 22.917 06:30:37 STEP 765 H= 191:15 +CPU= 22.464 06:31:00 STEP 766 H= 191:30 +CPU= 22.537 06:31:22 STEP 767 H= 191:45 +CPU= 22.530 06:31:53 STEP 768 H= 192:00 +CPU= 30.937 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000768 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000768 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000768 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000672 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000672 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000672 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000684 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000684 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000684 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000696 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000696 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000696 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000708 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000708 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000708 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000720 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000720 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000720 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000732 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000732 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000732 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000744 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000744 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000744 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000756 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000756 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000756 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0b3_2016092300_15_991_12207186_0_r912618472_7.zip Uploading the intermediate file: upload_file_7.zip 06:32:16 STEP 769 H= 192:15 +CPU= 22.450 06:32:38 STEP 770 H= 192:30 +CPU= 22.508 06:33:01 STEP 771 H= 192:45 +CPU= 22.529 06:33:23 STEP 772 H= 193:00 +CPU= 22.822 06:33:46 STEP 773 H= 193:15 +CPU= 22.475 06:34:08 STEP 774 H= 193:30 +CPU= 22.599 06:34:31 STEP 775 H= 193:45 +CPU= 22.606 06:34:54 STEP 776 H= 194:00 +CPU= 22.925 06:35:17 STEP 777 H= 194:15 +CPU= 22.542 06:35:39 STEP 778 H= 194:30 +CPU= 22.610 06:36:02 STEP 779 H= 194:45 +CPU= 22.607 06:36:30 STEP 780 H= 195:00 +CPU= 27.798 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000780 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000780 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000780 06:36:52 STEP 781 H= 195:15 +CPU= 22.650 06:37:15 STEP 782 H= 195:30 +CPU= 22.615 06:37:37 STEP 783 H= 195:45 +CPU= 22.516 06:38:01 STEP 784 H= 196:00 +CPU= 23.489 06:38:24 STEP 785 H= 196:15 +CPU= 23.214 06:38:47 STEP 786 H= 196:30 +CPU= 23.142 06:39:10 STEP 787 H= 196:45 +CPU= 22.628 06:39:33 STEP 788 H= 197:00 +CPU= 23.006 06:39:55 STEP 789 H= 197:15 +CPU= 22.547 06:40:18 STEP 790 H= 197:30 +CPU= 22.544 06:40:40 STEP 791 H= 197:45 +CPU= 22.537 06:41:08 STEP 792 H= 198:00 +CPU= 27.945 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000792 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000792 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000792 06:41:31 STEP 793 H= 198:15 +CPU= 22.571 06:41:54 STEP 794 H= 198:30 +CPU= 22.539 06:42:16 STEP 795 H= 198:45 +CPU= 22.657 06:42:39 STEP 796 H= 199:00 +CPU= 22.914 06:43:02 STEP 797 H= 199:15 +CPU= 22.633 06:43:24 STEP 798 H= 199:30 +CPU= 22.622 06:43:47 STEP 799 H= 199:45 +CPU= 22.721 06:44:10 STEP 800 H= 200:00 +CPU= 23.120 06:44:33 STEP 801 H= 200:15 +CPU= 22.882 06:44:56 STEP 802 H= 200:30 +CPU= 22.640 06:45:18 STEP 803 H= 200:45 +CPU= 22.563 06:45:47 STEP 804 H= 201:00 +CPU= 28.831 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000804 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000804 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000804 06:46:10 STEP 805 H= 201:15 +CPU= 22.586 06:46:32 STEP 806 H= 201:30 +CPU= 22.651 06:46:55 STEP 807 H= 201:45 +CPU= 22.687 06:47:19 STEP 808 H= 202:00 +CPU= 23.610 06:47:42 STEP 809 H= 202:15 +CPU= 23.737 06:48:05 STEP 810 H= 202:30 +CPU= 22.634 06:48:28 STEP 811 H= 202:45 +CPU= 22.556 06:48:51 STEP 812 H= 203:00 +CPU= 23.001 06:49:13 STEP 813 H= 203:15 +CPU= 22.660 06:49:36 STEP 814 H= 203:30 +CPU= 22.648 06:49:58 STEP 815 H= 203:45 +CPU= 22.492 06:50:30 STEP 816 H= 204:00 +CPU= 31.238 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000816 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000816 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000816 06:50:52 STEP 817 H= 204:15 +CPU= 22.706 06:51:15 STEP 818 H= 204:30 +CPU= 22.857 06:51:38 STEP 819 H= 204:45 +CPU= 22.705 06:52:01 STEP 820 H= 205:00 +CPU= 23.215 06:52:24 STEP 821 H= 205:15 +CPU= 22.655 06:52:46 STEP 822 H= 205:30 +CPU= 22.695 06:53:09 STEP 823 H= 205:45 +CPU= 22.667 06:53:32 STEP 824 H= 206:00 +CPU= 23.103 06:53:55 STEP 825 H= 206:15 +CPU= 22.730 06:54:18 STEP 826 H= 206:30 +CPU= 22.604 06:54:40 STEP 827 H= 206:45 +CPU= 22.724 06:55:08 STEP 828 H= 207:00 +CPU= 27.970 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000828 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000828 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000828 06:55:31 STEP 829 H= 207:15 +CPU= 22.733 06:55:54 STEP 830 H= 207:30 +CPU= 23.133 06:56:17 STEP 831 H= 207:45 +CPU= 22.852 06:56:41 STEP 832 H= 208:00 +CPU= 23.779 06:57:04 STEP 833 H= 208:15 +CPU= 23.107 06:57:27 STEP 834 H= 208:30 +CPU= 23.281 06:57:50 STEP 835 H= 208:45 +CPU= 22.775 06:58:13 STEP 836 H= 209:00 +CPU= 23.191 06:58:36 STEP 837 H= 209:15 +CPU= 22.658 06:58:59 STEP 838 H= 209:30 +CPU= 22.726 06:59:21 STEP 839 H= 209:45 +CPU= 22.770 06:59:49 STEP 840 H= 210:00 +CPU= 28.153 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000840 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000840 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000840 07:00:12 STEP 841 H= 210:15 +CPU= 22.872 07:00:35 STEP 842 H= 210:30 +CPU= 22.624 07:00:58 STEP 843 H= 210:45 +CPU= 22.742 07:01:21 STEP 844 H= 211:00 +CPU= 23.122 07:01:44 STEP 845 H= 211:15 +CPU= 22.981 07:02:07 STEP 846 H= 211:30 +CPU= 22.880 07:02:30 STEP 847 H= 211:45 +CPU= 22.814 07:02:53 STEP 848 H= 212:00 +CPU= 23.301 07:03:16 STEP 849 H= 212:15 +CPU= 23.144 07:03:39 STEP 850 H= 212:30 +CPU= 23.209 07:04:02 STEP 851 H= 212:45 +CPU= 22.893 07:04:30 STEP 852 H= 213:00 +CPU= 28.372 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000852 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000852 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000852 07:04:53 STEP 853 H= 213:15 +CPU= 22.792 07:05:16 STEP 854 H= 213:30 +CPU= 23.234 07:05:39 STEP 855 H= 213:45 +CPU= 22.843 07:06:03 STEP 856 H= 214:00 +CPU= 23.480 07:06:26 STEP 857 H= 214:15 +CPU= 23.011 07:06:49 STEP 858 H= 214:30 +CPU= 22.751 07:07:11 STEP 859 H= 214:45 +CPU= 22.616 07:07:35 STEP 860 H= 215:00 +CPU= 23.386 07:07:57 STEP 861 H= 215:15 +CPU= 22.873 07:08:20 STEP 862 H= 215:30 +CPU= 22.741 07:08:43 STEP 863 H= 215:45 +CPU= 22.682 07:09:14 STEP 864 H= 216:00 +CPU= 30.919 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000864 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000864 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000864 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000768 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000768 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000768 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000780 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000780 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000780 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000792 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000792 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000792 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000804 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000804 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000804 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000816 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000816 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000816 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000828 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000828 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000828 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000840 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000840 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000840 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000852 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000852 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000852 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0b3_2016092300_15_991_12207186_0_r912618472_8.zip Uploading the intermediate file: upload_file_8.zip 07:09:37 STEP 865 H= 216:15 +CPU= 22.749 07:09:59 STEP 866 H= 216:30 +CPU= 22.867 07:10:22 STEP 867 H= 216:45 +CPU= 22.929 07:10:46 STEP 868 H= 217:00 +CPU= 23.319 07:11:09 STEP 869 H= 217:15 +CPU= 22.875 07:11:31 STEP 870 H= 217:30 +CPU= 22.943 07:11:54 STEP 871 H= 217:45 +CPU= 22.693 07:12:18 STEP 872 H= 218:00 +CPU= 23.423 07:12:41 STEP 873 H= 218:15 +CPU= 23.050 07:13:04 STEP 874 H= 218:30 +CPU= 22.934 07:13:27 STEP 875 H= 218:45 +CPU= 23.059 07:13:55 STEP 876 H= 219:00 +CPU= 28.461 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000876 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000876 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000876 07:14:18 STEP 877 H= 219:15 +CPU= 23.132 07:14:41 STEP 878 H= 219:30 +CPU= 22.724 07:15:04 STEP 879 H= 219:45 +CPU= 22.836 07:15:28 STEP 880 H= 220:00 +CPU= 24.055 07:15:51 STEP 881 H= 220:15 +CPU= 22.818 07:16:14 STEP 882 H= 220:30 +CPU= 23.035 07:16:36 STEP 883 H= 220:45 +CPU= 22.639 07:16:59 STEP 884 H= 221:00 +CPU= 23.112 07:17:22 STEP 885 H= 221:15 +CPU= 22.686 07:17:45 STEP 886 H= 221:30 +CPU= 22.692 07:18:08 STEP 887 H= 221:45 +CPU= 22.711 07:18:36 STEP 888 H= 222:00 +CPU= 28.162 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000888 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000888 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000888 07:18:58 STEP 889 H= 222:15 +CPU= 22.760 07:19:21 STEP 890 H= 222:30 +CPU= 22.703 07:19:44 STEP 891 H= 222:45 +CPU= 22.702 07:20:07 STEP 892 H= 223:00 +CPU= 23.153 07:20:30 STEP 893 H= 223:15 +CPU= 23.150 07:20:54 STEP 894 H= 223:30 +CPU= 23.372 07:21:17 STEP 895 H= 223:45 +CPU= 23.670 07:21:41 STEP 896 H= 224:00 +CPU= 23.539 07:22:04 STEP 897 H= 224:15 +CPU= 23.002 07:22:27 STEP 898 H= 224:30 +CPU= 22.923 07:22:50 STEP 899 H= 224:45 +CPU= 23.142 07:23:18 STEP 900 H= 225:00 +CPU= 28.600 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000900 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000900 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000900 07:23:42 STEP 901 H= 225:15 +CPU= 23.094 07:24:05 STEP 902 H= 225:30 +CPU= 23.250 07:24:28 STEP 903 H= 225:45 +CPU= 23.251 07:24:52 STEP 904 H= 226:00 +CPU= 23.594 07:25:14 STEP 905 H= 226:15 +CPU= 22.869 07:25:38 STEP 906 H= 226:30 +CPU= 23.053 07:26:01 STEP 907 H= 226:45 +CPU= 23.200 07:26:24 STEP 908 H= 227:00 +CPU= 23.580 07:26:47 STEP 909 H= 227:15 +CPU= 23.021 07:27:10 STEP 910 H= 227:30 +CPU= 22.923 07:27:33 STEP 911 H= 227:45 +CPU= 22.904 07:28:05 STEP 912 H= 228:00 +CPU= 31.714 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000912 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000912 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000912 07:28:28 STEP 913 H= 228:15 +CPU= 23.006 07:28:51 STEP 914 H= 228:30 +CPU= 23.024 07:29:14 STEP 915 H= 228:45 +CPU= 23.127 07:29:38 STEP 916 H= 229:00 +CPU= 23.451 07:30:00 STEP 917 H= 229:15 +CPU= 22.883 07:30:23 STEP 918 H= 229:30 +CPU= 23.011 07:30:46 STEP 919 H= 229:45 +CPU= 22.914 07:31:10 STEP 920 H= 230:00 +CPU= 23.547 07:31:33 STEP 921 H= 230:15 +CPU= 23.221 07:31:56 STEP 922 H= 230:30 +CPU= 23.264 07:32:19 STEP 923 H= 230:45 +CPU= 22.894 07:32:48 STEP 924 H= 231:00 +CPU= 28.575 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000924 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000924 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000924 07:33:11 STEP 925 H= 231:15 +CPU= 22.827 07:33:34 STEP 926 H= 231:30 +CPU= 23.153 07:33:57 STEP 927 H= 231:45 +CPU= 23.178 07:34:20 STEP 928 H= 232:00 +CPU= 23.150 07:34:43 STEP 929 H= 232:15 +CPU= 23.329 07:35:06 STEP 930 H= 232:30 +CPU= 22.878 07:35:29 STEP 931 H= 232:45 +CPU= 22.846 07:35:52 STEP 932 H= 233:00 +CPU= 23.300 07:36:15 STEP 933 H= 233:15 +CPU= 22.984 07:36:38 STEP 934 H= 233:30 +CPU= 22.836 07:37:01 STEP 935 H= 233:45 +CPU= 22.822 07:37:29 STEP 936 H= 234:00 +CPU= 28.257 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000936 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000936 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000936 07:37:52 STEP 937 H= 234:15 +CPU= 22.885 07:38:15 STEP 938 H= 234:30 +CPU= 22.992 07:38:39 STEP 939 H= 234:45 +CPU= 23.301 07:39:02 STEP 940 H= 235:00 +CPU= 23.620 07:39:25 STEP 941 H= 235:15 +CPU= 23.096 07:39:48 STEP 942 H= 235:30 +CPU= 22.871 07:40:11 STEP 943 H= 235:45 +CPU= 22.872 07:40:34 STEP 944 H= 236:00 +CPU= 23.274 07:40:57 STEP 945 H= 236:15 +CPU= 23.034 07:41:20 STEP 946 H= 236:30 +CPU= 23.044 07:41:43 STEP 947 H= 236:45 +CPU= 22.808 07:42:11 STEP 948 H= 237:00 +CPU= 28.232 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000948 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000948 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000948 07:42:34 STEP 949 H= 237:15 +CPU= 22.930 07:42:57 STEP 950 H= 237:30 +CPU= 22.970 07:43:20 STEP 951 H= 237:45 +CPU= 22.908 07:43:44 STEP 952 H= 238:00 +CPU= 23.425 07:44:07 STEP 953 H= 238:15 +CPU= 23.069 07:44:30 STEP 954 H= 238:30 +CPU= 23.191 07:44:53 STEP 955 H= 238:45 +CPU= 23.223 07:45:17 STEP 956 H= 239:00 +CPU= 23.456 07:45:39 STEP 957 H= 239:15 +CPU= 22.852 07:46:02 STEP 958 H= 239:30 +CPU= 22.954 07:46:25 STEP 959 H= 239:45 +CPU= 23.039 07:46:56 STEP 960 H= 240:00 +CPU= 30.955 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000960 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000960 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000960 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000864 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000864 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000864 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000876 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000876 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000876 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000888 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000888 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000888 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000900 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000900 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000900 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000912 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000912 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000912 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000924 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000924 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000924 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000936 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000936 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000936 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMGGh7zg+000948 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMSHh7zg+000948 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207186/ICMUAh7zg+000948 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0b3_2016092300_15_991_12207186_0_r912618472_9.zip Uploading the intermediate file: upload_file_9.zip 07:47:19 STEP 961 H= 240:15 +CPU= 22.867 Uploading trickle at timestep: 864000 07:47:42 STEP 962 H= 240:30 +CPU= 22.707 07:48:05 STEP 963 H= 240:45 +CPU= 22.831 07:48:28 STEP 964 H= 241:00 +CPU= 23.278 07:48:51 STEP 965 H= 241:15 +CPU= 22.814 07:49:14 STEP 966 H= 241:30 +CPU= 22.741 07:49:37 STEP 967 H= 241:45 +CPU= 22.952 MAX U WIND= 255.539139289469 07:50:00 STEP 968 H= 242:00 +CPU= 23.316 MAX U WIND= 261.928495274880 MAX V WIND= 260.583949897653 07:50:23 STEP 969 H= 242:15 +CPU= 23.088 MAX U WIND= 250.109549628523 MAX U WIND= 260.265365633505 MAX V WIND= 266.892581659553 MAX V WIND= 268.049705894709 07:50:46 STEP 970 H= 242:30 +CPU= 23.149 MAX U WIND= 255.671630732870 MAX U WIND= 267.082540111386 MAX U WIND= 250.477099659162 MAX V WIND= 261.419834328610 MAX V WIND= 281.049859978423 MAX V WIND= 257.155168290960 07:51:09 STEP 971 H= 242:45 +CPU= 23.120 MAX V WIND= 250.628817251651 MAX U WIND= 264.342264419898 MAX U WIND= 281.929914386365 MAX U WIND= 259.356269239819 MAX V WIND= 257.301551763135 MAX V WIND= 280.610509633171 MAX V WIND= 273.798992360838 07:51:38 STEP 972 H= 243:00 +CPU= 28.666 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000972 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000972 Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000972 MAX V WIND= 256.415653766172 MAX V WIND= 253.349072746787 MAX U WIND= 276.970210571458 MAX U WIND= 286.351436224581 MAX V WIND= 251.408938475137 MAX V WIND= 277.347465346091 MAX V WIND= 280.366298218339 MAX V WIND= 256.404576501140 07:52:01 STEP 973 H= 243:15 +CPU= 23.112 MAX V WIND= 260.748804889301 MAX V WIND= 261.310230208340 MAX V WIND= 250.281515057640 MAX U WIND= 262.561427091848 MAX U WIND= 269.880770733473 MAX V WIND= 265.501209290663 MAX V WIND= 282.791955971398 MAX V WIND= 274.953613336400 07:52:25 STEP 974 H= 243:30 +CPU= 23.654 MAX V WIND= 257.760641732308 MAX V WIND= 267.183953845196 MAX V WIND= 258.099151093440 MAX U WIND= 253.108146591012 MAX U WIND= 277.555967660121 MAX V WIND= 257.363675088362 MAX V WIND= 274.334435404743 MAX V WIND= 251.420786642147 MAX V WIND= 276.896991483913 MAX V WIND= 250.307114511989 MAX V WIND= 253.897182211848 07:52:48 STEP 975 H= 243:45 +CPU= 22.963 MAX V WIND= 268.915862365795 MAX V WIND= 252.050080053576 MAX V WIND= 272.424921210141 MAX V WIND= 251.463840742654 MAX V WIND= 254.115330267680 MAX U WIND= 261.504067001129 MAX U WIND= 270.126671228746 MAX V WIND= 258.568828381823 MAX V WIND= 271.170691908635 MAX V WIND= 255.016350219200 MAX V WIND= 282.179944887315 MAX V WIND= 259.809158203969 MAX V WIND= 264.347200504378 07:53:11 STEP 976 H= 244:00 +CPU= 23.495 MAX V WIND= 250.906917229689 MAX V WIND= 253.432546275076 MAX V WIND= 274.854577676731 MAX V WIND= 268.646393719292 MAX V WIND= 253.947728024519 MAX U WIND= 267.689989994443 MAX V WIND= 257.693570208238 MAX V WIND= 271.014423112017 MAX V WIND= 250.708325452700 MAX V WIND= 281.319850163227 MAX V WIND= 265.245088763576 MAX V WIND= 270.836693501838 MAX V WIND= 261.998838515553 MAX V WIND= 250.140862558082 [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 4362MB (heap), 5615MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1 [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1 [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f0c0 (old at (nil)) [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0x1cc4a8f], nsigs = 1 [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1 [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3843] 4362 MB (maxheap), 5615 MB (maxrss), 0 MB (maxstack) [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : MASTER [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT0 [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT1 [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT2 [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT3 [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT4 [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : STEPO [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : SCAN2M [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : GP_MODEL_HEAP [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : GP_MODEL [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : EC_PHYS_DRV [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : >OMP-PHYSICS (1001) [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : EC_PHYS [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CALLPAR [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : TURBULENCE_LAYER [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : VDFOUTER [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075326:1676447606:22363.680] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : VDFMAIN [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/9/oifs_43r3_model.exe' : sigcontextptr=0x7ffd2e6e17d0 [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 24) with addr2line-cmd [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/9/oifs_43r3_model.exe' 0x838803 0x838e09 0x1d8bb20 0x1cc4a8f 0x12d283b 0x12ba8d9 0x12b0762 0x1163fc3 0x10b682f 0x10a915c 0xe680c3 0x15c1e62 0x15ac40e 0x6620b4 0x4a0e7c 0x49dc29 0x49ce72 0x49cd68 0x4078ad 0x40276f 0x40270d 0x1d8287a 0x1d840d7 0x4025e5 [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x838803] : LinuxTraceBack() at linuxtrbk.c:264 [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x838e09] : LinuxTraceBack() at linuxtrbk.c:236 [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x1d8bb20] : __restore_rt() at libc_sigaction.o:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1cc4a8f] : __libm_exp_e7() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x12d283b] : vdfmain_() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x12ba8d9] : vdfouter_() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x12b0762] : turbulence_layer_() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x1163fc3] : callpar_() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x10b682f] : ec_phys_() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x10a915c] : ec_phys_drv_() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xe680c3] : gp_model_() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x15c1e62] : gp_model_heap_() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x15ac40e] : scan2m_() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x6620b4] : stepo_() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x4a0e7c] : cnt4_() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x49dc29] : cnt3_() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x49ce72] : cnt2_() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49cd68] : cnt1_() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x4078ad] : cnt0_() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x40276f] : MAIN__() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x40270d] : main() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x1d8287a] : __libc_start_call_main() at libc-start.o:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1d840d7] : __libc_start_main_impl() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x4025e5] : _start() at ??:? [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.680] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s) Process 1 thread 1 calling linux_trbk from intel_trbk() [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/9/oifs_43r3_model.exe' : sigcontextptr=0x7ffd2e6e16e0 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 25) with addr2line-cmd [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/9/oifs_43r3_model.exe' 0x838803 0x838e09 0x820d70 0x1d8bb20 0x1cc4a8f 0x12d283b 0x12ba8d9 0x12b0762 0x1163fc3 0x10b682f 0x10a915c 0xe680c3 0x15c1e62 0x15ac40e 0x6620b4 0x4a0e7c 0x49dc29 0x49ce72 0x49cd68 0x4078ad 0x40276f 0x40270d 0x1d8287a 0x1d840d7 0x4025e5 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x838803] : LinuxTraceBack() at linuxtrbk.c:264 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x838e09] : LinuxTraceBack() at linuxtrbk.c:236 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x820d70] : signal_drhook() at drhook.c:1734 [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1d8bb20] : __restore_rt() at libc_sigaction.o:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x1cc4a8f] : __libm_exp_e7() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x12d283b] : vdfmain_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x12ba8d9] : vdfouter_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x12b0762] : turbulence_layer_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x1163fc3] : callpar_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x10b682f] : ec_phys_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0x10a915c] : ec_phys_drv_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0xe680c3] : gp_model_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x15c1e62] : gp_model_heap_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x15ac40e] : scan2m_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x6620b4] : stepo_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4a0e7c] : cnt4_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x49dc29] : cnt3_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49ce72] : cnt2_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x49cd68] : cnt1_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x4078ad] : cnt0_() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x40276f] : MAIN__() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x40270d] : main() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1d8287a] : __libc_start_call_main() at libc-start.o:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x1d840d7] : __libc_start_main_impl() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [24]: [0x4025e5] : _start() at ??:? [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s) [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.808] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1 [EC_DRHOOK:lb3-x2-c20:1:1:37499:37499] [20230215:075327:1676447607:22364.808] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x401140 for signal#8, nsigs = 1 forrtl: error (72): floating overflow Image PC Routine Line Source oifs_43r3_model.e 000000000081FCF1 Unknown Unknown Unknown oifs_43r3_model.e 0000000001D8BB20 Unknown Unknown Unknown oifs_43r3_model.e 0000000001CC4A8F Unknown Unknown Unknown oifs_43r3_model.e 00000000012D283B vdfmain_ 874 vdfmain.F90 oifs_43r3_model.e 00000000012BA8D9 vdfouter_ 739 vdfouter.F90 oifs_43r3_model.e 00000000012B0762 turbulence_layer_ 158 turbulence_layer.F90 oifs_43r3_model.e 0000000001163FC3 callpar_ 869 callpar.F90 oifs_43r3_model.e 00000000010B682F ec_phys_ 670 ec_phys.F90 oifs_43r3_model.e 00000000010A915C ec_phys_drv_ 599 ec_phys_drv.F90 oifs_43r3_model.e 0000000000E680C3 gp_model_ 613 gp_model.F90 oifs_43r3_model.e 00000000015C1E62 gp_model_heap_ 74 gp_model_heap.F90 oifs_43r3_model.e 00000000015AC40E scan2m_ 535 scan2m.F90 oifs_43r3_model.e 00000000006620B4 stepo_ 327 stepo.F90 oifs_43r3_model.e 00000000004A0E7C cnt4_ 1133 cnt4.F90 oifs_43r3_model.e 000000000049DC29 cnt3_ 267 cnt3.F90 oifs_43r3_model.e 000000000049CE72 cnt2_ 88 cnt2.F90 oifs_43r3_model.e 000000000049CD68 cnt1_ 92 cnt1.F90 oifs_43r3_model.e 00000000004078AD cnt0_ 146 cnt0.F90 oifs_43r3_model.e 000000000040276F MAIN__ 96 master.F90 oifs_43r3_model.e 000000000040270D Unknown Unknown Unknown oifs_43r3_model.e 0000000001D8287A Unknown Unknown Unknown oifs_43r3_model.e 0000000001D840D7 Unknown Unknown Unknown oifs_43r3_model.e 00000000004025E5 Unknown Unknown Unknown ..The child process has been killed with signal: 6 >>> Printing last 70 lines from file: NODE.001_01 AVE 0.131157695213025E-03 0.000000000000000E+00 0.314022767147851E-01 GPNORM RAIN AVERAGE MINIMUM MAXIMUM AVE 0.697106266175392E-05 0.000000000000000E+00 0.105823041078284E-01 GPNORM CLOUD FRACTION AVERAGE MINIMUM MAXIMUM AVE 0.193901226660496E+00 0.000000000000000E+00 0.100000000000000E+01 GPNORM CLW AVERAGE MINIMUM MAXIMUM AVE 0.390692175915910E-05 0.000000000000000E+00 0.231206230605857E-01 GPNORM CIW AVERAGE MINIMUM MAXIMUM AVE 0.527313563049261E-04 0.000000000000000E+00 0.199262468525745E-01 GPNORM CC AVERAGE MINIMUM MAXIMUM AVE 0.193698332642294E+00 0.000000000000000E+00 0.100000000000000E+01 GPNORM RFL AVERAGE MINIMUM MAXIMUM AVE 0.232092502215391E-04 0.000000000000000E+00 0.277557415119330E-01 GPNORM SFL AVERAGE MINIMUM MAXIMUM AVE 0.250119715209812E-04 0.000000000000000E+00 0.730034325877581E-02 GPNORM CRFL AVERAGE MINIMUM MAXIMUM AVE 0.362990392911475E-05 0.000000000000000E+00 0.159950656610220E-01 GPNORM CSFL AVERAGE MINIMUM MAXIMUM AVE 0.129711726918496E-05 0.000000000000000E+00 0.892262447802298E-02 GPNORM PFRC AVERAGE MINIMUM MAXIMUM AVE 0.155594032652522E+00 0.000000000000000E+00 0.100000000000000E+01 NSTEP = 972 STEPO A00000000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 972 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+000972 MODE=w IO-STREAM CLOSED - ICMGGh7zg+000972 MPI-TASK: 1 - 318179626 BYTES IN 6 RECORDS TRANSFERRED IN 0.0004 SECONDS795449.1 Mbytes/s, TOTAL TIME= 0.0079( 5.1%) NSTEP = 972 STEPO 0AA000000 IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMSHh7zg+000972 MODE=a IO-STREAM CLOSED - ./ICMSHh7zg+000972 MPI-TASK: 1 - 707765250 BYTES IN 202 RECORDS TRANSFERRED IN 0.0095 SECONDS 74501.6 Mbytes/s, TOTAL TIME= 0.2184( 4.3%) IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000972 MODE=a IO-STREAM CLOSED - ./ICMUAh7zg+000972 MPI-TASK: 1 - 5090874007 BYTES IN 125 RECORDS TRANSFERRED IN 0.0065 SECONDS783211.4 Mbytes/s, TOTAL TIME= 0.1846( 3.5%) STEPO_FPOS WAS : B00000F00E IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000972 MODE=a IO-STREAM CLOSED - ./ICMUAh7zg+000972 MPI-TASK: 1 - 309605993 BYTES IN 2 RECORDS TRANSFERRED IN 0.0002 SECONDS******** Mbytes/s, TOTAL TIME= 0.0035( 5.7%) STEPO_FPOS WAS : V00000000Y IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000972 MODE=a IO-STREAM CLOSED - ./ICMUAh7zg+000972 MPI-TASK: 1 - 318179626 BYTES IN 4 RECORDS TRANSFERRED IN 0.0002 SECONDS******** Mbytes/s, TOTAL TIME= 0.0054( 3.7%) STEPO_FPOS WAS : T00000000M NSTEP = 972 STEPO 0AAA00AAA MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 972 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+000972 MODE=a IO-STREAM CLOSED - ICMGGh7zg+000972 MPI-TASK: 1 - 318179617 BYTES IN 7 RECORDS TRANSFERRED IN 0.0005 SECONDS636359.2 Mbytes/s, TOTAL TIME= 0.0098( 5.1%) 07:51:38 STEP 972 H= 243:00 +CPU= 28.666 NSTEP = 973 STEPO 0AAA00AAA 07:52:01 STEP 973 H= 243:15 +CPU= 23.112 NSTEP = 974 STEPO 0AAA00AAA 07:52:25 STEP 974 H= 243:30 +CPU= 23.654 ISTEP= 975 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482 ISTEP= 975 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00 NSTEP = 975 STEPO 0AAA00AAA 07:52:48 STEP 975 H= 243:45 +CPU= 22.963 NSTEP = 976 STEPO 0AAA00AAA 07:53:11 STEP 976 H= 244:00 +CPU= 23.495 NSTEP = 977 STEPO 0AAA00AAA ------------------------------------------------ CNT0 not found; string returned was: 'STEPO' >>> Printing last 8 lines from file: ifs.stat 07:51:14 FULLPOS-T DYNFPOS 972 0.466 0.466 0.466 370:29 370:31 0.41910492955807E-04 2GB 0MB 07:51:14 0AAA00AAA STEPO 972 0.455 0.455 0.455 370:30 370:31 0.41910492955807E-04 2GB 0MB 07:51:38 0AAA00AAA STEPO 973 23.783 23.783 23.783 370:53 370:55 0.41910492955807E-04 2GB 0MB 07:52:01 0AAA00AAA STEPO 974 23.112 23.112 23.113 371:16 371:18 0.41910492955807E-04 2GB 0MB 07:52:25 0AAA00AAA STEPO 975 23.654 23.654 23.655 371:40 371:42 0.41910492955807E-04 2GB 0MB 07:52:48 0AAA00AAA STEPO 976 22.963 22.963 22.964 372:03 372:05 0.41910492955807E-04 2GB 0MB 07:53:11 0AAA00AAA STEPO 977 23.495 23.495 23.533 372:27 372:28 0.41910492955807E-04 2GB 0MB ------------------------------------------------ >>> Printing last 11 lines from file: rcf CSTEP = " 960", CTIME = "00100000 ", NSTEPLPP = 201, 202, 49, 228226, 228227, 2*0, 948, 2*0, IPRGPNSRES = 1, IPRGPEWRES = 1, IPRTRWRES = 1, IPRTRVRES = 1, GMASS0 = 0.000000000000000E+000, GMASSI = 0.000000000000000E+000 / ------------------------------------------------ >>> Printing last 8 lines from file: /var/lib/boinc-client/slots/9/progress_file_12207186.xml <running_values> <last_cpu_time>22353.240000</last_cpu_time> <upload_file_number>10</upload_file_number> <last_iter>977</last_iter> <last_upload>864000</last_upload> <model_completed>0</model_completed> </running_values> ------------------------------------------------ ..Failed, model did not complete successfully </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
09 May 2023 16:51:35 | 1534812 | 22307358 | oifs_43r3_bl_a0b3_2016092300_15_991_12207186_0 | 864,000 | 21,973 | 0.0254 |
©2024 climateprediction.net