climateprediction.net home page
Posts by Waldmeister

Posts by Waldmeister

1) Message boards : Number crunching : No trickles on webpage (Message 58770)
Posted 18 Sep 2018 by Waldmeister
Post:
I do not see any trickles after 11.09 for any batch/machines I have.

I also have one sam25 batch 742 received 09.09 that hasn't recorded a trickle on the web.


Just until one hour ago I also was missing all trickles for my current task , that is running for the last 5+ days. But hodiho, trickles have been inserted during the last hour and are showing up now.

Good work!
2) Message boards : Number crunching : Model uploaded/finished/reported, but still in progress on the web (Message 56477)
Posted 27 Jun 2017 by Waldmeister
Post:
Here are my tasks that are unfinished on the web but are completed and therefore not any more in my system:

hadcm3s_81et_201412_120_564_011004136_1
hadcm3s_825h_201412_120_564_011005096_1
3) Message boards : Number crunching : Extremely high work units done. (Message 50117)
Posted 11 Sep 2014 by Waldmeister
Post:
Morning folks!

Ok, good news for the moment!

@Les: One last question, you talked about a 'manual' run of the script in the news thread. What's the difference to a conventional run?
4) Message boards : Number crunching : Extremely high work units done. (Message 50112)
Posted 10 Sep 2014 by Waldmeister
Post:
It maybe more simple than that:

CPDN might have gotten things corrected or some sort of workaround was done.

I didn't restart the project, just pushed 'update' of the CPDN-project and I am back to about 111.000 and not billions. The latest BOINCstat-update also shows a vastly negativ number in latest point differential.
5) Message boards : Number crunching : ANOTHER UPLOAD PROBLEM (Message 50074)
Posted 8 Sep 2014 by Waldmeister
Post:
Problems as usual (EU-task):

Zips 1..12 don't transfer at all.
Zip 13 transfers to 100% and then do not finish.

Please tell someone here in this thread when things are working normal again. Up till then I have to seperate CPND from the rest of BOINCData-folder to ensure that unnecessary uploads won't occur.



Ok, as I read that things are currently running fine, tried it myself and reintegrated CPDN in my BOINC-Data-folder. -> Upload of all 13 zips worked well.
6) Message boards : Number crunching : Credit updates? (Message 49910)
Posted 1 Sep 2014 by Waldmeister
Post:
Now it get's strange:

As I said in the "Another Upload Problem"-Thread the zips of my latest eu-Task don't load up, only the small trickle files have uploaded.

However, I am getting points today. How that?

16726183 8954673 1329544 1 Aug 2014 7:43:32 UTC 14 Jul 2015 13:03:32 UTC Im Gange --- --- 2,386.39 2,386.39 UK Met Office HadAM3P-HadRM3P Europe v6.09

Folks, this entire CPDN-Project needs a serious rework: From completely disappearing web access to weekend service absenty to delayed credit updates to errant credit updates to various inaccessible upload-servers to errant jobs and on and on every day some problem seem to be solved and two new arise. It's is getting a monstrous task for us users to generally handle all these pitfalls.
7) Message boards : Number crunching : ANOTHER UPLOAD PROBLEM (Message 49897)
Posted 1 Sep 2014 by Waldmeister
Post:
Problems as usual (EU-task):

Zips 1..12 don't transfer at all.
Zip 13 transfers to 100% and then do not finish.

Please tell someone here in this thread when things are working normal again. Up till then I have to seperate CPND from the rest of BOINCData-folder to ensure that unnecessary uploads won't occur.

8) Message boards : Number crunching : Extremely high work units done. (Message 49817)
Posted 21 Aug 2014 by Waldmeister
Post:
Back to normal... :( ;)
9) Message boards : Number crunching : Credit updates? (Message 49800)
Posted 20 Aug 2014 by Waldmeister
Post:
Yep, more than 2.6M instead of just above 100k with me.

I'm kind of delighted! ;)

Additional info:

On my account page it reads ...

HadSM3 Model-Years 17,433.28
HadSM3 Complete (45-year) Runs 387.41


... which in my personal estimation seems to me messed up too, where as on the page which lists my tasks, everything seems updated correctly and plausible.
10) Message boards : Number crunching : Compute Errors on Pacific North West v7.22 Tasks (Message 49761)
Posted 18 Aug 2014 by Waldmeister
Post:
Anybody having first experience with the newest PNW-Batch (haven't startet my three tasks yet)?
11) Message boards : Number crunching : ANOTHER UPLOAD PROBLEM (Message 49718)
Posted 6 Aug 2014 by Waldmeister
Post:
Confirmation from me too, everyone of my trickles, that were pending, now have uploaded.

Credit will be taken care of later, I suppose. I am in no hurry on that.
12) Message boards : Number crunching : ANOTHER UPLOAD PROBLEM (Message 49693)
Posted 2 Aug 2014 by Waldmeister
Post:
Just for notice:

3 trickles of mine (hadcm3n-task) apparently didn't transfer up to today.
Now labelled as .SENT-Files in CPDN-folder.
13) Message boards : Number crunching : HADCM3N about to start - is my Pentium type OK? (Message 49641)
Posted 26 Jul 2014 by Waldmeister
Post:
CPU-temperature is a science in itself, because all CPU have different levels of max. temp. and you always have to have knowledge about the exact read out process. Therefore I have to admit, I'm not the finest expert in the field of computer temperature settings, however it seems at the high end of the legal range. If you hadn't any problems up till now with those temperatures, then keep up the good work.

However I'm a little concerned about SSD. Now, SSD is generally a fine thing, great advance and alternate in technology. However it has one drawback, one disadvantage that doesn't usually show up in many other computer operations but may show up in BOINC/CPDN: Due to the relatively frequent file update operations with huge amounts of data you touch one field, where SSD is still disadvantageous to HDD, and that is the amount/count of writing operations on SSD. You may refer to that attribute by reading general remarks (e.g. wikipedia) on SSD.

That said, I personally have no practical experience with SSD on my own, so my remarks are purely hypothetical. However just by theoretical thinking, just by calculation of the amount of data-heavy writing operations on SDD those extremely long CPDN tasks on their own may use up a significant part if not the entire life span of an SDD.

SSD should usually be used in an environment where read operation significantly outnumber write operations; e.g. bootup-process of computer.

Also, please read the follwing interesting experience by Dave himself (lowest entry):
http://climateapps2.oerc.ox.ac.uk/cpdnboinc/forum_thread.php?id=7446&nowrap=true#44754

Therefore, concerning SSD, you may ask Dave, he may be a better "practical" expert running BOINC/CPDN on SSD.
14) Message boards : Number crunching : HADCM3N about to start - is my Pentium type OK? (Message 49639)
Posted 25 Jul 2014 by Waldmeister
Post:
Hello Mike

Greetings vom Stuttgart, Germany

Your pentiums are just fine (if it's both times 2020M). As Dave said the only definite restriction is a command extension set called sse2. Now in reality, this is a real fossil of command extension set, introduced as early as 2001. Roughly 2005 or 2006 the last CPUs without sse2 were produced/delivered.

The characteristics of your computer are shown on the follwing INTEL-page:

http://ark.intel.com/de/products/71142/Intel-Pentium-Processor-2020M-2M-Cache-2_40-GHz

Your computer has sse4x. CPU's with that practically always include all lower versions of sse (sse2, sse3, ssse3).

More important than CPU is that you take care of your computer (probably a mobile computer anyway) in general. Treat your computer carefully, don't push it hard. There are a lot of harddisk-operations so make sure you don't mechanically stress your harddisk too much. Furtheron take care of heat generation in your laptop. Maybe clean it up before use to insure optimal air flow. Furtheron don't confuse your laptop with too many complex situations, say frequent change of other applications (outside Boinc/CPDN) and turning the computer off and on frequently. Best scenario is, having Boinc/CPDN as only application, then putting the computer on a table, starting the task an then letting it untouched for those 10-20 days.
15) Message boards : Number crunching : ANOTHER UPLOAD PROBLEM (Message 49359)
Posted 14 Jun 2014 by Waldmeister
Post:
Ok, my task cleared too. Case (temporarily) closed.
16) Message boards : Number crunching : ANOTHER UPLOAD PROBLEM (Message 49329)
Posted 10 Jun 2014 by Waldmeister
Post:
Hello folks!

Gotta report the same problem as in first post of this thread again: zip-file No.13 loads up to 100% and then doesn't finish, it rather restarts upload.

The task itself seemed to work really well the past few days. No problems of any kind visible. Just the very last upload of Zip-file No.13 doesn't complete.
Tried it three times now.

http://climateapps2.oerc.ox.ac.uk/cpdnboinc/result.php?resultid=16656981


Here the logs of the message menu (... lines denote messages of other projects)

10.06.2014 12:44:05 | climateprediction.net | Computation for task hadam3p_eu_r858_2013_1_008755442_0 finished
...
10.06.2014 12:50:05 | | Resuming network activity
10.06.2014 12:50:05 | climateprediction.net | Started upload of hadam3p_eu_r858_2013_1_008755442_0_9.zip
...
10.06.2014 12:50:05 | climateprediction.net | Started upload of hadam3p_eu_r858_2013_1_008755442_0_10.zip
...
10.06.2014 12:50:15 | climateprediction.net | Sending scheduler request: To send trickle-up message.
10.06.2014 12:50:15 | climateprediction.net | Not requesting tasks: "no new tasks" requested via Manager
...
10.06.2014 12:50:18 | climateprediction.net | Scheduler request completed
...
10.06.2014 12:59:14 | climateprediction.net | Finished upload of hadam3p_eu_r858_2013_1_008755442_0_9.zip
10.06.2014 12:59:14 | climateprediction.net | Started upload of hadam3p_eu_r858_2013_1_008755442_0_11.zip
10.06.2014 12:59:45 | climateprediction.net | Finished upload of hadam3p_eu_r858_2013_1_008755442_0_10.zip
10.06.2014 12:59:45 | climateprediction.net | Started upload of hadam3p_eu_r858_2013_1_008755442_0_12.zip
10.06.2014 13:07:28 | climateprediction.net | Finished upload of hadam3p_eu_r858_2013_1_008755442_0_11.zip
10.06.2014 13:07:28 | climateprediction.net | Started upload of hadam3p_eu_r858_2013_1_008755442_0_13.zip
...
10.06.2014 13:08:22 | climateprediction.net | Finished upload of hadam3p_eu_r858_2013_1_008755442_0_12.zip
...
10.06.2014 13:15:45 | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_eu_r858_2013_1_008755442_0_13.zip: No such file or directory
10.06.2014 13:15:45 | climateprediction.net | Temporarily failed upload of hadam3p_eu_r858_2013_1_008755442_0_13.zip: transient upload error
10.06.2014 13:15:45 | climateprediction.net | Backing off 00:02:57 on upload of hadam3p_eu_r858_2013_1_008755442_0_13.zip
10.06.2014 13:18:43 | climateprediction.net | Started upload of hadam3p_eu_r858_2013_1_008755442_0_13.zip
10.06.2014 13:26:21 | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_eu_r858_2013_1_008755442_0_13.zip: No such file or directory
10.06.2014 13:26:21 | climateprediction.net | Temporarily failed upload of hadam3p_eu_r858_2013_1_008755442_0_13.zip: transient upload error
10.06.2014 13:26:21 | climateprediction.net | Backing off 00:05:38 on upload of hadam3p_eu_r858_2013_1_008755442_0_13.zip
10.06.2014 13:26:31 | | Suspending network activity - user request
10.06.2014 13:52:48 | | Resuming network activity
10.06.2014 13:52:48 | climateprediction.net | Started upload of hadam3p_eu_r858_2013_1_008755442_0_13.zip
...
10.06.2014 14:00:17 | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_eu_r858_2013_1_008755442_0_13.zip: No such file or directory
10.06.2014 14:00:17 | climateprediction.net | Temporarily failed upload of hadam3p_eu_r858_2013_1_008755442_0_13.zip: transient upload error
10.06.2014 14:00:17 | climateprediction.net | Backing off 00:10:37 on upload of hadam3p_eu_r858_2013_1_008755442_0_13.zip
10.06.2014 14:00:24 | | Suspending network activity - user request


The upload-section for this ZIP-File in file client_state.xml looks like this:

<file>
<name>hadam3p_eu_r858_2013_1_008755442_0_13.zip</name>
<nbytes>36821677.000000</nbytes>
<max_nbytes>150000000.000000</max_nbytes>
<md5_cksum>b4d07615d3c72c2219551c58bb075fba</md5_cksum>
<status>1</status>
<upload_url>http://cpdn-restarts.oerc.ox.ac.uk/cgi-bin/file_upload_handler</upload_url>
<persistent_file_xfer>
<num_retries>3</num_retries>
<first_request_time>1402397041.847410</first_request_time>
<next_request_time>1402402255.478571</next_request_time>
<time_so_far>1403.103088</time_so_far>
<last_bytes_xferred>36821891.000000</last_bytes_xferred>
<is_upload>1</is_upload>
</persistent_file_xfer>
</file>



Could someone please look into this? Has it got to do with this announcement: http://climateapps2.oerc.ox.ac.uk/cpdnboinc/forum_thread.php?id=7846#49312 ?

Greetings Waldmeister
17) Message boards : Number crunching : Unsure about correct upload of zip files (Message 44550)
Posted 20 Jul 2012 by Waldmeister
Post:
Well, that's the way it is. No messages there for roughly a month, cross project wise. I don't get it either.

I have decided to continue the task. Trickle 7 with zip file now uploaded, now also with conventional message. Zip file 7 also correctly erased from my computer, zips 5/6 still there. And as I said, no older messages available.

Let's see at the end of the task, weather zip-files 5/6 have been send up or not.
If wu/task then shows success, then they are send up. If wu/task still pending, there remains a problem.
18) Message boards : Number crunching : Unsure about correct upload of zip files (Message 44548)
Posted 20 Jul 2012 by Waldmeister
Post:
Thank you both!

Well, and there is the great mystery.

I already tried overnight what mo.v suggested and it generated the 7th trickle and 7th zip file (upload manually disabled). And there the great mystery begins: Transfer tab has showing 7th zip-file but not 5th and 6th zip-file. However in CPDN-directory all three zip-files (5 through 7) show up, all with appearently normal content. It also shows the 7th trickle-file.

I am simply not getting that.

Besides, those txt-files, including stdoutdae.txt, show nothing, they all have no recent data/text/messages, for whatever reason.

Everything will be fine if there is a mechanism to send these zip-files 5 and 6 up or some info whether they are already up.

Hmmm, i am clueless.
19) Message boards : Number crunching : Unsure about correct upload of zip files (Message 44538)
Posted 20 Jul 2012 by Waldmeister
Post:
Hello folks.

I've got a little problem. Due to a computer problem some 1� days ago, that may or may not have affected Boinc and CPDN (long story), i am not sure about whether file uploads of CPDN have been correct tonight.


May you please have a look at task/Result # 14855580.

Trickles 1-4 and it's associated zip-files should be ok and send up normally some days ago.

But i may have a problem with trickles 5 and 6: Well, trickles 5 and 6 were eventually send up tonight (they are listed in the result pages) and deleted in the CPDN folder of my computer. However, to my amazement, the associated zip-files (or more correctly zip folders) are still in my CPDN folder and NOT deleted!

May you please check weather these zip folders were correctly send up or not
(Folder names: hadam3p_saf_1z67_1990_1_007031015_2_5 and hadam3p_saf_1z67_1990_1_007031015_2_6).

If they are not send up, if they are not within your system, may you give me a hint how to send them up?
Remark: I have all trickles and all zip files(folders) still available.

Thank you in advance for your services.
20) Message boards : Number crunching : Upload Failure (Message 44380)
Posted 12 Jun 2012 by Waldmeister
Post:
mine too! :D


Next 20

©2024 climateprediction.net