climateprediction.net home page
Is it uploaded or not? Things are unclear.

Is it uploaded or not? Things are unclear.

Questions and Answers : Unix/Linux : Is it uploaded or not? Things are unclear.
Message board moderation

To post messages, you must log in.

AuthorMessage
old_user26469

Send message
Joined: 23 Oct 04
Posts: 13
Credit: 70,493
RAC: 0
Message 7504 - Posted: 23 Jan 2005, 17:58:07 UTC

Well, my first upload's just finished on this i686 Linux box. Perhaps.

The total set of messages emitted during phase completion/upload (with interweaved junk from the next run removed) was:

Phase over, going into post_processing()
In pre_initialise_phase (part 1 of 3)
In initialise_phase (part 2 of 3)
Calculating global means for files .pa|.x3|.nc
Calculating regional means for .pa|.x3|.nc
Calculating global means for files .pd|.x3|.nc
Calculating regional means for .pd|.x3|.nc
Calculating global means for files .pe|.x3|.nc
Calculating regional means for .pe|.x3|.nc
Calculating global means for files .pf|.x3|.nc
Calculating regional means for .pf|.x3|.nc
2005-01-23 17:50:55 [climateprediction.net] Sending request to scheduler: http://climateapps2.oucs.ox.ac.uk/cpdnboinc_cgi/cgi
2005-01-23 17:50:55 [climateprediction.net] Scheduler RPC to http://climateapps2.oucs.ox.ac.uk/cpdnboinc_cgi/cgi succeeded
Calculating global means for files .pg|.x3|.nc
Calculating regional means for .pg|.x3|.nc
Post-processing successful!
Finished a complete run, now you can upload!
adding: 20qfaa.pa.gmts.x1.nc (deflated 34%)
[413 lines removed]
adding: 20qfca.phq6c10.x3.nc (deflated 57%)
adding: 20qfca.pw.8yac.x3.nc (deflated 17%)
adding: restart.day (deflated 47%)
2005-01-23 17:54:24 [climateprediction.net] Computation for result 20qf_100115223 finished
2005-01-23 17:54:25 [climateprediction.net] Starting result 35gz_100168540_1 using hadsm3 version 4.04
2005-01-23 17:54:25 [climateprediction.net] Started upload of 20qf_100115223_1_1.zip
2005-01-23 17:54:25 [climateprediction.net] Started upload of 20qf_100115223_1_2.zip
2005-01-23 17:56:26 [climateprediction.net] Temporarily failed upload of 20qf_100115223_1_2.zip
2005-01-23 17:56:26 [climateprediction.net] Backing off 1 minutes and 0 seconds on transfer of file 20qf_100115223_1_2.zip
2005-01-23 17:56:26 [climateprediction.net] Started upload of 20qf_100115223_1_3.zip
2005-01-23 17:56:30 [climateprediction.net] Finished upload of 20qf_100115223_1_1.zip
2005-01-23 17:56:30 [climateprediction.net] Throughput 24681703 bytes/sec
2005-01-23 17:56:30 [climateprediction.net] Started upload of 20qf_100115223_1_4.zip
2005-01-23 17:58:26 [climateprediction.net] Temporarily failed upload of 20qf_100115223_1_3.zip
2005-01-23 17:58:26 [climateprediction.net] Backing off 1 minutes and 0 seconds on transfer of file 20qf_100115223_1_3.zip
2005-01-23 17:58:26 [climateprediction.net] Started upload of 20qf_100115223_1_5.zip
2005-01-23 17:58:31 [climateprediction.net] Temporarily failed upload of 20qf_100115223_1_4.zip
2005-01-23 17:58:31 [climateprediction.net] Backing off 1 minutes and 0 seconds on transfer of file 20qf_100115223_1_4.zip
2005-01-23 17:58:31 [climateprediction.net] Started upload of 20qf_100115223_1_2.zip
2005-01-23 17:58:44 [climateprediction.net] Finished upload of 20qf_100115223_1_5.zip
2005-01-23 17:58:44 [climateprediction.net] Throughput 18624993 bytes/sec
2005-01-23 17:59:07 [climateprediction.net] Finished upload of 20qf_100115223_1_2.zip
2005-01-23 17:59:07 [climateprediction.net] Throughput 35330073 bytes/sec
2005-01-23 17:59:26 [climateprediction.net] Started upload of 20qf_100115223_1_3.zip
2005-01-23 17:59:31 [climateprediction.net] Started upload of 20qf_100115223_1_4.zip
2005-01-23 17:59:55 [climateprediction.net] Finished upload of 20qf_100115223_1_4.zip
2005-01-23 17:59:55 [climateprediction.net] Throughput 26055248 bytes/sec
2005-01-23 18:00:06 [climateprediction.net] Finished upload of 20qf_100115223_1_3.zip
2005-01-23 18:00:06 [climateprediction.net] Throughput 44871253 bytes/sec

Leaving aside the utterly insane bandwidth figures (45Mb/s? On a 22Kb/s-upload ADSL line?) and the gratitous temporary failures in the absence of network problems (is there a really short timeout somewhere?), 90% of the generated zip files haven't been uploaded, and are still sitting on my disk in the projects/climateprediction.net/20qf_100115223 subdirectory.

The server's stats for result 420728 still say `Server state: In progress / Client state: Unknown'.

What's going on? Are the heaps of non-uploaded files needed? Is the upload actually complete? Neither the client nor the server have given me any reason to believe that, but nothing's been uploaded for half an hour now.

Am I jumping at shadows?
ID: 7504 · Report as offensive     Reply Quote
Profile geophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2169
Credit: 64,555,907
RAC: 5,858
Message 7508 - Posted: 23 Jan 2005, 19:44:21 UTC

The result status on the server will update with your first trickle/communication with the next model. The model leaves about 300 mb of compressed files on your hard drive after it has finished. If you don't have room, you can move it to CD/DVD, or delete it. Occasionally the project investigators will request more files from the model if they find it interesting, but obviously you don't have to keep them or archive them if you don't wish to.
ID: 7508 · Report as offensive     Reply Quote
Profile astroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 7509 - Posted: 23 Jan 2005, 19:46:52 UTC
Last modified: 23 Jan 2005, 19:50:10 UTC

Hi,

The five summary files were successfully uploaded. (Don't know why there were temporary failures but are probably related to server connection.)

The other 365 zipped files are stored on your computer for possible future use. (You can burn them to CD-R or DVD-R if you choose, or delete them for the space, if you must. [If the additional files are required by the team for further study after it was deleted, someone would have to re-run it.] It is recommended that you move the zip'd folder to an Archive-folder outside your boinc folder; that permits faster backups of the boinc folder.)

It will take awhile for the "success" post to occur in your stats, but the credits should already be posted.

HTH.


Edit: Oops, sorry, George, your post arrived while I was doing my hunt-n-peck typing thing. Didn't mean to step on you.
"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 7509 · Report as offensive     Reply Quote
old_user26469

Send message
Joined: 23 Oct 04
Posts: 13
Credit: 70,493
RAC: 0
Message 7511 - Posted: 23 Jan 2005, 20:25:47 UTC - in response to Message 7509.  

> The five summary files were successfully uploaded. (Don't know why there were
> temporary failures but are probably related to server connection.)

At the very instant it reported failures with some of them, it was uploading others to the same place. Perhaps the upload server was overloaded and throttling connections, or something?

> The other 365 zipped files are stored on your computer for possible future
> use. (You can burn them to CD-R or DVD-R if you choose, or delete them for the

I have hundreds of unused CD-Rs: this seems like an excellent use for a few of them.

> It is
> recommended that you move the zip'd folder to an Archive-folder outside your
> boinc folder; that permits faster backups of the boinc folder.)

I must confess that I classify the BOINC stuff as `transient' and don't back it up in my regular schedule at all. (Everything's RAIDed anyway, so the chances of hardware failure eating anything are minimal.)

> It will take awhile for the "success" post to occur in your stats, but the
> credits should already be posted.

I've never really seen the point of credit-hunting: I'm doing this because as long as the machines are sitting idle they may as well be doing something to help people ameliorate the effects of all the power they're using. :)

> Edit: Oops, sorry, George, your post arrived while I was doing my hunt-n-peck
> typing thing. Didn't mean to step on you.

:)
ID: 7511 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 7515 - Posted: 23 Jan 2005, 22:03:43 UTC
Last modified: 23 Jan 2005, 23:28:51 UTC

I had something similar on the 5th January. My problem was caused by the dialup connection dropping out
several times. The 1st 3 zips failed and were re-scheduled. They were successfully upload after the other
2 finished, and the wu was shown as completed and successful, so I guess the server knowns what it's doing.

BUT....
then zips 1-3 remained in the folder, and there was a set of error messages as follows:

2005-01-05 07:36:24 [climateprediction.net] Couldn't delete file projectsclimateprediction.net25t9_100121870_3_1.zip
2005-01-05 07:40:25 [climateprediction.net] Couldn't delete file projectsclimateprediction.net25t9_100121870_3_3.zip
2005-01-05 07:40:39 [climateprediction.net] Couldn't delete file projectsclimateprediction.net25t9_100121870_3_2.zip

So, when I burnt the 330meg of files to cd, (along with the previous completed wu), I included all
5 upload zips. To be sure, To be sure! (Two wus easily fit on one cd.)


Les


edit
I had to leave this in a hurry. A dog was hit outside, and I had to get her to a vet in a hurry.

To continue. (A bit. When I remember what I was going to say.)

Your results are not yet complete. This will occur at your next trickle, or immediately if you do an 'Update'.

But your result graphs are VERRRRY Interesting!!! as they used to say on Laugh In.

There are a lot of users not sure what to do about the 330meg of files.
It really needs an addendum to the faq file.
And the Tech_Faq needs to be added to the lefthand blue menu to make it easier to find.

Maybe if the admin staff read this.....?

Les
ID: 7515 · Report as offensive     Reply Quote

Questions and Answers : Unix/Linux : Is it uploaded or not? Things are unclear.

©2024 climateprediction.net