climateprediction.net home page
Cleanup

Cleanup

Message boards : Number crunching : Cleanup
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile tullio

Send message
Joined: 6 Aug 04
Posts: 264
Credit: 965,476
RAC: 0
Message 35473 - Posted: 12 Nov 2008, 14:14:43 UTC
Last modified: 12 Nov 2008, 14:20:25 UTC

I am running hadcm 6.02. This morning it attempted to send up trickles but received this message:
12-Nov-2008 05:54:55 [climateprediction.net] Sending scheduler request: To send trickle-up message. Requesting 0 seconds of work, reporting 0 completed tasks
12-Nov-2008 05:55:00 [climateprediction.net] Scheduler request succeeded: got 0 new tasks
Can I clean the .nc files according to the rule no .pe, no .ph, no .pf or must wait?
Tullio
I forgot this:

12-Nov-2008 05:55:00 [climateprediction.net] Message from server: Project is temporarily shut down for maintenance
ID: 35473 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 35476 - Posted: 13 Nov 2008, 7:22:35 UTC

The CPDN server\'s up and running again. Don\'t clean up any .nc files until the model\'s trickled successfully. The cleaning instructions are here. Notice how Richard points out further down the thread that the best time to clean up is after a decadal file upload but before the model reaches December of the next year.
Cpdn news
ID: 35476 · Report as offensive     Reply Quote
old_user22652

Send message
Joined: 3 Oct 04
Posts: 39
Credit: 13,172,838
RAC: 0
Message 35563 - Posted: 21 Nov 2008, 7:25:10 UTC
Last modified: 21 Nov 2008, 7:30:04 UTC

A hadcm v 6.02 completed overnight. I hadn\'t cleaned out the .nc files as suggested by mo.v and others; the computer is dedicated to CPDN and there was plenty of disc-space. The backup times were becoming slightly alarming, and backing up the backups to an external disc was taking in excess of 2 hrs!

However, I notice that the disc-usage has dropped from approx 6.5GB to 3.07GB, so it looks as though the model has taken its .nc files with it. I will be uploading the final .zip when the server comes back online.

John
GW3PRV

Edit/ The disc usage is still high because there is another v 6.02 running; when this completes tomorrow, I am expecting the disc-usage to drop again.
ID: 35563 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 35564 - Posted: 21 Nov 2008, 10:42:41 UTC
Last modified: 21 Nov 2008, 10:45:47 UTC

When a model has completed and reported, we can of course delete the entire model folder.

We can also set CPDN to No New Tasks, wait until every model has completed and reported, then reset CPDN only. This cleans out all old model files and will reduce the size of backups.

The post about how to delete the .nc files is rather long because everything is explained in detail for the benefit of newbies and members who\'ve never looked inside the BOINC folder before. I also added extra precautions that aren\'t strictly necessary. One can in fact look inside a model\'s folder and even delete the .nc files while it\'s crunching, though I didn\'t recommend that.

The latest version of the CPDN HADCMs delete their own .nc files at the end of each model decade so we don\'t need to clean them up manually.
Cpdn news
ID: 35564 · Report as offensive     Reply Quote
old_user22652

Send message
Joined: 3 Oct 04
Posts: 39
Credit: 13,172,838
RAC: 0
Message 35580 - Posted: 23 Nov 2008, 9:36:17 UTC

Model hadcm3ivolc_12b3_2000_80_06001697_2 completed overnight. Disc usage is now down to ~500MB, so the .nc files have been cleaned up at last, and the backup time is again down to seconds. I\'m glad to see the back of them.

\"Oh we\'ll all go together when we go\" (T.Lehrer, circa 1960)

John
GW3PRV
ID: 35580 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 35581 - Posted: 23 Nov 2008, 13:07:53 UTC
Last modified: 23 Nov 2008, 13:09:34 UTC

Thanks for completing yet another model for CPDN. By the way, your Beta credits don\'t seem to display in your account. Mine are there, so are Tullio\'s. Did you use the same email address for Beta as for the CPDN main project?
Cpdn news
ID: 35581 · Report as offensive     Reply Quote
old_user22652

Send message
Joined: 3 Oct 04
Posts: 39
Credit: 13,172,838
RAC: 0
Message 35586 - Posted: 24 Nov 2008, 11:53:55 UTC

Yes, Mo. Same email address, but as you say the credits haven\'t appeared on the main board. Not too concerned.

John
GW3PRV
ID: 35586 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 35590 - Posted: 24 Nov 2008, 19:37:24 UTC

Rats.

In that case your Beta credits ought to be transferred automatically to your CPDN account. I\'ll start a new thread about this on the Beta forum to ask if any other members\' credits aren\'t being transferred to CPDN. Ages ago I sent private messages to the few Beta members without a CPDN account advising them to attach. But they\'re in a different situation from you. I thought we\'d sorted out the remaining Beta credit anomalies.
Cpdn news
ID: 35590 · Report as offensive     Reply Quote

Message boards : Number crunching : Cleanup

©2024 climateprediction.net