climateprediction.net home page
How are the climate prediction tasks designed to work?

How are the climate prediction tasks designed to work?

Questions and Answers : Getting started : How are the climate prediction tasks designed to work?
Message board moderation

To post messages, you must log in.

AuthorMessage
archeye

Send message
Joined: 3 Jul 19
Posts: 3
Credit: 50,058
RAC: 0
Message 61001 - Posted: 26 Sep 2019, 5:05:33 UTC
Last modified: 26 Sep 2019, 5:06:50 UTC

I am running my first 2 tasks for this project and just wish to understand better how the project tasks are running on my computer.

It looks like there are regular attempts to upload zip files as each task progresses.

I read in other forums and the word "trickle" is used. Is this what is happening here?

If it is I assume it is to reduce the size of the final completed task upload.

However, when I look at the messages in the Boinc Manager there are many regular repeats of the same thing and they all show "project communication failed".

Is this normal?



ID: 61001 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7230
Credit: 23,154,247
RAC: 5,416
Message 61002 - Posted: 26 Sep 2019, 5:38:50 UTC

There are 2 types of upload:
1. Trickle_up files, which were originally designed for allocating credits all through the model run, rather than all at the finish, as with other projects.
However, they have also been used to send back small amounts of science data. Not lately though.
They are actually an RPC, and don't show up in the Transfers tab.

2. Zip files, which are a compressed copy of the data created since the start, or the previous zip.
These are usually at one model year intervals.

Usually, both of these data types get created at about the same time, for convenience.

You can see how many there will be by the 5th set of characters in the file name.

*********************

"project communication failed"

This is a yes and no situation.

No, it shouldn't happen.
Yes it does happen a lot for the models that you're running.

If you look at the 2nd set of characters in the name, you can see that these are cam25 - Central America, at a resolution of 25 Kilometres.
They are from a research centre in Mexico, and that's where the files are supposed to go.
But there are constant problems with getting them there for reasons unknown.

Best advice at present - plod on and hope.

We've been wondering if anyone is still having problems, so I'll let the project people know.
ID: 61002 · Report as offensive     Reply Quote
archeye

Send message
Joined: 3 Jul 19
Posts: 3
Credit: 50,058
RAC: 0
Message 61020 - Posted: 26 Sep 2019, 16:36:55 UTC - in response to Message 61002.  
Last modified: 26 Sep 2019, 16:42:51 UTC

Thanks a lot for your reply.

For info, these are other messages I see;

and I will keep going with these tasks :)

also, some of the uploads must have worked. I now see some credit on my account.

PC

1617 climateprediction.net 26/09/2019 16:13:06 [error] Error reported by file upload server: [wah2_cam25_a0ho_200405_18_832_011891003_0_r301827096_5.zip] locked by file_upload_handler PID=141543

PC

1618 climateprediction.net 26/09/2019 16:13:06 Temporarily failed upload of wah2_cam25_a0ho_200405_18_832_011891003_0_r301827096_5.zip: transient upload error
ID: 61020 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 2722
Credit: 3,327,142
RAC: 1,283
Message 61024 - Posted: 26 Sep 2019, 19:49:48 UTC

1618 climateprediction.net 26/09/2019 16:13:06 Temporarily failed upload of wah2_cam25_a0ho_200405_18_832_011891003_0_r301827096_5.zip: transient upload error


The transient upload error will be because the server is getting hammered due to the backlog. Once that clears things should be fine.

With regards to credit, the credit script only runs once a week at the moment. Andy was working on an alternative script that would run daily and not be so resource intensive but I don't know if he gave up on it or it just got pushed to the back of the queue with other work.
ID: 61024 · Report as offensive     Reply Quote

Questions and Answers : Getting started : How are the climate prediction tasks designed to work?

©2020 climateprediction.net