climateprediction.net home page
ANOTHER UPLOAD PROBLEM

ANOTHER UPLOAD PROBLEM

Message boards : Number crunching : ANOTHER UPLOAD PROBLEM
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 15 · 16 · 17 · 18 · 19 · 20 · 21 . . . 33 · Next

AuthorMessage
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 51230 - Posted: 15 Jan 2015, 5:18:54 UTC

However, to save you from getting involved in rocket science, I've found a reference to the 2 models being talked about here:
hadcm3n upload error

In the 2nd post, Eirik Redd said:
Seeing similar on hadm3n and hadm3s uploads to rapid-watch.badc.rl.ac.uk

BADC is housed in a town a dozen miles south of Oxford, so I'll send an email to Peter to get him to email the BADC people.

ID: 51230 · Report as offensive     Reply Quote
Kevin

Send message
Joined: 5 Jul 09
Posts: 63
Credit: 6,091,274
RAC: 0
Message 51232 - Posted: 15 Jan 2015, 6:11:34 UTC - in response to Message 51230.  

However, to save you from getting involved in rocket science,


I could not handle rocket science now, just had a "fun" night driving around with a high sided trailor.

I will leave these zip files sitting in the transfers list, the tasks are showing as in progress but with full credits awarded on my computer page.

ID: 51232 · Report as offensive     Reply Quote
Profile Alan K

Send message
Joined: 22 Feb 06
Posts: 484
Credit: 29,579,234
RAC: 4,572
Message 51235 - Posted: 15 Jan 2015, 10:37:03 UTC - in response to Message 51232.  

Hi

Relevant section from my Client_state.xml for the short run:

<file>
<name>hadcm3s_73wm_1980_2_009364084_1_1.zip</name>
<nbytes>66338617.000000</nbytes>
<max_nbytes>188743680.000000</max_nbytes>
<md5_cksum>5790d224d0bb309e31142a4738c5a5c0</md5_cksum>
<status>1</status>
<upload_url>http://rapid-watch.badc.rl.ac.uk/cpdn_cgi/file_upload_handler</upload_url>
<persistent_file_xfer>
<num_retries>14</num_retries>
<first_request_time>1421196591.728890</first_request_time>
<next_request_time>1421323740.053478</next_request_time>
<time_so_far>31.137779</time_so_far>
<last_bytes_xferred>0.000000</last_bytes_xferred>
<is_upload>1</is_upload>
</persistent_file_xfer>
</file>
<file>
<name>hadcm3s_73wm_1980_2_009364084_1_2.zip</name>
<nbytes>66318377.000000</nbytes>
<max_nbytes>188743680.000000</max_nbytes>
<md5_cksum>68aaadb1390d0d8a9e2578ed775ae903</md5_cksum>
<status>1</status>
<upload_url>http://rapid-watch.badc.rl.ac.uk/cpdn_cgi/file_upload_handler</upload_url>
<persistent_file_xfer>
<num_retries>11</num_retries>
<first_request_time>1421231649.963341</first_request_time>
<next_request_time>1421327551.950719</next_request_time>
<time_so_far>24.040380</time_so_far>
<last_bytes_xferred>0.000000</last_bytes_xferred>
<is_upload>1</is_upload>
</persistent_file_xfer>
</file>

Hope this helps.
ID: 51235 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 925
Credit: 34,100,818
RAC: 11,270
Message 51237 - Posted: 15 Jan 2015, 10:51:00 UTC - in response to Message 51235.  

http://rapid-watch.badc.rl.ac.uk/cpdn_cgi/file_upload_handler is giving me

Error code: ERR_CONNECTION_REFUSED

That'll need liaison and attention by the two sets of admins.
ID: 51237 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 925
Credit: 34,100,818
RAC: 11,270
Message 51238 - Posted: 15 Jan 2015, 14:49:06 UTC - in response to Message 51237.  

It's alive! Andy says "this machine is now accepting uploads."

Probably lots of them, each one rather slowly...
ID: 51238 · Report as offensive     Reply Quote
Kevin

Send message
Joined: 5 Jul 09
Posts: 63
Credit: 6,091,274
RAC: 0
Message 51239 - Posted: 15 Jan 2015, 15:47:00 UTC - in response to Message 51238.  

It's alive! Andy says "this machine is now accepting uploads."

Probably lots of them, each one rather slowly...


All zips uploaded and tasks reported as completed.

thanks

ID: 51239 · Report as offensive     Reply Quote
Profile Alan K

Send message
Joined: 22 Feb 06
Posts: 484
Credit: 29,579,234
RAC: 4,572
Message 51240 - Posted: 15 Jan 2015, 23:08:52 UTC - in response to Message 51239.  
Last modified: 15 Jan 2015, 23:09:08 UTC

My two zip files have gone - at last! Model now cleared from tasks.
ID: 51240 · Report as offensive     Reply Quote
Profile Iain Inglis
Volunteer moderator

Send message
Joined: 16 Jan 10
Posts: 1079
Credit: 6,904,049
RAC: 6,657
Message 51241 - Posted: 15 Jan 2015, 23:37:15 UTC

Note that there is another way to find the upload servers for users of the recent BOINC Manager releases (7.4.36 at present), which is the advanced menu item offering "Event Log Diagnostic Flags". Select the "file_xfer_debug" option and you'll then get entries in the event log, such as these ...

15/01/2015 23:08:11 | climateprediction.net | Started upload of hadam3p_pnw_w1ep_2007_1_009351114_0_6.zip
15/01/2015 23:08:11 | climateprediction.net | [file_xfer] URL: http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler

... which is perhaps more in keeping with the modern trend in application design to keep users away from the file system.
ID: 51241 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 925
Credit: 34,100,818
RAC: 11,270
Message 51242 - Posted: 15 Jan 2015, 23:53:13 UTC - in response to Message 51241.  

From the same dialog, you can pick "http_debug", which gives some of the underlying causes hiding behind those generic "tansient HTTP error" messages.
ID: 51242 · Report as offensive     Reply Quote
MartinNZ

Send message
Joined: 22 Mar 06
Posts: 144
Credit: 24,695,428
RAC: 0
Message 51441 - Posted: 20 Feb 2015, 10:47:53 UTC

I've 6 hadam3p_afr trickles that have been trying to upload all day. Log says Internet access OK - project servers may be temporarily down.

I'm sure someone is aware of it, but if they aren't there's still a few hours left before the weekend - which is when these thing normally go astray ;-)
ID: 51441 · Report as offensive     Reply Quote
Jonathan Miller

Send message
Joined: 27 Jul 12
Posts: 21
Credit: 269,602
RAC: 0
Message 51442 - Posted: 20 Feb 2015, 15:26:23 UTC - in response to Message 51441.  

Hi,

Sorry about this, I was doing some maintenance on data held by the upload server, which caused apache to crawl along and then crash early this morning.

I have rebooted her and she seems fine now.

I hope your upload makes it in the next few hours :-)

Jonathan
ID: 51442 · Report as offensive     Reply Quote
MartinNZ

Send message
Joined: 22 Mar 06
Posts: 144
Credit: 24,695,428
RAC: 0
Message 51445 - Posted: 21 Feb 2015, 6:56:44 UTC - in response to Message 51442.  

Yup, all clear. Keep up the good work.
ID: 51445 · Report as offensive     Reply Quote
Profile Alan K

Send message
Joined: 22 Feb 06
Posts: 484
Credit: 29,579,234
RAC: 4,572
Message 51455 - Posted: 24 Feb 2015, 11:33:44 UTC - in response to Message 51445.  

Got an upload error on a "short" model:

24/02/2015 10:13:02 | climateprediction.net | [http] [ID#243] Received header from server:
24/02/2015 10:13:02 | climateprediction.net | [http] [ID#243] Info: Connection #1623 to host rapid-watch.badc.rl.ac.uk left intact
24/02/2015 10:13:03 | climateprediction.net | [error] Error reported by file upload server: Server is out of disk space
24/02/2015 10:13:03 | climateprediction.net | Temporarily failed upload of hadcm3s_7orf_2000_2_009450839_1_2.zip: transient upload error
24/02/2015 10:13:03 | climateprediction.net | Backing off 03:01:32 on upload of hadcm3s_7orf_2000_2_009450839_1_2.zip


Cheers
ID: 51455 · Report as offensive     Reply Quote
Profile Bonsai911

Send message
Joined: 9 Sep 04
Posts: 228
Credit: 30,229,255
RAC: 3,258
Message 51456 - Posted: 24 Feb 2015, 11:59:27 UTC

Server is out of disk space,

is still logged over here and remaining uploads stucked
ID: 51456 · Report as offensive     Reply Quote
Profile totoshi

Send message
Joined: 27 Nov 14
Posts: 3
Credit: 678,458
RAC: 0
Message 51458 - Posted: 24 Feb 2015, 15:32:27 UTC

Hopefully it will be fixed within the next day. The deadline is the day after tomorrow and the WU had a runtime over 611 hrs.

Di 24 Feb 2015 16:26:40 CET | climateprediction.net | Started upload of hadcm3n_saqv_1940_40_009109214_3_4.zip
Di 24 Feb 2015 16:26:41 CET | climateprediction.net | [error] Error reported by file upload server: Server is out of disk space
Di 24 Feb 2015 16:26:41 CET | climateprediction.net | Temporarily failed upload of hadcm3n_saqv_1940_40_009109214_3_4.zip: transient upload error
Di 24 Feb 2015 16:26:41 CET | climateprediction.net | Backing off 01:00:11 on upload of hadcm3n_saqv_1940_40_009109214_3_4.zip
ID: 51458 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,053,321
RAC: 4,417
Message 51459 - Posted: 24 Feb 2015, 16:00:55 UTC - in response to Message 51458.  

[quote]Hopefully it will be fixed within the next day. The deadline is the day after tomorrow and the WU had a runtime over 611 hrs.

The deadline doesn�t mean anything. The results will be accepted and used regardless of whether they are received before or after deadline.


ID: 51459 · Report as offensive     Reply Quote
Profile totoshi

Send message
Joined: 27 Nov 14
Posts: 3
Credit: 678,458
RAC: 0
Message 51460 - Posted: 25 Feb 2015, 9:42:41 UTC - in response to Message 51459.  

The deadline doesn�t mean anything. The results will be accepted and used regardless of whether they are received before or after deadline.


Thanks for the information. Good to know. :)
ID: 51460 · Report as offensive     Reply Quote
Profile astroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 51466 - Posted: 25 Feb 2015, 18:17:18 UTC

My stuck '_4' .zip HadCM3n file cleared about an hour ago. So, all stuck files should go home on next contact. (Uploads might be slow until the backload clears.)

"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 51466 · Report as offensive     Reply Quote
Profile Bonsai911

Send message
Joined: 9 Sep 04
Posts: 228
Credit: 30,229,255
RAC: 3,258
Message 51512 - Posted: 4 Mar 2015, 5:42:43 UTC

Upload problems to report:

04.03.2015 06:33:56 |Temporarily failed upload of hadam3p_eu_z5xq_2013_1_009334706_1_5.zip: transient HTTP error

on server:

[file_xfer] URL: http://cpdn-upload2.oerc.ox.ac.uk/cgi-bin/file_upload_handler


Have a nice day

bonsai911
ID: 51512 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 925
Credit: 34,100,818
RAC: 11,270
Message 51515 - Posted: 4 Mar 2015, 13:04:26 UTC - in response to Message 51512.  

I had one stuck the same way, but it's cleared now.
ID: 51515 · Report as offensive     Reply Quote
Previous · 1 . . . 15 · 16 · 17 · 18 · 19 · 20 · 21 . . . 33 · Next

Message boards : Number crunching : ANOTHER UPLOAD PROBLEM

©2024 climateprediction.net