climateprediction.net home page
A different upload problem -- out of disk space on rapid-watch.badc.rl.ac.uk

A different upload problem -- out of disk space on rapid-watch.badc.rl.ac.uk

Message boards : Number crunching : A different upload problem -- out of disk space on rapid-watch.badc.rl.ac.uk
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · 4 · Next

AuthorMessage
Eirik Redd

Send message
Joined: 31 Aug 04
Posts: 367
Credit: 131,194,567
RAC: 105,667
Message 47286 - Posted: 12 Oct 2013, 9:37:44 UTC

The error quoted below: looks like server problem:
12-Oct-2013 02:12:04 [climateprediction.net] Error reported by file upload server: Server is out of disk space
12-Oct-2013 02:12:04 [climateprediction.net] Temporarily failed upload of hadcm3n_3ibe_2020_40_008371813_2_4.zip: transient upload error
12-Oct-2013 02:12:04 [climateprediction.net] Backing off 8 min 31 sec on upload of hadcm3n_3ibe_2020_40_008371813_2_4.zip

this quote from client_state shows what server-

<file> <name>hadcm3n_3ibe_2020_40_008371813_2_4.zip</name>
<nbytes>54298486.000000</nbytes>
<max_nbytes>188743680.000000</max_nbytes>
<md5_cksum>89d56e434eb1a2ca7d42380795e1f807</md5_cksum>
<status>1</status>
<upload_url>http://rapid-watch.badc.rl.ac.uk/cpdn_cgi/file_upload_handler</upload_url>
<persistent_file_xfer>
<num_retries>6</num_retries>
<first_request_time>1381559199.068802</first_request_time>
<next_request_time>1381573168.035401</next_request_time>
<time_so_far>2144.255463</time_so_far>
<last_bytes_xferred>115.000000</last_bytes_xferred>
<is_upload>1</is_upload>
</persistent_file_xfer>
</file>

Like Murphy always does -- it's the start of the weekend. :)

ID: 47286 · Report as offensive     Reply Quote
Profile astroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 94,892,572
RAC: 313
Message 47304 - Posted: 13 Oct 2013, 1:48:31 UTC

I sent an email to Andy about Noon Pacific Daylight Time (Z-7) after seeing it on my boxes. Perhaps Monday...

"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 47304 · Report as offensive     Reply Quote
alvin

Send message
Joined: 12 Mar 12
Posts: 29
Credit: 666,199
RAC: 0
Message 47305 - Posted: 13 Oct 2013, 2:11:25 UTC - in response to Message 47304.  

13/10/2013 10:38:58 AM | climateprediction.net | [error] Error reported by file upload server: Server is out of disk space
13/10/2013 10:38:58 AM | climateprediction.net | [error] Error reported by file upload server: Server is out of disk space
13/10/2013 10:38:58 AM | climateprediction.net | Temporarily failed upload of hadcm3n_4mto_1980_40_008334699_3_1.zip: transient upload error
13/10/2013 10:38:58 AM | climateprediction.net | Backing off 04:24:01 on upload of hadcm3n_4mto_1980_40_008334699_3_1.zip
13/10/2013 10:38:58 AM | climateprediction.net | Temporarily failed upload of hadcm3n_4mto_1980_40_008334699_3_2.zip: transient upload error
13/10/2013 10:38:58 AM | climateprediction.net | Backing off 04:21:52 on upload of hadcm3n_4mto_1980_40_008334699_3_2.zip
ID: 47305 · Report as offensive     Reply Quote
jjwhalen
Avatar

Send message
Joined: 2 Dec 05
Posts: 11
Credit: 1,344,657
RAC: 0
Message 47319 - Posted: 14 Oct 2013, 2:29:20 UTC

Me too with hadcm3n_7yu3_1980_40_008456430_0_4.zip -- though I've actually been trying to U/L this one for about a week now. I made it to 98% once before the connection petered out. Maybe THIS week.



Best wishes:)
ID: 47319 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1102
Credit: 20,168,736
RAC: 848
Message 47320 - Posted: 14 Oct 2013, 4:24:44 UTC

I can see that the server is full and is not excepting the decadal zip files, but, does this server also except the trickles? If so are we to expect credits problems again until such time as some of the data is off loaded to storage?

ID: 47320 · Report as offensive     Reply Quote
alvin

Send message
Joined: 12 Mar 12
Posts: 29
Credit: 666,199
RAC: 0
Message 47321 - Posted: 14 Oct 2013, 5:35:35 UTC

it's a bit frustrating to waste such resources doing nothing.
Big things coming for all projects as tech and admin personnel are all busy with their main duties after holidays and vacation it seems)
But still disappointment to see how all these climate calculations or LHC are just not happen properly or not uploaded or crunching cluster just stays idle.
ID: 47321 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7182
Credit: 22,883,095
RAC: 1,397
Message 47322 - Posted: 14 Oct 2013, 6:25:43 UTC - in response to Message 47320.  

Jim

Tickle_up files have their own server.

ID: 47322 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7182
Credit: 22,883,095
RAC: 1,397
Message 47323 - Posted: 14 Oct 2013, 6:29:10 UTC - in response to Message 47321.  

coku

It's been the weekend, and the University of Oxford has been closed.

It'll be open again in another couple of hours.

ID: 47323 · Report as offensive     Reply Quote
alvin

Send message
Joined: 12 Mar 12
Posts: 29
Credit: 666,199
RAC: 0
Message 47324 - Posted: 14 Oct 2013, 6:44:57 UTC - in response to Message 47323.  
Last modified: 14 Oct 2013, 6:45:10 UTC


It'll be open again in another couple of hours.


No worries, glad to hear we've back on track
ID: 47324 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1102
Credit: 20,168,736
RAC: 848
Message 47326 - Posted: 14 Oct 2013, 14:53:15 UTC - in response to Message 47322.  

Jim

Tickle_up files have their own server.


Good. This means that we shouldn't have to listen to the bitching about the credits again.
ID: 47326 · Report as offensive     Reply Quote
alvin

Send message
Joined: 12 Mar 12
Posts: 29
Credit: 666,199
RAC: 0
Message 47332 - Posted: 17 Oct 2013, 8:33:06 UTC - in response to Message 47326.  
Last modified: 17 Oct 2013, 8:39:22 UTC

Jim

Tickle_up files have their own server.


Good. This means that we shouldn't have to listen to the bitching about the credits again.


really don't care about credits but have files sitting and waiting for upload for days.
17/10/2013 7:31:07 PM | climateprediction.net | Started upload of hadcm3n_7wk6_1980_40_008453481_1_1.zip
17/10/2013 7:31:08 PM | climateprediction.net | Started upload of hadcm3n_7wk6_1980_40_008453481_1_2.zip
17/10/2013 7:31:12 PM | climateprediction.net | Project file upload handler is missing
17/10/2013 7:31:12 PM | climateprediction.net | Backing off 04:50:48 on upload of hadcm3n_7wk6_1980_40_008453481_1_1.zip
17/10/2013 7:31:12 PM | climateprediction.net | Project file upload handler is missing
17/10/2013 7:31:12 PM | climateprediction.net | Backing off 03:14:04 on upload of hadcm3n_7wk6_1980_40_008453481_1_2.zip
ID: 47332 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7182
Credit: 22,883,095
RAC: 1,397
Message 47333 - Posted: 17 Oct 2013, 9:08:13 UTC - in response to Message 47332.  

That's because your problem is nothing to do with server space.
Look at the messages that you posted:
Project file upload handler is missing

This is the first time that I've seen this for a Windows machine.
You'll have to look in client_state.xml, and look for that upload zip. Then post what the line containing the upload string says. (Should be a couple of lines earlier.)

ID: 47333 · Report as offensive     Reply Quote
alvin

Send message
Joined: 12 Mar 12
Posts: 29
Credit: 666,199
RAC: 0
Message 47340 - Posted: 18 Oct 2013, 7:22:30 UTC - in response to Message 47333.  


You'll have to look in client_state.xml, and look for that upload zip. Then post what the line containing the upload string says. (Should be a couple of lines earlier.)



<file>
<name>hadcm3n_oew6_1900_40_008474425_1_4.zip</name>
<nbytes>0.000000</nbytes>
<max_nbytes>188743680.000000</max_nbytes>
<status>0</status>
<upload_url>http://rapid-watch.badc.rl.ac.uk/cpdn_cgi/file_upload_handler</upload_url>
</file>
<file>
<name>hadcm3n_o478_1940_40_008381789_4_1.zip</name>
<nbytes>54623290.000000</nbytes>
<max_nbytes>188743680.000000</max_nbytes>
<md5_cksum>cc7aa0232e284f831c529c9b729a4b5a</md5_cksum>
<status>1</status>
<upload_url>http://rapid-watch.badc.rl.ac.uk/cpdn_cgi/file_upload_handler</upload_url>
<persistent_file_xfer>
<num_retries>37</num_retries>
<first_request_time>1381439073.523335</first_request_time>
<next_request_time>1382085616.909086</next_request_time>
<time_so_far>485.545534</time_so_far>
<last_bytes_xferred>54624660.000000</last_bytes_xferred>
<is_upload>1</is_upload>
</persistent_file_xfer>
</file>
<file>
<name>hadcm3n_o478_1940_40_008381789_4_2.zip</name>
<nbytes>0.000000</nbytes>
<max_nbytes>188743680.000000</max_nbytes>
<status>0</status>
<upload_url>http://rapid-watch.badc.rl.ac.uk/cpdn_cgi/file_upload_handler</upload_url>
</file>
<file>
<name>hadcm3n_o478_1940_40_008381789_4_3.zip</name>
<nbytes>0.000000</nbytes>
<max_nbytes>188743680.000000</max_nbytes>
<status>0</status>
<upload_url>http://rapid-watch.badc.rl.ac.uk/cpdn_cgi/file_upload_handler</upload_url>
</file>
<file>
<name>hadcm3n_o478_1940_40_008381789_4_4.zip</name>
<nbytes>0.000000</nbytes>
<max_nbytes>188743680.000000</max_nbytes>
<status>0</status>
<upload_url>http://rapid-watch.badc.rl.ac.uk/cpdn_cgi/file_upload_handler</upload_url>
</file>
<file>
<name>hadcm3n_ocml_1900_40_008471488_2_1.zip</name>
<nbytes>54695088.000000</nbytes>
<max_nbytes>188743680.000000</max_nbytes>
<md5_cksum>3dcb9938f429eaf22d2d55b5a5f185a8</md5_cksum>
<status>1</status>
<upload_url>http://rapid-watch.badc.rl.ac.uk/cpdn_cgi/file_upload_handler</upload_url>
<persistent_file_xfer>
<num_retries>39</num_retries>
<first_request_time>1381401206.108494</first_request_time>
<next_request_time>1382093660.458453</next_request_time>
<time_so_far>559.976886</time_so_far>
<last_bytes_xferred>54696458.000000</last_bytes_xferred>
<is_upload>1</is_upload>
</persistent_file_xfer>
</file>
<file>
<name>hadcm3n_ocml_1900_40_008471488_2_2.zip</name>
<nbytes>0.000000</nbytes>
<max_nbytes>188743680.000000</max_nbytes>
<status>0</status>
<upload_url>http://rapid-watch.badc.rl.ac.uk/cpdn_cgi/file_upload_handler</upload_url>
</file>
ID: 47340 · Report as offensive     Reply Quote
alvin

Send message
Joined: 12 Mar 12
Posts: 29
Credit: 666,199
RAC: 0
Message 47341 - Posted: 18 Oct 2013, 7:24:28 UTC - in response to Message 47333.  

That's because your problem is nothing to do with server space.
Look at the messages that you posted:
Project file upload handler is missing




DNS is ok on that machine

C:\Windows\system32>nslookup rapid-watch.badc.rl.ac.uk
Server: xxxx
Address: xxxxx

Non-authoritative answer:
Name: rapid-watch.badc.rl.ac.uk
Address: 130.246.191.84
ID: 47341 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7182
Credit: 22,883,095
RAC: 1,397
Message 47342 - Posted: 18 Oct 2013, 7:42:52 UTC

Strange. No idea what's wrong here, I'll ask the project if things are OK.

ID: 47342 · Report as offensive     Reply Quote
alvin

Send message
Joined: 12 Mar 12
Posts: 29
Credit: 666,199
RAC: 0
Message 47343 - Posted: 18 Oct 2013, 9:37:09 UTC - in response to Message 47342.  

Strange. No idea what's wrong here, I'll ask the project if things are OK.


other computer

<file>
<name>hadcm3n_u694_2020_40_008338790_3_2.zip</name>
<nbytes>55067298.000000</nbytes>
<max_nbytes>188743680.000000</max_nbytes>
<md5_cksum>da829212f82cc4d84f3b77afc456f3bb</md5_cksum>
<status>1</status>
<upload_url>http://rapid-watch.badc.rl.ac.uk/cpdn_cgi/file_upload_handler</upload_url>
<persistent_file_xfer>
<num_retries>35</num_retries>
<first_request_time>1381483945.909908</first_request_time>
<next_request_time>1382096894.628488</next_request_time>
<time_so_far>347.973815</time_so_far>
<last_bytes_xferred>55068668.000000</last_bytes_xferred>
<is_upload>1</is_upload>
</persistent_file_xfer>
</file>
<file>
<name>hadcm3n_u694_2020_40_008338790_3_3.zip</name>
<nbytes>55053607.000000</nbytes>
<max_nbytes>188743680.000000</max_nbytes>
<md5_cksum>34d34d9fb780905c098772deadc4ef20</md5_cksum>
<status>1</status>
<upload_url>http://rapid-watch.badc.rl.ac.uk/cpdn_cgi/file_upload_handler</upload_url>
<persistent_file_xfer>
<num_retries>9</num_retries>
<first_request_time>1381976443.583637</first_request_time>
<next_request_time>1382097829.703411</next_request_time>
<time_so_far>94.913241</time_so_far>
<last_bytes_xferred>55054977.000000</last_bytes_xferred>
<is_upload>1</is_upload>
</persistent_file_xfer>
</file>
<file>
<name>hadcm3n_u694_2020_40_008338790_3_4.zip</name>
<nbytes>0.000000</nbytes>
<max_nbytes>188743680.000000</max_nbytes>
<status>0</status>
<upload_url>http://rapid-watch.badc.rl.ac.uk/cpdn_cgi/file_upload_handler</upload_url>
</file>
ID: 47343 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7182
Credit: 22,883,095
RAC: 1,397
Message 47344 - Posted: 18 Oct 2013, 9:44:57 UTC

Andy says that uploads are proceeding to the server.

So it looks like it's just your computer.
:(

ID: 47344 · Report as offensive     Reply Quote
alvin

Send message
Joined: 12 Mar 12
Posts: 29
Credit: 666,199
RAC: 0
Message 47345 - Posted: 18 Oct 2013, 10:10:04 UTC - in response to Message 47344.  

Andy says that uploads are proceeding to the server.

So it looks like it's just your computer.
:(


I've used versions beta 7.2.5 and 7.2.18 and probably I need to report issues to team
Anyways return to 7.0.64 and see what's happen
Thanks mate
ID: 47345 · Report as offensive     Reply Quote
MarkJ
Avatar

Send message
Joined: 28 Mar 09
Posts: 125
Credit: 9,825,980
RAC: 0
Message 47352 - Posted: 19 Oct 2013, 0:37:08 UTC - in response to Message 47345.  

Andy says that uploads are proceeding to the server.

So it looks like it's just your computer.
:(


I've used versions beta 7.2.5 and 7.2.18 and probably I need to report issues to team
Anyways return to 7.0.64 and see what's happen
Thanks mate


I've tried many versions with no success. That included 7.0.64. Didn't help. I don't believe there have been any changes to the file transfer mechanism since the 6.12 clients.

The last thing I am yet to try will be a 56k dialup modem using another ISP. Waiting on the ISP to setup the account at the moment.
BOINC blog
ID: 47352 · Report as offensive     Reply Quote
alvin

Send message
Joined: 12 Mar 12
Posts: 29
Credit: 666,199
RAC: 0
Message 47355 - Posted: 20 Oct 2013, 9:15:15 UTC - in response to Message 47352.  
Last modified: 20 Oct 2013, 9:21:22 UTC

Andy says that uploads are proceeding to the server.

So it looks like it's just your computer.
:(


I've used versions beta 7.2.5 and 7.2.18 and probably I need to report issues to team
Anyways return to 7.0.64 and see what's happen
Thanks mate


I've tried many versions with no success. That included 7.0.64. Didn't help. I don't believe there have been any changes to the file transfer mechanism since the 6.12 clients.

The last thing I am yet to try will be a 56k dialup modem using another ISP. Waiting on the ISP to setup the account at the moment.


well based on limits in same section we have 188M maximum for upload and nothing seems wrong about it.
If I'm not the only one with issue this possibly has to be investigated via server's uploader log which was rejected initially by admin staff.
You also may try 3G or 4G modem which will give you clear picture.
Another way to use proxy or otherwise.
Mine other projects are all ok, so only these sit without any movements. By this I was forced to suspend any further crunching and even did delete some results to see any difference. so no difference)
Waste of machine time is always sad.
ID: 47355 · Report as offensive     Reply Quote
1 · 2 · 3 · 4 · Next

Message boards : Number crunching : A different upload problem -- out of disk space on rapid-watch.badc.rl.ac.uk

©2020 climateprediction.net