climateprediction.net (CPDN) home page
Thread 'Free-DC reports negative credits today for CPDN'

Thread 'Free-DC reports negative credits today for CPDN'

Message boards : Number crunching : Free-DC reports negative credits today for CPDN
Message board moderation

To post messages, you must log in.

AuthorMessage
marmot

Send message
Joined: 12 May 05
Posts: 34
Credit: 1,436,930
RAC: 2,182
Message 60419 - Posted: 24 Jun 2019, 11:28:28 UTC

Any idea what happened with the export?

My CPID shows -19,129 today.
ID: 60419 · Report as offensive     Reply Quote
mmonnin

Send message
Joined: 28 May 17
Posts: 49
Credit: 17,405,877
RAC: 5,319
Message 60420 - Posted: 24 Jun 2019, 11:51:25 UTC

It just loaded an old copy of data since the site was down when it tried to pull stats. It's happened plenty of times at Free-DC. Mine went back to a familiar # for me.
ID: 60420 · Report as offensive     Reply Quote
bernard_ivo

Send message
Joined: 18 Jul 13
Posts: 438
Credit: 25,646,207
RAC: 1,928
Message 60421 - Posted: 24 Jun 2019, 11:58:31 UTC

A week or two someone also reported that Free-DC cannot get new stats from CPDN and the issue is on CPDN site. So issues ;)
ID: 60421 · Report as offensive     Reply Quote
crashtech

Send message
Joined: 1 Jun 17
Posts: 13
Credit: 30,617,511
RAC: 21,536
Message 60425 - Posted: 24 Jun 2019, 15:14:54 UTC

I just returned to CPDN ater a long break, there were problems with credit reporting then, and from the looks of it, they've only gotten worse. My reward for returning? Negative 4.2 million!
ID: 60425 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4541
Credit: 19,039,635
RAC: 18,944
Message 60426 - Posted: 24 Jun 2019, 15:28:48 UTC - in response to Message 60425.  

The scheduler is currently running on the backup system. I have no idea whether this has had any effect on credits however.

I have not seen anything unexpected in my own credits but I don't check them very often and over the past week my computers have been almost totally devoted to the testing programme so they wouldn't show much change in total from last week.
ID: 60426 · Report as offensive     Reply Quote
Profilegeophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2187
Credit: 64,822,615
RAC: 5,275
Message 60428 - Posted: 24 Jun 2019, 18:06:24 UTC

Looking at boincstats, everything looks reasonable, but perhaps the stats were only good through yesterday and didn't take into account any oddities due to the server failover?
ID: 60428 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4541
Credit: 19,039,635
RAC: 18,944
Message 60429 - Posted: 24 Jun 2019, 19:03:56 UTC - in response to Message 60425.  

I just returned to CPDN ater a long break, there were problems with credit reporting then, and from the looks of it, they've only gotten worse. My reward for returning? Negative 4.2 million!


How long a break? I could imagine issues if before the last big multi-week crash but would hesitate to give this to Andy till checking whether things return to normal after next weekend's credit run.
ID: 60429 · Report as offensive     Reply Quote
bernard_ivo

Send message
Joined: 18 Jul 13
Posts: 438
Credit: 25,646,207
RAC: 1,928
Message 60431 - Posted: 24 Jun 2019, 19:49:37 UTC - in response to Message 60429.  

Free-DC haven't updated CPDN stats for at least 3 weeks/times as Bill F reported here
ID: 60431 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 60433 - Posted: 24 Jun 2019, 22:16:46 UTC

When I reported the problem that stats sites were having getting the data after the BOINC upgrade on the servers, (end of May), Andy said this:

I think regarding the link problem, I think I am going to have to bring forward the switch to the new web code.

Whatever that means.

And last week we were all busy with the big data run for the OpenIFS collaboration.

This project will ALWAYS have some sort of problem with the credits, because of the massive amounts of data, which, unlike other projects, is always kept.
So there's no need to get excited about it every time there's a problem. it'll get fixed when there's time left over from the working side of what the project is about.
ID: 60433 · Report as offensive     Reply Quote
mmonnin

Send message
Joined: 28 May 17
Posts: 49
Credit: 17,405,877
RAC: 5,319
Message 60434 - Posted: 24 Jun 2019, 22:25:11 UTC - in response to Message 60421.  

A week or two someone also reported that Free-DC cannot get new stats from CPDN and the issue is on CPDN site. So issues ;)


The difference here is that credit reversed on Free-DC while other weeks there was just no update at Free-DC. This time the CPDN site was down. I'm not sure how often Free-DC queries CPDN. It might be a week until it goes back to the data from a couple of weeks ago.

Free-DC also has 2 sets of data to update and display the site. At times they can get out of sync.
ID: 60434 · Report as offensive     Reply Quote
crashtech

Send message
Joined: 1 Jun 17
Posts: 13
Credit: 30,617,511
RAC: 21,536
Message 60444 - Posted: 25 Jun 2019, 15:27:01 UTC - in response to Message 60429.  

I just returned to CPDN ater a long break, there were problems with credit reporting then, and from the looks of it, they've only gotten worse. My reward for returning? Negative 4.2 million!


How long a break? I could imagine issues if before the last big multi-week crash but would hesitate to give this to Andy till checking whether things return to normal after next weekend's credit run.


I'm honestly not sure. It may have been close to a year? Here's a link to the relevant Free-DC page for my team:

https://stats.free-dc.org/stats.php?page=team&proj=bcpdn&team=4

I'm still crunching on some CPDN work in hopes that the credits will get straightened out.
ID: 60444 · Report as offensive     Reply Quote
ProfileDave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4541
Credit: 19,039,635
RAC: 18,944
Message 60447 - Posted: 25 Jun 2019, 16:31:57 UTC - in response to Message 60444.  
Last modified: 25 Jun 2019, 17:03:00 UTC

A year should be OK.

I suspect this is just the problem with the credit not showing due to things currently running on the backup server. There are a few of the more obscure pages not being accessible at the moment as well. (Ones used just by project staff and moderators.)

Edit: Have you checked your credit under your user account here?
ID: 60447 · Report as offensive     Reply Quote
crashtech

Send message
Joined: 1 Jun 17
Posts: 13
Credit: 30,617,511
RAC: 21,536
Message 60452 - Posted: 26 Jun 2019, 13:23:09 UTC - in response to Message 60447.  

A year should be OK.

I suspect this is just the problem with the credit not showing due to things currently running on the backup server. There are a few of the more obscure pages not being accessible at the moment as well. (Ones used just by project staff and moderators.)

Edit: Have you checked your credit under your user account here?

I hadn't until you asked. Credit here seems to be okay, although there is nothing showing (yet) for any recent work. If I take the recent negative updated credit amount shown on Free-DC, reverse the sign and add it to my total credit shown on Free-DC, the number matches almost exactly with my total credit shown here. That would suggest that a very old version of the stats was uploaded, though how that could happen I would have no clue.
ID: 60452 · Report as offensive     Reply Quote
Bok

Send message
Joined: 22 Jun 05
Posts: 4
Credit: 2,434,860
RAC: 140,054
Message 60550 - Posted: 2 Jul 2019, 11:45:13 UTC

I'm actually getting a forbidden 403 when trying to retrieve the stats files from https://www.climateprediction.net/stats/

-bash-4.2$ wget https://www.climateprediction.net/stats/tables.xml
--2019-07-02 07:50:18-- https://www.climateprediction.net/stats/tables.xml
Resolving www.climateprediction.net (www.climateprediction.net)... 129.67.242.70
Connecting to www.climateprediction.net (www.climateprediction.net)|129.67.242.70|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2019-07-02 07:50:18 ERROR 403: Forbidden.

Perhaps like Einstein@Home they now have individual credentials required?

Any admins reading this ?
ID: 60550 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 60551 - Posted: 2 Jul 2019, 12:18:16 UTC

That link works for me, as does https://www.cpdn.org/cpdnboinc/stats.
ID: 60551 · Report as offensive     Reply Quote
Bok

Send message
Joined: 22 Jun 05
Posts: 4
Credit: 2,434,860
RAC: 140,054
Message 60552 - Posted: 2 Jul 2019, 12:41:02 UTC - in response to Message 60551.  

that second link I can get the files from ok, but they are out of date and match up with what I have at Free-DC. If you look in the tables.xml file the update time is 1561384650

This is in unix epoch format which translates to Monday, June 24, 2019 1:57:30 PM

This matches the timestamp on the files themselves.

Someone needs to kick the xml output job to update the files :)
ID: 60552 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 60553 - Posted: 2 Jul 2019, 13:00:58 UTC

There's been problems with the data center not being able to offload data to storage fast enough, so the server ran out of disk space.
All further uploads were blocked over the weekend, while space was being cleared.
Uploads were restarted Monday morning.

The stats probably got stopped too, as there was no point.
ID: 60553 · Report as offensive     Reply Quote
crashtech

Send message
Joined: 1 Jun 17
Posts: 13
Credit: 30,617,511
RAC: 21,536
Message 60630 - Posted: 10 Jul 2019, 12:19:16 UTC

https://www.climateprediction.net/stats/tables.xml doesn't work for me either at this time.
ID: 60630 · Report as offensive     Reply Quote

Message boards : Number crunching : Free-DC reports negative credits today for CPDN

©2024 cpdn.org