Formula BOINC Sprint 2019

Message boards : News : Formula BOINC Sprint 2019

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Profile Natalia
Volunteer moderator
Project administrator
Project developer
Project scientist
Help desk expert

Send message
Joined: 11 Aug 17
Posts: 92
Credit: 1,714,590
RAC: 1,136
Message 853 - Posted: 11 Apr 2019, 8:50:49 UTC

Hello all! We are glad to welcome Formula BOINC in our project. Since the last Sprint, we changed several parameters that should improve server's work. In case you face any difficulties when sending a results report, try to use the option max_tasks_reported: https://rake.boincfast.ru/rakesearch/forum_thread.php?id=93&postid=458#458
ID: 853 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
bluestang

Send message
Joined: 12 Jun 18
Posts: 9
Credit: 19,103,476
RAC: 6
Message 856 - Posted: 11 Apr 2019, 19:40:36 UTC - in response to Message 853.  

Server doesn't seem to be able to handle upload and download of Work Units. Can anything be done to help handle this Sprint?
ID: 856 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile marsinph

Send message
Joined: 13 Apr 18
Posts: 7
Credit: 821,303
RAC: 29
Message 857 - Posted: 11 Apr 2019, 21:27:23 UTC - in response to Message 856.  

Hello Natalia
As each year the same problems. And it will again happen on both ODLK.
Not your fault. The most know you do your best..
We know Rake, OGLK and ODLK1 kan not handle so much traffic load during Sprint, due to not very powerfull server.
But someone on SETIBZH stay pushing, without consideration.
Can you imagine if all your projects gives as much credits as Collatz ?
...
....
Best regards to you and Hoarfrost

Phil
ID: 857 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
hoarfrost
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Help desk expert

Send message
Joined: 11 Aug 17
Posts: 334
Credit: 8,570,741
RAC: 4,469
Message 859 - Posted: 12 Apr 2019, 4:15:49 UTC

Hi folks!

During the phase of tasks flushing, a number of requests in many times higher than average by sprint. My computers also faced with problems but at ~22:00 UTC situation looks normal (except website pages, of course).
Does anyone have problems now?

Thank you for participation! A rate of tasks processing is amazing!
ID: 859 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
pschoefer

Send message
Joined: 1 Jan 19
Posts: 4
Credit: 31,196,322
RAC: 29
Message 866 - Posted: 12 Apr 2019, 6:17:56 UTC - in response to Message 859.  
Last modified: 12 Apr 2019, 6:23:58 UTC

There are still lots of failing file transfers (transient HTTP errors). This can cause computers to run dry, as BOINC does not request new tasks from a project with stalled downloads or too many uploads in progress.

On the other hand, there doesn't appear to be a significant validator backlog and the task generation is much faster than the tasks are sent out. You might even consider slowing task generation down a bit, as all those extra tasks only inflate the database.

All in all, the situation is far from perfect, but I have seen worse things. When PrimeGrid started their Challenge Series back in 2008, it took a few tries until they had figured out which parameters to adjust in which way in order to keep their server alive and their participants happy. And, unlike you, they knew about the challenge well in advance, so they had a chance to open some glass doors instead of just picking up the pieces when it is already too late.

Edit: Sorry for posting this multiple times. I got "504 timeout" errors and retried without checking if it was posted.
ID: 866 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Johannes Elsner

Send message
Joined: 14 Apr 18
Posts: 5
Credit: 7,745,800
RAC: 17
Message 867 - Posted: 12 Apr 2019, 7:46:07 UTC - in response to Message 866.  

Hihi, Mr. Pentadingens hat einen nervösen Zeigefinger (;-)))
Freu' mich schon auf Anfang Mai.
Gruss
ID: 867 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
jozef j
Avatar

Send message
Joined: 11 Sep 17
Posts: 33
Credit: 171,009,275
RAC: 22,682
Message 868 - Posted: 12 Apr 2019, 13:29:14 UTC

All was working here until this mess "chalenges" started... **********
Detto bunkerthlon .. where all "robin hoods" fraudly use not own computers ,not pay electricity, just stealing from taxpayers ,, And i have compete with someone who have hundreds computers from school/company/state institition or other similar?? LOL of course no.)) And if robin hoods aka hide computers do bunkering on this hundreds/ thousand machines ,what i see they do last years..bunkering going to crazy level! WE- real suporters dont have chance!
whole concept of challenges on boinc is bad/old ..also formula chose one project and 10K users start count on one project ..of course it will collapse.. just think omg!
ID: 868 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
hoarfrost
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Help desk expert

Send message
Joined: 11 Aug 17
Posts: 334
Credit: 8,570,741
RAC: 4,469
Message 876 - Posted: 12 Apr 2019, 22:01:30 UTC

Load during the sprint (especially - in a phase of tasks flushing) in many times higher, than in "usual peaks".
Simple arithmetics - in last days before sprint project server received and processed about 3 ... 5 per second and generate ~1 .. 2 canonical results.
After sprint start, about 220 000 tasks hit to the server simultaneously. Really physical limits stretched out this wave, but load really in tens times higher than usual peaks.

But I like Formula BOINC Sprints because they flash bottlenecks. During the previous sprint main bottleneck was an I/O on hard drives. After - we increase server DRAM, MySQL caches, change data archiving strategy and now I/O not limit the performance. Most operations performed in file system DRAM cache. Network iterations as I see now is the main bottleneck. Several minutes ago we change some settings of apache and now monitor the situation. Really we monitor the server most of the day.

And great thanks for all crunchers for support and attention!
ID: 876 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
SystemViper

Send message
Joined: 8 Apr 19
Posts: 1
Credit: 867,154
RAC: 0
Message 879 - Posted: 13 Apr 2019, 20:45:11 UTC

hey i just want to thank everyone at the RakeSearch Project and also all the support people/

Being hit by the swarm in a Sprint is a little mind boggling,the stress and other things that you just didn't count on.

I just want to say thanks for all your time and effort.....

Top Notch Job!

-steve
SystemViper
ID: 879 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Dark Angel

Send message
Joined: 2 Jun 18
Posts: 4
Credit: 3,666,080
RAC: 0
Message 880 - Posted: 13 Apr 2019, 22:38:43 UTC

Hello @jozef j
You should be aware that in the wider BOINC community there are many institutions that make their systems, hundreds of them, available for distributed computing projects as part of their own community engagement policies. Some organisations allow their systems to be controlled by one or more of their system administrators who can choose which projects they participate in. while others choose a single project and stay with it.
There are also a number of people who have more money than space, so they rent system resources in the form of virtual cloud instances, sometimes very large numbers of them at any given time.
While some feel neither situation is in the "spirit" of the challenges, both are participating legally and honestly, neither are the thieves you have accused them of being.

Making use of system resources without proper authorisation is referred to as "borg'ing", named after The Borg, a race of Star Trek aliens. It is strongly discouraged across the wider crunching and folding (Folding at Home project participants) communities and has resulted in people being both banned from projects entirely and the police being involved.

Please do not call people thieves just because they are capable of utilising more resources than you.
ID: 880 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Kiska

Send message
Joined: 21 Sep 17
Posts: 1
Credit: 131,346
RAC: 0
Message 881 - Posted: 14 Apr 2019, 2:22:50 UTC - in response to Message 876.  

Yes, to the point that my munin instance is unable to grab the server status xml from your server, it keeps timing out.

ID: 881 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile yoyo_rkn

Send message
Joined: 17 Sep 17
Posts: 2
Credit: 87,868
RAC: 0
Message 884 - Posted: 14 Apr 2019, 6:06:58 UTC - in response to Message 883.  

Seems that I can fetch the data :-)

ID: 884 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
xii5ku

Send message
Joined: 18 Apr 18
Posts: 6
Credit: 13,691,449
RAC: 0
Message 886 - Posted: 14 Apr 2019, 7:39:40 UTC - in response to Message 884.  

Kiska's site is showing periods with good contact to server status each night between about 01:00 UTC and 07:00 UTC.
ID: 886 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
zombie67 [MM]
Avatar

Send message
Joined: 8 Sep 17
Posts: 2
Credit: 24,056,468
RAC: 11
Message 887 - Posted: 14 Apr 2019, 14:21:36 UTC

It's been like this for at least half a day now. Maybe longer. My machines are idle, with no work.

123995	Rake search of diagonal Latin squares	4/14/2019 7:16:28 AM	[sched_op] Starting scheduler request	
123996	Rake search of diagonal Latin squares	4/14/2019 7:16:28 AM	Sending scheduler request: To fetch work.	
123997	Rake search of diagonal Latin squares	4/14/2019 7:16:28 AM	Requesting new tasks for CPU	
123998	Rake search of diagonal Latin squares	4/14/2019 7:16:28 AM	[sched_op] CPU work request: 5727297.44 seconds; 56.00 devices	
123999	Rake search of diagonal Latin squares	4/14/2019 7:16:28 AM	[sched_op] AMD/ATI GPU work request: 0.00 seconds; 0.00 devices	
124000	Rake search of diagonal Latin squares	4/14/2019 7:17:30 AM	Scheduler request failed: HTTP gateway timeout	
124001	Rake search of diagonal Latin squares	4/14/2019 7:17:30 AM	[sched_op] Deferring communication for 00:01:06	
124002	Rake search of diagonal Latin squares	4/14/2019 7:17:30 AM	[sched_op] Reason: Scheduler request failed	

Dublin, California
Team: SETI.USA
ID: 887 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile PDW

Send message
Joined: 8 Sep 17
Posts: 33
Credit: 100,046,103
RAC: 1
Message 888 - Posted: 14 Apr 2019, 14:27:07 UTC

The server is now reporting it is out of space when trying to upload :(
ID: 888 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
RobertN

Send message
Joined: 9 Oct 18
Posts: 2
Credit: 3,851,413
RAC: 0
Message 892 - Posted: 15 Apr 2019, 8:26:43 UTC

I don't think one has to be a rocket scientist to realise that the Formula BOINC event breaks things here at RakeSearch.
The organisers of said event should pick projects that can handle the load.
ID: 892 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
VietOZ

Send message
Joined: 26 Mar 18
Posts: 8
Credit: 246,834,594
RAC: 53
Message 894 - Posted: 15 Apr 2019, 16:07:51 UTC

Hello @jozef j
I understand your frustrations, but sometime things happen.
I totally agreed with Dark Angel. Nowadays, with more and more Universities, institutions, are aware and getting involve with Distributing Computing.
Whether we, as individual contributors, like it or not or feels like they're not legit ... it's still good for science. It's still better than they'd use those computers to mine crypto. Would you agree?
Believe it or not, there are people out there very dedicated to DC. I happened to know a gentleman that has well over 30 machines at his house. His electric bill can probably build a 1950X Threadripper per month. While he doesn't spend money on new hardware, he'd go around town and picked up machines that people threw away and put them to work.
I, myself, have no where near the amount of machines he has.But in the top 10 computers here at Rake, 4 of them are mine. That doesn't mean I stole resources like you said. I also haven't had a vacation for the last 5 years. All the money went to hardware and electric bills. That's the sacrifices I had to make in order to have the output that I have.

So Please do not call people thieves because it's not fair for those who dedicate their time and money to contribute.
ID: 894 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile bcavnaugh
Avatar

Send message
Joined: 30 Nov 17
Posts: 12
Credit: 45,895,534
RAC: 977
Message 900 - Posted: 16 Apr 2019, 23:42:22 UTC
Last modified: 16 Apr 2019, 23:44:11 UTC

Not the best Run this year, no tasks and if I got any it was on 1 or 2 at a time.

And Lots of
504 Gateway Time-out
nginx/1.15.7
ID: 900 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile RFGuy_KCCO

Send message
Joined: 12 Oct 17
Posts: 3
Credit: 102,636,207
RAC: 585
Message 901 - Posted: 16 Apr 2019, 23:59:13 UTC - in response to Message 900.  

Not the best Run this year, no tasks and if I got any it was on 1 or 2 at a time.

And Lots of
504 Gateway Time-out
nginx/1.15.7



Same here.
ID: 901 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile AlexxSaigon
Avatar

Send message
Joined: 17 Mar 19
Posts: 4
Credit: 5,534,120
RAC: 77
Message 902 - Posted: 17 Apr 2019, 5:05:23 UTC

The organizers, due to arrogance and ambitions, got involved in the competition without having any opportunities. It is low, throwing soldiers with sticks under the tanks.
ID: 902 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
1 · 2 · Next

Message boards : News : Formula BOINC Sprint 2019


©2019 The searchers team