Cannot display tak list

Questions and Answers : Web site : Cannot display tak list

To post messages, you must log in.

AuthorMessage
Profile [B@P] Daniel

Send message
Joined: 8 Sep 17
Posts: 99
Credit: 402,603,726
RAC: 0
Message 249 - Posted: 17 Dec 2017, 22:20:53 UTC

Hi,
I cannot display task list - I get following error:
Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 2 bytes) in .../html/inc/db_conn.inc on line 125

It is a bit surprising that 128MB is not enough there. I checked original code and it loads only 20 results from DB at once. If you did not make any changes in this area, please log bug at https://github.com/BOINC/boinc/issues that something else consumes lots of memory.
ID: 249 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
[AF>FAH-Addict.net]toTOW

Send message
Joined: 30 Nov 17
Posts: 10
Credit: 10,045,366
RAC: 0
Message 252 - Posted: 20 Dec 2017, 20:31:49 UTC

I guess the system need an automatic process to purge the older WUs from this page ...

All WUs I computed since I started the project (November 30th) are still in this list ... I can't imagine how many entries the page has to handle for Daniel with such a high RAC ... :o
ID: 252 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile [B@P] Daniel

Send message
Joined: 8 Sep 17
Posts: 99
Credit: 402,603,726
RAC: 0
Message 253 - Posted: 20 Dec 2017, 20:53:38 UTC - in response to Message 252.  
Last modified: 20 Dec 2017, 20:59:57 UTC

I guess the system need an automatic process to purge the older WUs from this page ...

All WUs I computed since I started the project (November 30th) are still in this list ... I can't imagine how many entries the page has to handle for Daniel with such a high RAC ... :o

It may be surprising, but it is enough to load and process 20 entries at once. Plus one or few ones extra to display various total numbers there. As I checked in BOINC sever code, it should be already working this way. Something strange is going there.

And yes, periodic removal of old WUs would help to keep server load low. I read somewhere that BOINC server comes with script which can do this, so there is no need to reinvent the wheel.

Edit: BTW, there are people who have higher RAC than me :) http://rake.boincfast.ru/rakesearch/top_users.php
ID: 253 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile PDW

Send message
Joined: 8 Sep 17
Posts: 34
Credit: 100,058,853
RAC: 0
Message 255 - Posted: 21 Dec 2017, 8:41:21 UTC - in response to Message 253.  

This memory allocation error has been happening on quite a few projects for quite a few years.
The advice given is generally just to double the limit for the memory in the config file each time it occurs.

It is to do with the number of results the user has, the code may say only to load 20 but 'something' in the process is loading everything into memory.

Purging older results can help stop it from happening as well as speeding up the time it takes to load the page.
ID: 255 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile [B@P] Daniel

Send message
Joined: 8 Sep 17
Posts: 99
Credit: 402,603,726
RAC: 0
Message 257 - Posted: 21 Dec 2017, 10:32:18 UTC - in response to Message 255.  

This memory allocation error has been happening on quite a few projects for quite a few years.
The advice given is generally just to double the limit for the memory in the config file each time it occurs.

It is to do with the number of results the user has, the code may say only to load 20 but 'something' in the process is loading everything into memory.

Purging older results can help stop it from happening as well as speeding up the time it takes to load the page.

Thanks for info. I have checked list of open issues at GitHub BOINC repository, and found that they do not have open issue for this, so I logged them new one: https://github.com/BOINC/boinc/issues/2277.
ID: 257 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Natalia
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Help desk expert

Send message
Joined: 11 Aug 17
Posts: 98
Credit: 1,880,657
RAC: 0
Message 258 - Posted: 21 Dec 2017, 12:39:51 UTC

Thank you, Daniel!
ID: 258 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Progger

Send message
Joined: 7 Sep 17
Posts: 5
Credit: 513,398
RAC: 0
Message 303 - Posted: 23 Jan 2018, 10:40:13 UTC

Причина: https://github.com/BOINC/boinc/issues/2277#issuecomment-359722415

Если в БД старые задания и результаты никак не используются - т.е. у вас нет ссылок на них с каких-нибудь своих таблиц, то можно запустить db_purge. У меня она запущена с параметрами:
<daemon>
    <cmd>db_purge -d 3 --gzip --max_wu_per_file 10000 --min_age_days 7 --daily_dir</cmd>
</daemon>

Ещё можете создать дополнительные индексы:
ALTER TABLE `boinc_odlk`.`result`
ADD INDEX `tmp$res_userid_senttime` (`userid`, `sent_time`),
ADD INDEX `tmp$res_hostid_senttime` (`hostid`, `sent_time`),
ADD INDEX `tmp$res_ai_ss_o_rt` (`appid`, `server_state`, `outcome`, `received_time`),
ADD INDEX `tmp$res_ai_vs_rt` (`appid`, `validate_state`, `received_time`),
ADD INDEX `tmp$res_hi_st_o_vs` (`hostid`, `server_state`, `outcome`, `validate_state`),
ADD INDEX `tmp$res_es_wuid` (`exit_status`, `workunitid`)
Это может ускорить отображение некоторых страниц.
ID: 303 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
hoarfrost
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Help desk expert

Send message
Joined: 11 Aug 17
Posts: 436
Credit: 13,314,636
RAC: 0
Message 304 - Posted: 24 Jan 2018, 13:28:05 UTC
Last modified: 24 Jan 2018, 13:29:07 UTC

Hello folks!

Information about results and workunits may be useful, but it is not requred to store it in project database. We plan to migrate it to other database.

Thank you for participation!
ID: 304 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile [B@P] Daniel

Send message
Joined: 8 Sep 17
Posts: 99
Credit: 402,603,726
RAC: 0
Message 308 - Posted: 28 Jan 2018, 8:15:11 UTC

This bug is fixed now in BOINC, you can selectively apply fix for it or upgrade everything to latest version.
ID: 308 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile PDW

Send message
Joined: 8 Sep 17
Posts: 34
Credit: 100,058,853
RAC: 0
Message 309 - Posted: 28 Jan 2018, 8:57:25 UTC - in response to Message 308.  

This bug is fixed now in BOINC, you can selectively apply fix for it or upgrade everything to latest version.

Thanks Daniel and Progger for working out the fix and getting the code updated :)
ID: 309 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
stoneageman
Avatar

Send message
Joined: 17 Feb 18
Posts: 1
Credit: 292,163,662
RAC: 0
Message 855 - Posted: 11 Apr 2019, 15:01:42 UTC

It's still not fixed. Now getting the same error when trying to open my task list

Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 2 bytes) in /home/boincadm/projects/rakesearch/html/inc/db_conn.inc on line 125
ID: 855 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Questions and Answers : Web site : Cannot display tak list


©2021 The searchers team, Karelian Research Center of the Russian Academy of Sciences