is the optimized app now part of the official package ?

Hello!

Hi,
I have few question about things which are not clear for me:
1. Is Generator::keyValue field needed? I checked few WUs and it always was set to -1 there. I wonder if this field and code which uses it can be removed;

This class member is required for store a value of cell[keyRowId][keyColumnId] at which the generator of diagonal squares must stop. It is a workunit border. With current partitioning of squares on workunits, keyValue is always -1.

2. Can I assume that every new WU at the beginning will have Generator::cellId set to 0?

Yes. Because cellId is an index of current cell in path - array Generator::path. But while working cellId changed, of course. You can see this situation in any checkpoint file.

3. Can I assume that every new WU at the beginning for every cell in Generator::path will have all corresponding values (bits) in Generator::cellsHistory set to 1 (i.e. all numbers from 0 to 8 can be potentially used for cell)?

In cellsHistory[rowId][columnId] the generator marks values, that used in current visit on this cell - Matrix[rowId][columnId]. When generator make a rollback to previous cell - it clear the history of cell. When generator go "into cell", cell history is clean, but real set of values, available for inserting into cell determine by flags in columns[value][columnId] and rows[rowId][value] arrays and cellsHistory, of course.

4. How do you check if result is valid - are you checking if files are binary identical, or examine contents more closely? I wonder what will happen if for some WU app will find two square pairs, but report them in different order than now. Will server be able to handle this? Or do I need to sort pairs in such case to make result "canonical"?

By binary equivalency. But applications use an identical Generator::path[] (that supplied in workunit file) and computations must produce the identical squares sets in identical order.

One more question: do you always generate WUs with all values on diagonals set? I checked few WUs and noticed this. I wanted to optimize Generator::Start by processing diagonal elements before non-diagonal ones and save some cycles consumed by processing of 'primary' and 'secondary' variables in latter part, but now I wonder if this part of code could be eliminated completely.

In workunits of current search all diagonals - primary and secondary completely filled. Excluding of if (rowid == columnId) and if (rowId == Rank - 1 - columnId), if I understand you right - may be a good idea.

I run tests again several times with offset set the same for AVX2 and AVX512 to 0 =4300MHz and the results are:

AVX2
real 3m32,724s
user 0m0,000s
sys 0m0,015s

AVX512
real 3m25,637s
user 0m0,000s
sys 0m0,015s

AVX512 looks (and is) faster, but when interpolated it is basically the same as the last time with offset set to -3 =4000MHz, but now you can see it clock to clock.
BOINC and other CPU load intensive processes were suspended.

I am available for another test when needed.
Keep up the good work.

Sure, results for AVX2 and AVX512 on i9-7920X (offset for AVX2 is set to 4GHz, for AVX512 is set to 3.8GHz) under Windows 10:

AVX2
real 3m32,268s
user 0m0,000s
sys 0m0,000s

AVX512
real 3m40,743s
user 0m0,000s
sys 0m0,000s

Yes, times are correct. I could set the offset same for the benchmarking if it makes a difference later today.

I downloaded rakesearch_linux_arm_v7l.tgz from github.
On a pi 3 (not overclocked), with Raspbian Stretch, with boinc loaded
sudo apt-get install boinc
I ran the boinc manager and added Rakesearch (by URL). I ignored the warning "this project may not have units for your CPU" (or whatever it says). I usually run my pi 3's headless. I suppose i could have done it with boinccmd. The boinc manager showed me what was going on a bit quicker.

I then installed the application:
# get a root shell
sudo bash
# extract the binary:
cd /var/lib/boinc-client/projects/rake.boincfast.ru_rakesearch/
tar xvf ~pi/rakesearch_linux_arm_v7l.tgz
# exit the root shell
exit

Stopping and starting the boinc manager didn't work, so i restarted the pi
sudo shutdown -r

I let it download a couple units, which executed in 5 to 6 hours each.

I chose the arm_v7l version as it is the one that i expected to work on the pi 3. I don't expect it to work on a pi 2. I have a pi 2 that runs Jessie, and i'll give it a try soon. I also have a pi zero w, and could give that a shot.

I don't expect the NEON version (rakesearch_linux_arm_v7l_neon.tgz) to work on a pi 3. I might give it a try and see. It might possibly work with a 64 bit OS. That would be nice to know for sure, one way or the other. It might work on a banana pi or a higher end droid. I don't have either of these.

The above process is more or less the same as on the x86, which was smooth for me.

grep 'neon\|asimd' /proc/cpuinfo | head -1

I'm running the rakesearch_linux_64_sse2.tgz version on an AMD Phenom (running Linux Mint 13). It's not young enough to support AVX. I also have an AMD A8 also on Mint 13, which does have AVX. I haven't attempted to run that as yet.

I've only looked at Arm optimization a little bit. It looks complicated, and like a ton of work. In particular, getting the data to move in and out of the processor while the processor does the work looks difficult to get right. Daniel has clearly gotten it right, so it very likely was a ton of work. Thanks, very much.

Stephen.

Minor update at 2018-01-07.

As you might noticed, number of tasks ready to send (line "Tasks ready to send" on the Server status page) became a significant smaller. This is a consequence of new mechanism of tasks generation. It starts up every 5 minutes and if tasks queue is empty then adds a new 32000 tasks in queue.

Hi, I am trying running AVX512 app and it is not triggering my AVX512 offset set in BIOS on my i9-7920X cpu, it runs with offset for AVX2. Is this app really using AVX512?

edit: been observing it for a little longer and it occasionaly triggers AVX512 offset, but it is quite rare and only for a very short period of time.

Hello Brian!

Excuse me for belated answer. Now there no plans, but of course, ARM platform can supply a big amount of computer power.

I am just curious. Three Months later since last reply. Any change in developing ARM chips support. As you stated the ARM platform can supply a big amount of computer power.

This memory allocation error has been happening on quite a few projects for quite a few years.
The advice given is generally just to double the limit for the memory in the config file each time it occurs.

It is to do with the number of results the user has, the code may say only to load 20 but 'something' in the process is loading everything into memory.

Purging older results can help stop it from happening as well as speeding up the time it takes to load the page.

I guess the system need an automatic process to purge the older WUs from this page ...

All WUs I computed since I started the project (November 30th) are still in this list ... I can't imagine how many entries the page has to handle for Daniel with such a high RAC ... :o

Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 2 bytes) in .../html/inc/db_conn.inc on line 125

On my Odroid-XU4 i get this error:
../../projects/rake.boincfast.ru_rakesearch/rakesearch: error while loading shared libraries: libboinc_api.so.7: cannot open shared object file: No such file or directory
http://rake.boincfast.ru/rakesearch/results.php?hostid=1797

Hi Daniel, and Anyone Else involved in this Optimized App,

If this application's code works as well as some are reporting, then would this code be helpful for the other "Boinc" projects, or only for this project? If so, can this code be integrated into the Boinc software?

Best regards,
Phil
phd21

ARM:
real    20m37.322s
user    20m35.665s
sys     0m0.155s

ARM+NEON:
real    15m58.774s
user    15m57.060s
sys     0m0.080s

PEXT instruction is very slow on Ryzen, as I wrote above. Please try avx2nopext app version, it does not use it, and should be a bit faster than AVX one for you.

I tried to a few days ago. but all end up immediately with a bug/error and then the project start blocking me from download new units.also change all my rest tasks in boinc.m to error task.. on ryzen 1700,1700x .. so i back to AVX after deatach project in boinc manager.. Soo i dont know..but i will do later new tests..))

Could someone please explain the process for correctly unpacking the optimized app files in Linux? I have successfully downloaded and extracted the files to my desktop, but when attempting to place them in the rakesearch folder I hit a dead end. I must be going about this the wrong way. I am trying to use the same process as setting up a cc_config file and it is not working.

So far in Linux Mint Xfce 18.2:
(1) Download file
(2) Extract contents to desktop (couldn't figure out how to extract directly to the rakesearch folder as in Win 7)
(3) Tried using gksudo xed /var/lib/boinc-client/projects/rake.boincfast.ru_rakesearch/ to open the destination folder and add contents but no go.

Is the command wrong or do I need to add /home/skivelitis before /var /lib? Or as is most likely am I completely off-base? I have been using Linux for about a year now but only on dedicated number crunchers and am definitely a noob.
Thanks in advance.

su -
cd /var/lib/boinc/projects/rake.boincfast.ru_rakesearch/
wget https://github.com/sirzooro/RakeSearch/releases/download/v1.0/rakesearch_linux_64_avx.tgz
tar zxvf rakesearch_linux_64_avx.tgz
systemctl restart boinc-client