Rethinking search

Started by Arantor, April 09, 2022, 09:10:29 AM

Previous topic - Next topic

spiros

Quote from: Col on February 23, 2023, 06:09:39 PMSo, if I understand you correctly, the delta index can be rerun quite quickly (minimal interruption). And then, once in a while, a total rebuild of the search database using the whole post table. Yeah, I can see that being more workable, but it remains messy and disruptive (even if to a lesser degree).

I have Delta run every 2 mins and main index once a day. Works just fine for me.

Col

Quote from: spiros on February 24, 2023, 04:30:24 AM
Quote from: Col on February 23, 2023, 06:09:39 PMSo, if I understand you correctly, the delta index can be rerun quite quickly (minimal interruption). And then, once in a while, a total rebuild of the search database using the whole post table. Yeah, I can see that being more workable, but it remains messy and disruptive (even if to a lesser degree).

I have Delta run every 2 mins and main index once a day. Works just fine for me.
How many forum posts in total; and how many posts per day? How long does the total rebuild take when there are a few million posts to reindex?

Arantor

Note that search isn't down while the re-index happens, you do the reindex then switch the indexes over. At least that's how it was when I tidied up the Sphinx docs on that subject (I was a docs contributor in 2008 or so...)

Col

I thought the delta index was the difference between the main index (of old posts) and new posts? My reading of your posts is that there are two full indexes, and they alternate? Yes?

How is the re-indexing triggered?

Arantor

Usually by a cron job, but it doesn't impact on search because search keeps using the old index until the indexer is done and sends a message to search to switch over to the new index (and remove the old one)

They haven't updated the docs for 3.x yet but the same docs in 2.x should be relevant: http://sphinxsearch.com/docs/manual-2.3.2.html#delta-updates

Col

Thanks, Arantor. That seems much more workable than I feared. I'll have read through that and see if it is something I can set up. Though, by the looks of it, if I cannot, I should be able to find someone to install and set it up and it should take care of itself.

Advertisement: