GoFuckYourself.com - Adult Webmaster Forum

GoFuckYourself.com - Adult Webmaster Forum (https://gfy.com/index.php)
-   Fucking Around & Business Discussion (https://gfy.com/forumdisplay.php?f=26)
-   -   full text search, what are you using ? (https://gfy.com/showthread.php?t=1300329)

freecartoonporn 06-20-2018 11:32 AM

full text search, what are you using ?
 
i am using mysql native full text search. but increased traffic is crashing my mysql., and server load is fucking high too, eben on 64 gig box with ssd.

i used sphinx before on different project and it was pain in the ass, taking my server load to the roof. eating all my cpu.

i heard good things about elasticsearch, but looks difficult to implement.

or is it time to scale horizontally ? and throw more servers., and do master slave replication in mysql.

how many servers does the big sites own ? under 10k alexa sites ?

thanks for your time.

i have around 5 mil records and i only need to search title which is varchar 255 .
why the fuck this shit has to be so difficult for dbms.,

one of these days i am gonna code my own fts search engine.,

kjs 06-20-2018 03:02 PM

just use https://elastic.co

sarettah 06-20-2018 03:27 PM

Quote:

Originally Posted by freecartoonporn (Post 22290716)
i have around 5 mil records and i only need to search title which is varchar 255 .
why the fuck this shit has to be so difficult for dbms.,

You would probably be better off NOT using full text search and just using a like statement instead. Full text search has a lot of overhead to it that should not be needed for just a 255 char field.

Do some testing between full text search and using a like statement.

If you can, index the title too.

All strictly imho, of course.

.

freecartoonporn 06-20-2018 06:49 PM

Quote:

Originally Posted by kjs (Post 22290874)

it looks like hosted elastic search.

Quote:

Originally Posted by sarettah (Post 22290892)
You would probably be better off NOT using full text search and just using a like statement instead. Full text search has a lot of overhead to it that should not be needed for just a 255 char field.

Do some testing between full text search and using a like statement.

If you can, index the title too.

All strictly imho, of course.

.

nope, full text search has more performance than like queries,

iceboi 06-20-2018 07:50 PM

I use elastic search on 15 million records - 64gb ram and it performs great. The index doesn't need so much ram though. If it's too hard to set up, then go with the hosted version or you can check out algolia but it can get crazy expensive but might be worth it depending on your business model.

freecartoonporn 06-20-2018 08:30 PM

Quote:

Originally Posted by iceboi (Post 22291062)
I use elastic search on 15 million records - 64gb ram and it performs great. The index doesn't need so much ram though. If it's too hard to set up, then go with the hosted version or you can check out algolia but it can get crazy expensive but might be worth it depending on your business model.

Thanks

how many hits does your site get ?

or whats the alexa of your site ?

do you have single box for lemp and elastic or separate boxes ?

last time i tried setting up elastic on vps , i got confused in elastic and kibana and logstash., looks like i need to do some reading now.

freecartoonporn 06-21-2018 06:08 AM

okat, installed elasticsearch, playing with it now.,


All times are GMT -7. The time now is 08:12 PM.

Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc