So, I just read that manwin moved youporn off mysql and onto redis and are loving the performance gain. They say youporn gets 100million/day and their redis server is clustered.
I moved off mysql earlier this month and onto lucene when traffic started to seriously increase. This is for 5 million/day and lucene isn't clustered as it isn't even working hard.
I too was blasted by the massive improvement in performance - the visitors did too since page load time was a blink and search was a shitload more useful and accurate (number of daily searches went up 10x within a few days)
So, are you using either of these two, or another nosql flavour? If by any miracle, anyone has tried both, care to give a breakdown of which you settled for and why?
I haven't tried Redis, and after reading about it I think I'm better with lucene, simply because of its faceted search capabilities, that I use heavily...
And before anyone starts blowing the trumpet of mysql, yeah I love mysql too - I'm running other things, particularly one that has 30+million dailies that heavily uses mysql and mysql isn't anywhere near sweating.... but that is a different operation with different needs. What I'm on about are pages that heavily use key/value stores and require superior full text search capabilities.
Eric @manwin must surely have tested lucene, so I'd value his input
