View Single Post
Old 10-16-2010, 09:03 AM  
VGeorgie
Confirmed User
 
Join Date: Nov 2008
Posts: 359
Quote:
Originally Posted by MisterPeabody View Post
Guess you missed the part where I said we did test this. I never said I didn't test the same time, day of week, etc. My point was, these other factors can have an affect on any 3rd party cc processer.

In other words, if testing would simply answer the issue don't you think a "real business" like Twistys (forget MRPW) would have their answer and not have to start threads publicly wondering WTF? Guess testing doesn't answer it then, does it?
I guess you missed the part where I said the test is to flatly determine if a processor is to blame. You said you ran the tests but since you still complain about strange sales days the conclusion has to be it's not the fault of the specific processor. It's one of these other things, and you are right, there are many things that influence a day's sales.

A/B tests are common in research and business. But you must pull from the same test group. You don't test one processor one day, and another the next, because those are different test groups. You don't switch processors when things start to look strange. Every time I read one of these threads this is what people are doing. Shap didn't say he's run A/B tests. He said he flipped the cascade after noticing a period of poor sales. That's inconclusive.

Or, just on the fundamental analysis side, I note Kickass still uses CCBill at the top of their cascade. They're pretty big, right? Either they accept these mysterious sales days as part of business, or they don't have them, or CCBill has a secret pact with them to not screw them over, like they supposedly do with everyone else.

Don't get me wrong - I'm not saying we should blindly accept results from third party partners and never question things. Questioning is good. But there are proven, established methodologies that can resolve these questions. If you've done A/B tests, it would be nice to know the (general) results. Include the length of the test, the size of the test groups, and what you discovered.

I mean, it's not like this information would help a competitor, but if whatever the outcome of your tests, it would provide some real facts among a lot of conjecture and outright fearmongering.
VGeorgie is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote