How many A:B tests do I have to run before it is meaningful?
Inside Facebook has a good post about how to not screw up your A:B testing that is a useful reminder about how many tests you need to run before you know that the results are statistically significant....
View ArticleHow to implement reporting and analytics for your startup
Andrew Chen has a good post on how a startup should think about implementing analytics that I think applies to companies of all sizes and is worth reading. He notes: In general, a philosophy on the...
View ArticleClik here to view.
Usability testing slows down launch but speeds up success
I hate hearing the term “user error”. Good usability testing should eliminate most user error. I am a big proponent of A:B testing with live users. However, often a small usability test can quickly...
View ArticleTips on A:B testing
If you’re doing A:B testing, you should read this paper and the accompanying presentation by Kohavi, Practical Guide to Controlled Experiments on the Web: Listen to Your Customers not to the HiPPO. It...
View ArticleWhich user experience research tools a startup should use, and when
I recently posted about how usability testing can slow down launch but speed up success. But usability testing is just one of many elements of user experience research, with others including the...
View ArticleClik here to view.
Test your design intuition
I’m an advocate of A:B testing of all elements of design and copy. However, that doesn’t mean that good design intuition can’t help advance the baseline from which you start your testing. Which Test...
View Article
