Do It Yourself A/B Testing

I always start marketing interviews with a phone screen of some variant of the following question: “Let’s say this is your first day at Urbanspoon and I show you the following data. We’ve just launched an A/B test of that I’d like you to evaluate. [The example can be almost anything you want to test different results for – from almost any search element, PPC campaigns, email subject lines etc. In this case, I’m using a PPC example.] Imagine you are running two different ads on a campaign with 50 kewords. We’ve been running Ad A for a while and have 17,235 impressions and 272 clicks. I started running Ad B last week and that has received 41 clicks on 2,253 impressions. What would you do?” I’m looking for an answer that goes beyond demonstration of pre-algebra skills and rudimentary familiarity with a calculator. Obvious answers include splitting up 50 keywords into differen...

Full article: http://searchengineland.com/do-it-yourself-ab-testing-116778

Tweets

@josephshell » 25 Apr '12, 3pm
Interesting read re A/B testing - thanks @elgrom @bigpinots [link]
@bigpinots » 25 Apr '12, 3pm
@josephshell @elgrom Wasn't it this article: [link] << I still have it open to read!
@shaanr » 16 Apr '12, 12pm
Do It Yourself A/B Testing [link] (via Instapaper)
@theindiefeed » 12 Apr '12, 5am
RT @KISSmetrics2012Do It Yourself A/B Testing [link] #measure
@joewardpr » 11 Apr '12, 8pm
A/B testing with statistical confidence intervals #KIS: [link] via @ConradSaam
@amylaceous » 11 Apr '12, 6pm
RT @KISSmetrics: Do It Yourself A/B Testing [link] #measure
@OOm_Singapore » 10 Apr '12, 11pm
DIY A/B testing! Know How by Reading on~ #SEM [link]
@webwallaby » 09 Apr '12, 11pm
RT @stonetemple: Do It Yourself A/B Testing [link] by @conradsaam via @sengineland #SEM #PPC
@seotweetz » 09 Apr '12, 5pm
RT @laurindom: Do It Yourself A/B Testing [link] via @sengineland #SEO #SEM
@LeaonPPC » 08 Apr '12, 9pm
An in depth approach to A/B testing. [link]
@elgrom » 07 Apr '12, 3pm
Do It Yourself A/B Testing. [link] - and the math behind doing it properly!
@reservationbook » 06 Apr '12, 5pm
Very cool for testing outcomes: Do It Yourself A/B Testing [link]
@MamboMedia » 05 Apr '12, 11pm
Do It Yourself A/B Testing, Theoretical Statistics Made Easy with Actionable Next Steps- [link] #SEO #SEM #PPC
@chrisbumgardner » 05 Apr '12, 10pm
How to statistically analyze A/B results: RT @bkmacdaddy: Do It Yourself A/B Testing [link]
@level343 » 05 Apr '12, 7pm
RT @mongoosemetrics: RT @CPollittIU: Do It Yourself A/B Testing [link] via @sengineland
@seotweetz » 05 Apr '12, 7pm
RT @fsoresini: Do It Yourself A/B Testing [link] via @sengineland #seo #analytics
@fsoresini » 05 Apr '12, 7pm
Do It Yourself A/B Testing [link] via @sengineland #seo #analytics
@PromptMailers » 05 Apr '12, 7pm
RT @mindfireinc: Do It Yourself A/B Testing: [link]
@UTstartup » 05 Apr '12, 6pm
RT @seocom: Do It Yourself A/B Testing [link] via @sengineland #UTstartup
@SandboxInd » 05 Apr '12, 6pm
DIY A/B testing for nearly any type of campaign - [link]
@Phil_Ammendolia » 05 Apr '12, 5pm
Do It Yourself A/B Testing [link] - Pretty good article on testing. ABT - Always Be Testing.
@jakelangwith » 05 Apr '12, 2pm
Do It Yourself A/B Testing [link] Test, Test & Test again. Don't forget MVT too
@Mihalek » 05 Apr '12, 2pm
RT @olinjoseph: For all you smart A/B testers out there --> Do It Yourself A/B Testing [link]
@olinjoseph » 05 Apr '12, 2pm
For all you smart A/B testers out there --> Do It Yourself A/B Testing [link]
@danimburns » 05 Apr '12, 1pm
Yes, please. 'Do It Yourself A/B Testing' @sengineland [link]
@leerbyrd » 05 Apr '12, 1pm
Checkout this Great, Free A/B Testing Tool. It offers useful stats to help professionals of all levels. Click Here: [link]
@mongoosemetrics » 05 Apr '12, 1pm
RT @cpollittiu: Do It Yourself A/B Testing [link] via @sengineland
@askppc » 05 Apr '12, 1pm
Do it yourself A/B testing (FREE Tool) - [link] [link]
@alblazek » 05 Apr '12, 1pm
Great post on simple A/B testing [link] via @sengineland
@DopDayMarketing » 05 Apr '12, 12pm
Aside from the ridiculous interview question, this is awesome! Thanks! Do It Yourself A/B Testing [link] via @sengineland
@MidWestDigital1 » 05 Apr '12, 12pm
[link] Learn your A's and B's...everything else will follow.
@TanasukTech » 05 Apr '12, 12pm
Do It Yourself A/B Testing [link] via @sengineland #multivariate
@eliowell » 05 Apr '12, 11am
Do It Yourself A/B Testing [link] vía @sengineland #measure
@ChrisSchuett » 05 Apr '12, 10am
Very useful! Do It Yourself A/B Testing [link] #li
@DickWarner » 05 Apr '12, 10am
Do It Yourself A/B Testing [link] via @sengineland #InterviewQuestion
@sean_GFX_simone » 05 Apr '12, 10am
Marketing by numbers: Do It Yourself A/B Testing [link] via @sengineland
@Maude2711 » 05 Apr '12, 9am
Faîtes vos A/B Testing vous-même! [link]
@Dimflo » 05 Apr '12, 9am
Do It Yourself A/B Testing [link] - do I miss my days back in College? Yes I do. #in
@Kess2000 » 05 Apr '12, 9am
RT @tribaltalk: Do It Yourself A/B Testing [link] #search #seo
@caro_ds » 05 Apr '12, 7am
Intervalle de confiance ... > Do It Yourself A/B Testing [link]
@yannruello » 05 Apr '12, 5am
[en] Faites vous-même l'A/B Testing [link] #webmarketing
@BlueBlazingMdia » 05 Apr '12, 5am
#search #panda Do It Yourself A/B Testing [link]
@googlegirl » 05 Apr '12, 5am
Hot Off the Press! Do It Yourself A/B Testing: I always start marketing interviews with a phon... [link] #searchengineland
@a1_LE_Intl » 05 Apr '12, 5am
I always start marketing interviews with a phone screen of some variant of the following questi... [link] @MotorSportTotal
@TrendingViral » 05 Apr '12, 5am
Josh's Read - Do It Yourself A/B Testing [link]
@AnalyticsNotes » 05 Apr '12, 2am
Do It Yourself A/B Testing [link] via @zite
@camis_z » 05 Apr '12, 2am
#GCTT Good article that links Tech class with the MKT Research elective. Do It Yourself A/B Testing [link] via @sengineland
@JohnBolyard » 04 Apr '12, 11pm
DIY A/B Split Testing - informative and fun to read! [link] via @sengineland
@DowntownRob » 04 Apr '12, 11pm
RT @MarketIntrigue: Do It Yourself A/B Testing [link] via @sengineland
@CSEveteran » 04 Apr '12, 11pm
@CPC_Andrew the timing of this article is hilarious [link]