James Birchler Engineering Director, IMVU GDC, San Francisco, March 3, 2011
#im imvugdc vugdc @jamesbirchler
1. 1. Exp xperiments eriments 2. 2. Produ duct ct Feat atur ures es 3. 3. produ oduct ct developmen elopment
The sc scien entif tific ic met ethod is based on
experimentation ion
@copernicus
#inquisition
@copernicus
@Giordano_Bruno
@Galileo
@Jamesbirchler
$ IMVU Revenue Growth Qtr Q1'06 Q2'06 Q3'06 Q4'06 Q1'07 Q2'07 Q3'07 Q4'07 Q1'08 Q2'08 Q3'08 Q4'08 Q1'09 Q2'09 Q3'09 Q4'09
Ex Experi erimentati mentation on IS IS GO GOOD OD
Ask Question Got Do Research Scie ienc nce? e? Hypothesis Test Analyze Data Conclusion Report Results
Question Research Results Scient ntific fic Method Conclusion Hypothesis Analyze Test Data
Questi tion Resul ults ts Research rch Quack. Scienti ntific fic #leans nsta tartup Method Hypo pothesis Conclu lusion Analyz lyze An Alleged “duck” Test Data
cul culture ture of of Ex Experimentation erimentation
Okay, I’ll run an Okay, I’ll run an experiment! Okay, I’ll run an Okay, I’ll run an experiment! Okay, I’ll run an experiment! experiment! experiment! Okay, I’ll run an experiment! Let’s keep this Okay, I’ll run an simple! Okay, I’ll run an experiment! experiment! Prove your idea is the best!
Running experiments is fun!
Ask Question Do Research Hypothesis Test Analyze Data Conclusion Report Results Looks a lot like the scientific method (it is!)…
Keep it simple
if( setup_experiment(...) == "control" ) { // do it the old way } else { Simple // do it the new way To code }
Simple To manage
Simple To share
embrace failure
embrace failure
Ex Exper periment iment wi with th proc ocess ess
Meas Measure ure
Meas Measure ure
5 whys
5 whys Root Cause: Fix this!
Pr Proc ocess ess Ex Experi eriment ments
Do Dogm gma
Ideal Days
Ideal Days
Scrum technology…
Hack Week @IMVU…
Recap…
We’re Hiring! www.imvu.com/jobs
credits its Than anks ks
Recommend
More recommend
