Driving Quality with the "Yes, If ..." Mentality - PDF document

¡ ¡ T13 ¡ Leadership ¡ Thursday, ¡October ¡3rd, ¡2019 ¡1:30 ¡PM ¡ ¡ ¡ ¡ ¡ Driving ¡Quality ¡with ¡the ¡"Yes, ¡If ¡..." ¡ Mentality ¡ ¡ Presented ¡by: ¡ ¡ ¡ ¡ Jane ¡Jeffers ¡ ¡ Riot ¡Games ¡ ¡ Brought ¡to ¡you ¡by: ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ 888 -­‑-­‑-­‑ 268 -­‑-­‑-­‑ 8770 ¡ ·√·√ ¡904 -­‑-­‑-­‑ 278 -­‑-­‑-­‑ 0524 ¡-­‑ ¡info@techwell.com ¡-­‑ ¡http://www.starwest.techwell.com/ ¡ ¡ ¡ ¡ ¡ ¡ ¡

¡ Jane ¡Jeffers ¡ ¡ A ¡QA ¡architect ¡on ¡League ¡of ¡Legends ¡at ¡Riot ¡Games, ¡Jane ¡Jeffers ¡has ¡more ¡than ¡nine ¡ years ¡in ¡the ¡games ¡industry. ¡Before ¡moving ¡into ¡the ¡MOBA ¡(Multiplayer ¡Online ¡ Battle ¡Arena) ¡space, ¡she ¡worked ¡on ¡multi-­‑platform ¡AAA ¡RTS ¡titles ¡such ¡as ¡The ¡Lord ¡ of ¡the ¡Rings: ¡The ¡Battle ¡for ¡Middle-­‑Earth ¡II ¡and ¡Command ¡& ¡Conquer ¡3. ¡As ¡a ¡content ¡ specialist ¡on ¡League ¡of ¡Legends, ¡Jane ¡built ¡much ¡of ¡the ¡QA ¡process ¡around ¡features ¡ that ¡allow ¡players ¡to ¡personalize ¡their ¡experience, ¡fusing ¡her ¡previous ¡black ¡box ¡ testing ¡background ¡with ¡a ¡qualitative ¡approach ¡in ¡the ¡agile ¡arena. ¡ ¡

Jane Jeffers jjeffers@riotgames.com www.riotgames.com

Introduction VILLAIN CAUTION ! !

Introduction

Introduction

Introduction VILLAIN CAUTION ! !

Introduction Let’s cross the bridge!

Introduction NO , BECAUSE…

Introduction Never mind… Give Up Give Up Fight Go Around

Introduction Give Up Fight Fight Go Around

Introduction Bypass mode initiated Give Up Fight Go Around Go Around

Introduction …the bridge isn’t safe. 404: Floor Not Found

Introduction Instead, stead, sa say: y: Don’t say: “Yes, if…” “No, because…”

MAIN IN MENU NU Introduction Diving in with Context Shining Light on Resources Unchaining from Limitations Final Thoughts

Introduction Valid reasons to say “No, because…”  Ser eriou ious s Healt alth h & Saf afety ety Ris isks ks  Leg egal al Concer ncerns  Con ontra tractual ctual Obl bligati igation on Vio iolat lation ions  Reg egula ulation/Ce tion/Certifica rtification tion Risks sks  Cul ultur tural al Tab aboos oos  Cus ustom tomer er Dat ata a Ris isks ks

Introduction Ch Chang anging ing mind indsets sets is ha is hard. rd. (Don’t panic when you get it wrong)

Diving ving in with th Context text

Diving in with Context

Diving in with Context What if players unlock progressive rewards based on how much they participate in the event?

Diving in with Context ! ! !

Diving in with Context IT’S FOR CHARITY! …okay, fine

Diving in with Context No, because…  I don’t understand why we wan ant t to do o tha hat  That idea won’t work (fo for r [in insert sert reason ason])  The here re are e blo lockers ckers (th that at people aren’t aware of)  …that just sounds like a pre retty tty cra razy zy idea, ea, fam am

Diving in with Context No, because…  I don’t understand why we wan ant t to do o tha hat We’re missing CO CONT NTEXT XT  That idea won’t work (fo for r [in insert sert reason ason])  The here re are e blo lockers ckers (th that at people aren’t aware of)  …that just sounds like a pre retty tty cra razy zy idea, ea, fam am

Diving in with Context Yes, if…  You ou hel elp me und nderst erstand nd why hy thi his s is goo ood d to do  We mod odify ify the he ide dea a so tha hat t it can n wor ork  We can an sol olve ve for r the hese se blo locke ckers rs tha hat t wor orry ry me  We com ome e up wit ith a pla lan tha hat t mak akes es sen ense se

Diving in with Context Ho How do w does es it it dr driv ive e Qu Qual alit ity? y? More re context text = Bette tter r testing ting It’s easier to validate goals, requi quirem rements, ents, and d plans ans Quali ality ty is woven en into o the decis cision ion- making king and d the solutio lutions ns

Shinin ining g Light ght on Resour sources ces

Shining Light on Resources

Shining Light on Resources Let’s make 9 additional forms based on elements! And players can combine some elements to get other elements during the actual game!

Shining Light on Resources YES, IF all of the art sub-disciplines can finish their work on these specific dates, AND we can figure out the tech with enough time to test and fix it. Okay!

Shining Light on Resources No, because…  We don’t have enough tim ime e to do tha hat  We don’t have a big eno nough ugh tes est t tea eam  There isn’t enough test aut utoma omation tion cov overa erage ge  We don’t have the right equ quipm ipment/har ent/hardware dware

Shining Light on Resources No, because…  We don’t have enough tim ime e to do tha hat We don’t have the right  We don’t have a big RESOU RE OURC RCES ES eno nough ugh tes est t tea eam  There isn’t enough test aut utoma omation tion cov overa erage ge  We don’t have the right equ quipm ipment/har ent/hardware dware

Shining Light on Resources Yes, if…  We get et mor ore e tim ime/ca e/can adj djust ust the he dea eadli dline ne  We can an gro row w our ur tea eam/g m/get et mor ore e peo eople ple  We inv nvest est in more re tes est t aut utoma omation tion  We can an get et the he right ght equ quipm ipment/har ent/hardware dware

Shining Light on Resources Ho How do w does es it it dr driv ive e Qu Qual alit ity? y? Quality We activ ively ely repr pres esen ent t Quali ality ty in the dev v proce ocess ss Time Cost By havin ing g resou ourcin rcing g conv nver ersati sation ons, s, we bette tter r under dersta stand d actua tual l prior ioriti ities There’s enough flexibility to pick quality ality-mi minded nded solutio lutions ns

Unchai chaining ning from om Limita mitation tions

Unchaining from Limitations

Unchaining from Limitations https://www.youtube.com/watch?v=vJFv8eUXvyg

Unchaining from Limitations No, because…  Our system/tech can’t handle it or wasn’t des esign igned ed to do that at  We hav ave e too o muc uch h tec ech h deb ebt t blo locking cking us  Our tools just don’t wor ork k tha hat t way ay  We don’t work that way

Unchaining from Limitations No, because…  Our system/tech can’t handle it or wasn’t des esign igned ed to do that at We ha We have LIM IMIT ITATI ATIONS ONS  We hav ave e too o muc uch h tec ech h deb ebt t blo locking cking us  Our tools just don’t wor ork k tha hat t way ay  We don’t work that way

Unchaining from Limitations Yes, if…  We’re willing to invest in rea eal l chang anges es to our ur sys ystem tem/tech /tech  We res esolve olve the he tech ch debt bt that’s in the way first  We can an ada dapt pt our r too ools ls or get et/make /make new ew one nes  We cha hange nge how ow we wor ork

Unchaining from Limitations Ho How do w does es it it dr driv ive e Qu Qual alit ity? y? It’s easier to help people see why cleaning eaning up tech ch debt t is important portant Quali ality ty-mind minded ed deve velo lopmen pment t crea eate tes less ss issues ues to begin gin with th By pushi hing ng on limi mita tation tions, s, we impr prov ove e the e qualit lity y of everyth erything ing we do

Final nal Though oughts ts

Final Thoughts say “No, because…” The reaso sons s we sa are re of often com omplicated cated and d mu multifa ifaceted. ceted. “Yes, if…” enabl bles s us t s to have the right t conversa rsatio tions ns to untangl ngle e those se reaso sons s and then so solve for them.

Final Thoughts “Yes, if…” builds trust.

Final Thoughts Jane Jeffers jjeffers@riotgames.com www.riotgames.com