#TESTWORKSCONF #XPIRT Marcel de Vries CTO Xpirit @marcelv @marcelv
Lets sell music online! @marcelv
Assemble a team We do Scrum We read THE book @marcelv
@marcelv
Marketing is doing great! @marcelv
Website looks great …. @marcelv
Launch date …. @marcelv
What just happened? @marcelv
@marcelv
But…….?!? We did the lean startup thing…. We used agile methodology to produce the software…. We wrote tons of tests, everything is unit tested, we have 98% coverage!!! We use Microsoft Azure…. We have auto scaling turned on….. @marcelv
Welcome to the pitfall called success! Applications always behave differently when running under high load and stress conditions! @marcelv
I never make the same mistake twice. I make it five or six times, just to be sure.” – Anonymous @marcelv
Performance Load Stress Capacity testing: testing: testing: planning: How will the What is point of users- Will the application How fast will application behave in load that will break be able to scale up the application front of the expected your application? to the expected code perform? users load? future capacity? @marcelv
T ools that can help in this space Variation of Open Source and Commecial software Some common tools used: @marcelv
Performance testing in VS Visual Studio Ultimate(2010,12,13) Visual Studio Enterprise 2015 Web Performance T est Any unit test We have done an amazing job of hiding this diamond (a 10K+ load testing tool) inside the box for years -- Charles Sterling .Net Rocks episode 1202 @marcelv
Demo @marcelv
Typical Enterprise setup TFS Dev .myenterprise.com Server Dev Servers AD server TST .myenterprise.com Prod .myenterprise.com & DNS Server Prod servers AD server DEV network AD server & & DNS Server Dev Clients DNS Server TST Servers Prod network TST network Workplace clients @marcelv TST Clients
Load test configuration TST .myenterprise.com Load test database Load test rig TST network AD server & DNS Server Load generator Load generator Http(s)://myurl.tst.myenterprise.com + Controller TST Workstation @marcelv System Under Test
What is needed to make this work? Appropriate/buy/ rent computers Install your software/agents Physically setup computers Replicate this to all the computers @marcelv
Benefits of cloud load testing No need to Get infrastructure Use the same load Scale out easily setup your own in cloud when test project which in case of doing infrastructure you need it. you use for on stress testing. and maintain it. premises today. @marcelv
Cloud Load test configuration TST .myenterprise.com Load test rig AD server & DNS Server TST network Http(s)://myurl.tst.myenterprise.com Load generator TST Workstation System Under Test Load generator + @marcelv Controller
@marcelv New capabilities in VS 2015 & Update 5 13 regions up to 100 Cores for 72 hrs! @marcelv
Demo @marcelv
But I don’t want Visual Studio! @marcelv
No worries, don’t need it @marcelv
Demo @marcelv
Load testing Approach Need to create representative scenarios Need to provide a real life scenario mix Start with a baseline Always compare to the baseline and check improvements Make it part of your daily routine “It is not hard to break something with a load test but it is extremely hard to learn something when you do” -- Richard Campbell, .Net Rocks episode 1202 @marcelv
Example Node.JS & Mongo optimization done in April @marcelv
Load testing part of build & Release VSTS standard build engine VSTS Release pipelines @marcelv
Demo @marcelv
But what does this cost? • First we need to define a VUM.. • E.g run a test for 1 hour to simulate 10,000 users => @marcelv
Conclusion Cloud based load testing enables easy road to load testing for your external facing sites / API’s Visual Studio supports simple to set up load tests Visual Studio T eam Services(VSTS) provides cloud based load tests supports various formats including JMeter Make load testing part of you automated deployment strategy! @marcelv
@marcelv http://fluentbytes.com mdevries@xpirit.com @marcelv
xpir.it/XpiritMagazine @marcelv http://fluentbytes.com mdevries@xpirit.com @marcelv
Recommend
More recommend
