CSCI211: Intro Objec1ves Introduc1on to Algorithms, Analysis Course - PDF document

1/11/18 CSCI211: Intro Objec1ves • Introduc1on to Algorithms, Analysis • Course summary • Reviewing proof techniques Jan 8, 2018 Sprenkle – CSCI211 1 My Bio • From Dallastown, PA • B.S., GeQysburg College • M.S., Duke University • Ph.D., University of Delaware • For fun: pop culture, gardening, volunteer at Rockbridge Animal Alliance Jan 8, 2018 2 Sprenkle – CSCI211 1

1/11/18 What This Course Is About From 30 Rock Jan 8, 2018 Sprenkle – CSCI211 3 Now, everything comes down to expert knowledge of algorithms and data structures . If you don't speak fluent O-notation , you may have trouble getting your next job at the technology companies in the forefront. -- Larry Freeman For me, great algorithms are the poetry of computation. Just like verse, they can be terse, allusive, dense, and � even mysterious. But once unlocked, they cast a � brilliant new light on some aspect of computing. -- Francis Sullivan Jan 8, 2018 Sprenkle – CSCI211 4 2

1/11/18 Mo1va1on • From a Google interview prepara1on email Get your algorithms straight (they may comprise up to a third � of your interview). Visit: http://en.wikipedia.org/wiki/List_of_algorithm_general_topics and examine this list of algorithms: � http://en.wikipedia.org/wiki/List_of_algorithms and data structures: http://en.wikipedia.org/wiki/List_of_data_structures Write out all the algorithms yourself from start to finish and � make sure they're working. Jan 8, 2018 Sprenkle – CSCI211 5 What is an Algorithm? • Precise procedure to solve a problem • Completes in a finite number of steps Jan 8, 2018 Sprenkle – CSCI211 6 3

1/11/18 Ques1ons to Consider • What are our goals when designing algorithms? • How do we know when we’ve met our goals? • Goals: Correctness, Efficiency • Use analysis to show/prove Jan 8, 2018 Sprenkle – CSCI211 7 Course Goals • Learn how to formulate precise problem descrip1ons • Learn specific algorithm design techniques and how to apply them • Learn how to analyze algorithms for efficiency and for correctness • Learn when no exact, efficient solu1on is possible Jan 8, 2018 Sprenkle – CSCI211 8 4

1/11/18 Course Content • Algorithm analysis Ø Formal – proofs; Asympto1c bounds • Advanced data structures Ø e.g., heaps, graphs • Greedy Algorithms • Divide and Conquer • Dynamic Programming • Network Flow • Computa1onal Intractability Jan 8, 2018 Sprenkle – CSCI211 9 Course Notes • Textbook: Algorithm Design • Par1cipa1on is encouraged Ø Individual, group, class • Assignments: Ø Reading text, wri1ng brief summaries • Readings through Friday due following Monday Ø Solu1ons to problems Given on Friday, � Ø Analysis of solu1ons due next Friday Ø Programming (liQle) Jan 8, 2018 Sprenkle – CSCI211 10 5

1/11/18 Course Grading • 38% Individual wriQen and programming homework assignments • 30% Two midterm exams • 20% Final • 7% Text book reading summaries, weekly Ø In a journal on wiki • 5% Par1cipa1on and aQendance Jan 8, 2018 Sprenkle – CSCI211 11 Journal Content • Brief summary of chapter/sec1on Ø ~1 paragraph of about 5-10 sentences/sec1on; feel free to write more if that will help you • Include mo1va1ons for the given problem, as appropriate • For algorithms, brief sketch of algorithm, intui1on, and implementa1on Ø Include run1me • Ques1ons you have about mo1va1on/solu1on/proofs/analysis • Discuss anything that makes more sense aler reading it again, aler it was presented in class (or vice versa) • Anything that you want to remember, anything that will help you • Say something about how readable/interes1ng the sec1on was on scale of 1 to 10 Jan 8, 2018 Sprenkle – CSCI211 12 6

1/11/18 Journal Grading Grade Meaning ✔ + Especially well-done, insighoul ques1ons ✔ Typical grade ✔ - Unsa1sfactory write up; will have specific feedback 0 No submission Jan 8, 2018 Sprenkle – CSCI211 13 ALGORITHMS Jan 8, 2018 Sprenkle – CSCI211 14 7

1/11/18 Computa1onal Problem Solving 101 • Computa1onal Problem Ø A problem that can be solved by logic • To solve the problem: 1. Create a model of the problem 2. Design an algorithm for solving the problem using the model 3. Write a program that implements the algorithm Jan 8, 2018 Sprenkle – CSCI211 15 Computa1onal Problem Solving 101 • Algorithm: a well-defined recipe for solving a problem Ø Has a finite number of steps Ø Completes in a finite amount of 1me • Program Ø An algorithm wriQen in a programming language Ø Important to consider implementa1on’s effect on run1me Jan 8, 2018 Sprenkle – CSCI211 16 8

1/11/18 PROOFS Jan 8, 2018 Sprenkle – CSCI211 17 Why Proofs? • What are insufficient alterna1ves? • How can we prove something isn’t true? Jan 8, 2018 Sprenkle – CSCI211 18 9

1/11/18 Why Proofs? • What are insufficient alterna1ves? Ø Examples • Considered all possible? Ø Empirical/sta1s1cal evidence • Ex: “Lying” with sta1s1cs • How can we prove something isn’t true? Ø One counterexample Need irrefutable proof that something is true—for all possibilities Jan 8, 2018 Sprenkle – CSCI211 19 Soap Opera Proofs • “It’s the only thing that makes sense.” Jan 8, 2018 Sprenkle – CSCI211 20 10

1/11/18 From Joel Feinstein � Not discussed in class University of Nottingham Analyzing Sta1s1cs “Why do we do proofs” Two hospitals (A and B) each claim to be better � at treating a certain disease than the other. Hospital A Hospital B • cured a greater % of its • cured a greater % of its male pa7ents last year than pa7ents last year than Hospital B Hospital A • cured a greater % of its female pa7ents last year than Hospital B Given that none of the #s involved are zero, is it possible that both hospitals have their calculations correct? If so, which hospital would you rather be treated by? Jan 8, 2018 Sprenkle – CSCI211 21 From Joel Feinstein � Not discussed in class University of Nottingham Example “Why do we do proofs” Male Female Total Hospital % % % Pa;ents Pa;ents Pa;ents A 50/100 50% 1/1 100% 51/101 50.5% B 24/50 48% 49/50 98% 73/100 73% Well-known phenomenon: Simpson’s Paradox Jan 8, 2018 Sprenkle – CSCI211 22 11

1/11/18 Common Types of Proofs? Jan 8, 2018 Sprenkle – CSCI211 23 Common Types of Proofs • Direct proofs Ø Series of true statements, each implies the next • Proof by contradic1on • Proof by induc1on Jan 8, 2018 Sprenkle – CSCI211 24 12

1/11/18 Proof By Contradic1on What are the steps to a proof by contradiction? Jan 8, 2018 Sprenkle – CSCI211 25 Proof By Contradic1on 1. Assume the proposi1on (P) we want to prove is false 2. Reason to a contradic1on 3. Conclude that P must therefore be true Jan 8, 2018 Sprenkle – CSCI211 26 13

1/11/18 Prove: There are Infinitely Many Primes Jan 8, 2018 Sprenkle – CSCI211 27 Prove: There are Infinitely Many Primes • What is a prime number? • What is not-a-prime number? • What is our first step (proof by contradic1on)? • What do we want to show? Jan 8, 2018 Sprenkle – CSCI211 28 14

1/11/18 Prove: There are Infinitely Many Primes • Assume there are a finite number of prime numbers Ø List them: p 1 , p 2 ..., p n • Consider the number q = p 1 p 2 ... p n + 1 What are the possibilities for q? q is either composite or prime Jan 8, 2018 Sprenkle – CSCI211 29 Prove: There are Infinitely Many Primes • Assume there are a finite number of prime numbers Ø List them: p 1 , p 2 ..., p n • Consider the number q = p 1 p 2 ... p n + 1 • Case: q is composite Ø If we divide q by any of the primes, we get a remainder of 1 à q is not composite Jan 8, 2018 Sprenkle – CSCI211 30 15

1/11/18 Prove: There are Infinitely Many Primes • Assume there are a finite number of prime numbers Ø List them: p 1 , p 2 ..., p n • Consider the number q = p 1 p 2 ... p n + 1 • Case: q is composite Ø If we divide q by any of the primes, we get a remainder of 1 à q is not composite • Therefore, q is prime, but q is larger than any of the finitely enumerated prime numbers listed à Contradic7on Proof thanks to Euclid Jan 8, 2018 Sprenkle – CSCI211 31 Proof By Induc1on What are the steps to a proof by induction? Jan 8, 2018 Sprenkle – CSCI211 32 16