Introd u ction to iterators P YTH ON DATA SC IE N C E TOOL BOX ( - PowerPoint PPT Presentation

Introd u ction to iterators P YTH ON DATA SC IE N C E TOOL BOX ( PAR T 2 ) H u go Bo w ne - Anderson Data Scientist at DataCamp

Iterating w ith a for loop We can iterate o v er a list u sing a for loop employees = ['Nick', 'Lore', 'Hugo'] for employee in employees: print(employee) Nick Lore Hugo PYTHON DATA SCIENCE TOOLBOX ( PART 2)

Iterating w ith a for loop We can iterate o v er a string u sing a for loop for letter in 'DataCamp': print(letter) D a t a C a m p PYTHON DATA SCIENCE TOOLBOX ( PART 2)

Iterating w ith a for loop We can iterate o v er a range object u sing a for loop for i in range(4): print(i) 0 1 2 3 PYTHON DATA SCIENCE TOOLBOX ( PART 2)

Iterators v s . iterables Iterable E x amples : lists , strings , dictionaries , � le connections An object w ith an associated iter() method Appl y ing iter() to an iterable creates an iterator Iterator Prod u ces ne x t v al u e w ith next() PYTHON DATA SCIENCE TOOLBOX ( PART 2)

Iterating o v er iterables : ne x t () word = 'Da' it = iter(word) next(it) 'D' next(it) 'a' next(it) StopIteration Traceback (most recent call last) <ipython-input-11-2cdb14c0d4d6> in <module>() -> 1 next(it) StopIteration: PYTHON DATA SCIENCE TOOLBOX ( PART 2)

Iterating at once w ith * word = 'Data' it = iter(word) print(*it) D a t a print(*it) No more v al u es to go thro u gh ! PYTHON DATA SCIENCE TOOLBOX ( PART 2)

Iterating o v er dictionaries pythonistas = {'hugo': 'bowne-anderson', 'francis': 'castro'} for key, value in pythonistas.items(): print(key, value) francis castro hugo bowne-anderson PYTHON DATA SCIENCE TOOLBOX ( PART 2)

Iterating o v er file connections file = open('file.txt') it = iter(file) print(next(it)) This is the first line. print(next(it)) This is the second line. PYTHON DATA SCIENCE TOOLBOX ( PART 2)

Let ' s practice ! P YTH ON DATA SC IE N C E TOOL BOX ( PAR T 2 )

Pla y ing w ith iterators P YTH ON DATA SC IE N C E TOOL BOX ( PAR T 2 ) H u go Bo w ne - Anderson Data Scientist at DataCamp

Using en u merate () avengers = ['hawkeye', 'iron man', 'thor', 'quicksilver'] e = enumerate(avengers) print(type(e)) <class 'enumerate'> e_list = list(e) print(e_list) [(0, 'hawkeye'), (1, 'iron man'), (2, 'thor'), (3, 'quicksilver')] PYTHON DATA SCIENCE TOOLBOX ( PART 2)

en u merate () and u npack avengers = ['hawkeye', 'iron man', 'thor', 'quicksilver'] for index, value in enumerate(avengers): print(index, value) 0 hawkeye 1 iron man 2 thor 3 quicksilver for index, value in enumerate(avengers, start=10): print(index, value) 10 hawkeye 11 iron man 12 thor 13 quicksilver PYTHON DATA SCIENCE TOOLBOX ( PART 2)

Using z ip () avengers = ['hawkeye', 'iron man', 'thor', 'quicksilver'] names = ['barton', 'stark', 'odinson', 'maximoff'] z = zip(avengers, names) print(type(z)) <class 'zip'> z_list = list(z) print(z_list) [('hawkeye', 'barton'), ('iron man', 'stark'), ('thor', 'odinson'), ('quicksilver', 'maximoff')] PYTHON DATA SCIENCE TOOLBOX ( PART 2)

z ip () and u npack avengers = ['hawkeye', 'iron man', 'thor', 'quicksilver'] names = ['barton', 'stark', 'odinson', 'maximoff'] for z1, z2 in zip(avengers, names): print(z1, z2) hawkeye barton iron man stark thor odinson quicksilver maximoff PYTHON DATA SCIENCE TOOLBOX ( PART 2)

Print z ip w ith * avengers = ['hawkeye', 'iron man', 'thor', 'quicksilver'] names = ['barton', 'stark', 'odinson', 'maximoff'] z = zip(avengers, names) print(*z) ('hawkeye', 'barton') ('iron man', 'stark') ('thor', 'odinson') ('quicksilver', 'maximoff') PYTHON DATA SCIENCE TOOLBOX ( PART 2)

Using iterators to load large files into memor y P YTH ON DATA SC IE N C E TOOL BOX ( PAR T 2 ) H u go Bo w ne - Anderson Data Scientist at DataCamp

Loading data in ch u nks There can be too m u ch data to hold in memor y Sol u tion : load data in ch u nks ! Pandas f u nction : read_csv() Specif y the ch u nk : chunk_size PYTHON DATA SCIENCE TOOLBOX ( PART 2)

Iterating o v er data import pandas as pd result = [] for chunk in pd.read_csv('data.csv', chunksize=1000): result.append(sum(chunk['x'])) total = sum(result) print(total) 4252532 PYTHON DATA SCIENCE TOOLBOX ( PART 2)

Iterating o v er data import pandas as pd total = 0 for chunk in pd.read_csv('data.csv', chunksize=1000): total += sum(chunk['x']) print(total) 4252532 PYTHON DATA SCIENCE TOOLBOX ( PART 2)

Congrat u lations ! P YTH ON DATA SC IE N C E TOOL BOX ( PAR T 2 ) H u go Bo w ne - Anderson Data Scientist at DataCamp

What ’ s ne x t ? List comprehensions and generators List comprehensions : Create lists from other lists , DataFrame col u mns , etc . Single line of code More e � cient than u sing a for loop PYTHON DATA SCIENCE TOOLBOX ( PART 2)

Introd u ction to iterators P YTH ON DATA SC IE N C E TOOL BOX ( - PowerPoint PPT Presentation

Introd u ction to iterators P YTH ON DATA SC IE N C E TOOL BOX ( PAR T 2 ) H u go Bo w ne - Anderson Data Scientist at DataCamp Iterating w ith a for loop We can iterate o v er a list u sing a for loop employees = ['Nick', 'Lore', 'Hugo'] for

Introd u ction to Te x t Encoding FE ATU R E E N G IN E E R IN G FOR MAC H IN E L E AR N IN G

Introd u ction to statistical seismolog y C ASE STU D IE S IN STATISTIC AL TH IN K IN G J u

Introd u ction to P y D u b SP OK E N L AN G U AG E P R OC E SSIN G IN P YTH ON Daniel Bo u

Introd u ction to a u dio data in P y thon SP OK E N L AN G U AG E P R OC E SSIN G IN P YTH ON

Introd u ction to Net w orks IN TR OD U C TION TO N E TW OR K AN ALYSIS IN P YTH ON Eric Ma

Introd u ction to s w imming data C ASE STU D IE S IN STATISTIC AL TH IN K IN G J u stin Bois

Welcome and Introd u ction SU P E R VISE D L E AR N IN G IN R : R E G R E SSION Nina Z u mel and

Introd u ction : Working With Web Data in R W OR K IN G W ITH W E B DATA IN R Oli v er Ke y

Introd u ction to APIs and JSONs IN TE R ME D IATE IMP OR TIN G DATA IN P YTH ON H u go Bo w

Introd u ction to the dataset W OR K IN G W ITH G E OSPATIAL DATA IN P YTH ON Joris Van den

Introd u ction IN TE R ME D IATE IN TE R AC TIVE DATA VISU AL IZATION W ITH P L OTLY IN R

Introd u ction to Teacher Forcing MAC H IN E TR AN SL ATION IN P YTH ON Th u shan Ganegedara

Introd u ction VISU AL IZIN G G E OSPATIAL DATA IN P YTH ON Mar y v an Valkenb u rg Data

Introd u ction to databases STR E AML IN E D DATA IN G E STION W ITH PAN DAS Aman y Mahfo uz

Introd u ction to EFA FAC TOR AN ALYSIS IN R Jennifer Br u sso w Ps y chometrician Ps y cho +

Introd u ction to E x plorator y Data Anal y sis STATISTIC AL TH IN K IN G IN P YTH ON ( PAR T 1

INTROD TRODUCT CTION TO TO PRI RIOR ORITY TY-BASED ED B BUDGET ET BUDGETI TING F FOR

Introd u ction to animation IN TE R ME D IATE IN TE R AC TIVE DATA VISU AL IZATION W ITH P L

Introd u ction to spreadsheets STR E AML IN E D DATA IN G E STION W ITH PAN DAS Aman y Mahfo

Introd u ction to relational databases IN TR OD U C TION TO IMP OR TIN G DATA IN P YTH ON H u

Introd u ction to the Co u rse TIME SE R IE S AN ALYSIS IN P YTH ON Rob Reider Adj u nct

Introd u ction to the NASA fireball data set BU IL D IN G DASH BOAR D S W ITH SH IN YDASH BOAR

Introd u ction to common marketing metrics AN ALYZIN G MAR K E TIN G C AMPAIG N S W ITH PAN

Introd u ction to JSON STR E AML IN E D DATA IN G E STION W ITH PAN DAS Aman y Mahfo uz Instr