nput " Input Presented by: Jim McKeeth Embarcadero - PDF document

¡ K4 K4 Keynote ¡ 4/16/2015 ¡9:45 ¡AM ¡ ¡ ¡ ¡ " Thought hought: : The he Fut Futur ure e of of Mobile obile and and Embedded mbedded Applicat pplication ion nput " Input ¡ Presented by: Jim McKeeth Embarcadero Technologies ¡ ¡ ¡ ¡ ¡ Brought ¡to ¡you ¡by: ¡ ¡ ¡ ¡ 340 ¡Corporate ¡Way, ¡Suite ¡300, ¡Orange ¡Park, ¡FL ¡32073 ¡ 888-­‑268-­‑8770 ¡·√ ¡904-­‑278-­‑0524 ¡·√ ¡sqeinfo@sqe.com ¡·√ ¡www.sqe.com

Jim McKeeth Embarcadero Technologies As lead developer evangelist at Embarcadero Technologies, Jim McKeeth is a key part of Embarcadero’s developer community outreach. With more than twenty years of programming experience, Jim travels the world speaking at conferences and sharing his excitement and knowledge. He holds a patent for the swipe to unlock and pattern unlocks used on both iPhone and Android phones, plus a number of other computer- and software-related patents. When not traveling, Jim is an improvisational performer with ComedySportz Boise and enjoys spending time with his family. ¡

4/6/15 ¡ Thought: The Future of Mobile and Embedded Application Input J IM M C K EETH E MBARCADERO T ECHNOLOGIES JIM . MCKEETH @ EMBARCADERO . COM @J IM M C K EETH About Jim McKeeth • Lead World Wide Developer Evangelist • Host of Podcast at Delphi.org • Longtime developer ◦ Object Pascal, Java, C#, JavaScript, Objective-C, etc. • Invented and patented swipe to unlock in 2000 ◦ US Patent # 8352745 & 6766456, etc. • Improvisational performer with ComedySportz Boise • I am not a neuroscientist, but I find this all fascinating! 2 ¡ ‹#› 1 ¡

4/6/15 ¡ Embarcadero Technologies • Founded 1993 • Provides Architect, Database and Developer Tools • 3.2 Million Customers including 97% of Fortune 2000 • 35+ Product Awards – Consistent Innovation • 500+ Employees in 29 Countries • www.embarcadero.com 3 ¡ ‹#› Agenda • The Science of Reading the Brain • The Science of Direct Brain Input • Consumer Brain-Computer Interfaces • Demonstration - Volunteer flying the Quadricopter • Summary & MindTunes 4 ¡ ‹#› Images ¡from ¡Wikimedia ¡Commons ¡or ¡Product ¡websites. 2 ¡

4/6/15 ¡ What will the world be like in five years? “In five years, science fiction will be real!” -Claus Torp Jensen (@ClausTorpJensen) Senior Technical Staff Member and Chief Architect API Economy at IBM (@ibmapimgt) 5 ¡ ‹#› Brain-Computer Interface ST:TNG ¡Episode ¡93 ¡(4x19): ¡ The ¡Nth ¡Degree ¡ (1991) ¡ ¡ 6 ¡ ‹#› 3 ¡

4/6/15 ¡ The Science of Reading the Brain Polygraph (aka Lie Detector) • Measures physical manifestations of stress that come with lying • Blood pressure, pulse, respiration, skin conductivity, etc. • Looks for changes. • Requires specialized training. • Invented in 1921 8 ¡ ‹#› 4 ¡

4/6/15 ¡ Heart Rate Monitors • Bluetooth GATT Profiles supports all Bluetooth Smart Heart Rate Monitors. • Your app doesn’t need to support individual heart rate monitors. https://developer.bluetooth.org/TechnologyOverview/Pages/HRP.aspx • Assigned Number: 0x180D https://developer.bluetooth.org/gatt/profiles/Pages/ProfilesHome.aspx 9 ¡ ‹#› Magnetic Resonance Imaging (MRI) • Uses oscillating magnetic fields at different resonant frequencies. • Functional MRI (fMRI) uses software to analyze images. • Shows activity (blood flow) in different parts of the brain. • Combined with brain mapping can reveal thought information. 10 ¡ ‹#› 5 ¡

4/6/15 ¡ Electroencephalography (EEG) • Measures electrical activity along the scalp. • Detects voltage fluctuations resulting from ionic current flows within neurons of brain. • Millisecond-range resolution (faster than CT or MRI) • Typical clinical usage has 19+ input electrodes as well as ground and reference. 11 ¡ ‹#› • Invented between 1875 and 1924 Magnetoencephalography (MEG) Uses Arrays of SQUIDs (Superconducting QUantum Interference Devices) 12 ¡ ‹#› 6 ¡

4/6/15 ¡ The Science of Direct Brain Input Change Perception of Reality The ¡“headjack” ¡from ¡ The ¡Matrix ¡ movies ¡-­‑ ¡1999 ¡ 14 ¡ ‹#› 7 ¡

4/6/15 ¡ Transcranial Direct-Current Stimulation (tDCS) • Constant, low current delivered via electrodes. • Results: ◦ Increase cognitive performance ◦ Enhance language & math ability ◦ Improve attention span ◦ Aid problem solving, memory & coordination Accelerated Learning tdcsplacements.com • Recent DIY “Brain Hacking” Craze http://thebrainstimulator.net/ 15 ¡ ‹#› ◦ http://www.reddit.com/r/tDCS tDCS with Mobile • foc.us just launched new tDCS headsets with Bluetooth API • Targeting athletes and gamers • Developer devices available • http://www.foc.us/index.php/v2-tdcs- developer-edition • http://www.foc.us/bluetooth-api 16 ¡ ‹#› 8 ¡

4/6/15 ¡ Transcranial Magnetic Stimulation (TMS) • Similar strength to MRI • Magnetic induction of electrical currents • Used to treat neurological conditions • Produces: ◦ Flashes of lights in vision (phosphene) ◦ Muscular activity 17 ¡ ‹#› Ultrasonic Transcranial Stimulation Device • 2000 patent from Sony (US6584357 B1) Speculative work, “There were not any ◦ Finer targeting than TMS experiments done.” ◦ Theoretically invoking sensory experiences ◦ Continued research and patents (US7350522 B2) hHp://www.newscienLst.com/arLcle/mg18624944.600 ¡ ¡ ¡ 18 ¡ ‹#› 9 ¡

4/6/15 ¡ Ultrasonic Neuromodulation for Spatial Resolution • Virginia Tech Carilion Research Institute study published in Jan 2014 Nature Neuroscience • Used “targeted ultrasound” to boost “sensory perception” • Targeted an area of the brain as small as the size of an “M&M” 19 ¡ hHp://www.eurekalert.org/pub_releases/2014-­‑01/vt-­‑udt011014.php ¡ ¡ ‹#› Using More than 10% of Our Brain? We all use LUCY 1 00% of our 2014 Brain Capacity 20 ¡ ‹#› 10 ¡

4/6/15 ¡ Science Fiction Becoming Reality Interesting Milestones Brain-to-Brain Input The ¡“Hat” ¡from ¡ Brainstorm ¡-­‑ ¡1983 ¡ 22 ¡ ‹#› 11 ¡

4/6/15 ¡ Brain-to-Brain Input at University of Washington in 2013 • Input from Computer • EEG from brain • Transmitted over campus internet • Replayed through TMS to another brain • Output to computer More information http://bit.ly/EEG2TMS & http://bit.ly/bci2cbi 23 ¡ ‹#› See What You See - Hear What You Hear The ¡“Monitor” ¡from ¡ Ender’s ¡Game ¡ – ¡2013 ¡ 24 ¡ ‹#› 12 ¡

4/6/15 ¡ See What You See • In 2010 a team lead by Shinji Nishimoto partially reconstructed YouTube videos based on brain recordings. • Used fMRI • Overlaid similar videos to create composite video. • http://youtu.be/nsjDnYxJ0bo & http://youtu.be/EdGjB6XCXOA 25 ¡ http://bit.ly/ReconstructingVisual ‹#› Hear What You Hear • 2012 - UC Berkeley & Brian Pasley decoded internal neural processing of auditory information. • Reconstructed sound on computer from electrical signals in observer’s brains. • Resulting sound was recognizable when compared to original. 26 ¡ hHp://bit.ly/ReconstrucLngSpeech ¡ ¡ ‹#› 13 ¡

4/6/15 ¡ Data Entry via BCI ST:TNG ¡Episode ¡93 ¡(4x19): ¡ The ¡Nth ¡Degree ¡ (1991) ¡ ¡ 27 ¡ ‹#› Typing via BCI • Brain researcher Jonathan . � . � . � . � . � . � . � . � Wolpaw at Wadsworth Center in . � A � B � C � D � E � F � . � Albany, NY . � G � H � I � J � K � L � . � • Wear EEG while looking at a . � M � N � O � P � Q � R � . � flashing matrix of characters . � S � T � U � V � W � X � . � • Each character flashes with a . � Y � Z � 1 � 2 � 3 � 4 � . � different pattern . � 5 � 6 � 7 � 8 � 9 � 0 � . � • ~15 seconds to type a character . � . � . � . � . � . � . � . � • The Verge http://embt.co/typebci 28 ¡ ‹#› 14 ¡

4/6/15 ¡ Uploading Your Consciousness 29 ¡ Transcendence ¡-­‑ ¡2014 ¡ ¡ ‹#› Human Connectome Project • Map of neural connection the brain • The neurological version of the genome • Unique to each person, changes over time • Representation of memories, thoughts, etc. • www.ted.com/talks/sebastian_seung • humanconnectomeproject.org • humanconnectome.org Image ¡by ¡Xavier ¡Gigandet ¡et. ¡al. ¡ 30 ¡ ‹#› 15 ¡