rethinking hci with neural interfaces
play

Rethinking HCI with Neural Interfaces @CTRLlabsco Adam Berenzweig, - PowerPoint PPT Presentation

Aug 20, 2023 •373 likes •814 views

Rethinking HCI with Neural Interfaces @CTRLlabsco Adam Berenzweig, Director of R&D, CTRL-labs @madadam | adam@ctrl-labs.com 1. A Brief History of User Interface Paradigm Shifts 2. Introduction to Neural Interfaces 3. Designing for Neural

  1. Rethinking HCI with Neural Interfaces @CTRLlabsco Adam Berenzweig, Director of R&D, CTRL-labs @madadam | adam@ctrl-labs.com

  4. 1. A Brief History of User Interface Paradigm Shifts 2. Introduction to Neural Interfaces 3. Designing for Neural Interfaces

  14. 1. A Brief History of User Interface Paradigm Shifts 2. Introduction to Neural Interfaces 3. Designing for Neural Interfaces

  15. Human Human input output 10,000,000 bits/s 30 bits/s

  17. Cortical BMI is hard

  19. Surface EMG neural interface. Biophysical signal to control signal. Neural activity EMG Control

  20. In the future you will connect your nervous system to everything.

  22. 1. A Brief History of User Interface Paradigm Shifts 2. Introduction to Neural Interfaces 3. Designing for Neural Interfaces

  23. Neural Interaction Design Challenges 1. Robustness & Reliability 2. Novel Interactions 3. Ergonomics a. Touchless Control vs. Spatial Computing 4. Learnability & Customization a. Fun to learn, and it learns you. 5. Fit to Environment 6. Props

  25. Neural Interaction Design Challenges 1. 3- and 6-DOF navigation 2. Activation, “wake-word” & mode switching 3. Simultaneous continuous & discrete control 4. Hand-object interaction in XR. 5. Text Input!!

  26. Ergonomics & Comfort 1. Smaller is better -- motionless is best? 2. Anatomically informed 3. Variation is essential for comfort. 4. Force: brief or light.

  28. Hand-Object Interaction in XR 1. Grasping, manipulating. 2. Spatial Computing vs. Touchless Control, i.e. direct vs indirect. 3. Haptics & feedback. Use your arm, or use The Force?

  29. Novel Interactions Co-evolution of software and controllers. Control these with an xbox controller… or your hand?

  30. Novel Interactions Co-evolution of software and controllers. Control these with an xbox controller… or your hand?

  31. Text Input!! 1. One-handed vs two 2. QWERTY-or-not 3. Visual, audio feedback 4. Swipe, chords, …? We can do better than this...

  32. Props 1. Constrain hand shape & muscle activation 2. Something to push against 3. Feels cool 4. Optional scaffolding?

  34. https://www.reddit.com/r/gaming/comments/84wjsk/inverted_mouse/

  38. … 2019 2020

  39. CTRL-kit developer platform. Hardware SDK & API @CTRLlabsco ctrl-labs.com

  40. Questions? adam@ctrl-labs.com @CTRLlabsco @madadam ctrl-labs.com

  41. [Extra slides]

  42. Neurocontrol: EMG → motor neuron activity

  43. The richest signals are at the forearm. Tool / object control Spoken language

Recommend

Characterization of Parylene-C Thin Films as an Encapsulation for Neural Interfaces Hsu, Jui-Mei

Characterization of Parylene-C Thin Films as an Encapsulation for Neural Interfaces Hsu, Jui-Mei

Characterization of Parylene-C Thin Films as an Encapsulation for Neural Interfaces Hsu, Jui-Mei 1 ; Kammer, Sascha 2 ; Jung, Erik 3 ; Rieth, Loren 4 ; Normann, Richard 5 ; Solzbacher, Florian 1,4,5 1 Materials Science and Engineering - University

361 views • 20 slides
CSSE 220 Interfaces and Polymorphism Check out Interfaces from SVN Interfaces What, When,

CSSE 220 Interfaces and Polymorphism Check out Interfaces from SVN Interfaces What, When,

CSSE 220 Interfaces and Polymorphism Check out Interfaces from SVN Interfaces What, When, Why, How? What: Code Structure used to express operations that multiple class have in common No method implementations No fields

611 views • 12 slides
Miniaturized Energy-Efficient Integrated Neural Interfaces Chul Kim Department of Bio and Brain

Miniaturized Energy-Efficient Integrated Neural Interfaces Chul Kim Department of Bio and Brain

Miniaturized Energy-Efficient Integrated Neural Interfaces Chul Kim Department of Bio and Brain Engineering KAIST Microelectrocorticography ( ECoG) Flexible Modular Array Emerging ECoG technologies - High spatiotemporal resolution

332 views • 9 slides
T Topic 7 i 7 Interfaces and Abstract Interfaces and Abstract Classes Interfaces Interfaces

T Topic 7 i 7 Interfaces and Abstract Interfaces and Abstract Classes Interfaces Interfaces

T Topic 7 i 7 Interfaces and Abstract Interfaces and Abstract Classes Interfaces Interfaces I prefer Agassiz in the abstract, rather than in the concrete. CS 307 Fundamentals of CS 307 Fundamentals of 1 2 Computer Science

325 views • 10 slides
Rethinking of the Rethinking of the debian/watch debian/watch With thought experiments about

Rethinking of the Rethinking of the debian/watch debian/watch With thought experiments about

Rethinking of the Rethinking of the debian/watch debian/watch With thought experiments about uscan Kentaro Hayashi DebConf18 in T aiwan 2018-08-03 ClearCode Inc. Digest of this talk Current d/watch fi le is sometimes complicated Update

800 views • 77 slides
Rethinking W aste Rethinking Waste W aste w hat is it? Websters 1913 Dictionary

Rethinking W aste Rethinking Waste W aste w hat is it? Websters 1913 Dictionary

Rethinking W aste Rethinking Waste W aste w hat is it? Websters 1913 Dictionary definition: lying unused; unproductive; w orthless; valueless; refuse; rejected Oxford 2017 English Dictionary definition: elim inated or

582 views • 28 slides
Interfaces Interfaces interface : A list of methods that a class promises to implement.

Interfaces Interfaces interface : A list of methods that a class promises to implement.

Interfaces Interfaces interface : A list of methods that a class promises to implement. Interfaces give you an is-a relationship without code sharing. Only method stubs in the interface Allows object with no common ancestor to act

268 views • 13 slides
Interfaces Interfaces n interface : A list of methods that a class promises to implement. q

Interfaces Interfaces n interface : A list of methods that a class promises to implement. q

10/21/12 Interfaces Interfaces n interface : A list of methods that a class promises to implement. q Interfaces give you an is-a relationship without code sharing. Only method stubs in the interface n Allows object with no common

420 views • 7 slides
Neural Information Retrieval Wassila Lalouani 1 Plan Neural network architectures Neural

Neural Information Retrieval Wassila Lalouani 1 Plan Neural network architectures Neural

Neural Information Retrieval Wassila Lalouani 1 Plan Neural network architectures Neural IR tasks Neural IR architecture Feature Representations Neural IR query auto completion Neural IR query suggestion Neural IR document

1.48k views • 18 slides
CS 349: User Interfaces This course focusses on creating user interfaces (UIs), including

CS 349: User Interfaces This course focusses on creating user interfaces (UIs), including

CS 349: User Interfaces This course focusses on creating user interfaces (UIs), including underlying UI architecture and algorithms, practice implementing UIs using frameworks, and theories and methods relevant to interface design.

378 views • 23 slides
CS 349: User Interfaces This course focuses on creating user interfaces (UIs), including

CS 349: User Interfaces This course focuses on creating user interfaces (UIs), including

CS 349: User Interfaces This course focuses on creating user interfaces (UIs), including underlying UI architecture and algorithms, practice implementing UIs using frameworks, and theories and methods relevant to interface design.

600 views • 20 slides
CS 349: User Interfaces This course focusses on creating user interfaces (UIs), including

CS 349: User Interfaces This course focusses on creating user interfaces (UIs), including

CS 349: User Interfaces This course focusses on creating user interfaces (UIs), including underlying UI architecture and algorithms, practice implementing UIs using frameworks, and theories and methods relevant to interface design.

603 views • 24 slides
RETHINKING THE TOOLS OF ENGAGEMENT FLIPPING THE OUTCOMES RETHINKING THE TOOLS OF ENGAGEMENT /

RETHINKING THE TOOLS OF ENGAGEMENT FLIPPING THE OUTCOMES RETHINKING THE TOOLS OF ENGAGEMENT /

RETHINKING THE TOOLS OF ENGAGEMENT FLIPPING THE OUTCOMES RETHINKING THE TOOLS OF ENGAGEMENT / FLIPPING THE OUTCOMES RETHINKING THE TOOLS OF ENGAGEMENT / FLIPPING THE OUTCOMES 1. THE limitations of current outreach methods RETHINKING THE TOOLS

436 views • 43 slides
SVG for Automotive User SVG for Automotive User Interfaces Interfaces S. Boisgrault, Mines

SVG for Automotive User SVG for Automotive User Interfaces Interfaces S. Boisgrault, Mines

SVG for Automotive User SVG for Automotive User Interfaces Interfaces S. Boisgrault, Mines ParisTech M. Othman Abdallah, Mines ParisTech J.-M. Temmos, Visteon Introduction HMI: human-machine interfaces Design of HMI displays for car

427 views • 24 slides
Neural Decoding of Cursor Motion using Kalman Filter W. Wu, M. J. Black, Y. Gao, E. Bienenstock,

Neural Decoding of Cursor Motion using Kalman Filter W. Wu, M. J. Black, Y. Gao, E. Bienenstock,

Neural Decoding of Cursor Motion using Kalman Filter W. Wu, M. J. Black, Y. Gao, E. Bienenstock, M. Serruya, A. Shaikhouni, J. P. Donoghue NIPS 15, 2003 CSE 599E: Brain-Computer Interfaces Presented by: Jean Wu 19 April 2006 Overview [

306 views • 12 slides
SAASOA Rethinking the Ports Regulatos Core Methodology Rethinking the Ports Regulators Core

SAASOA Rethinking the Ports Regulatos Core Methodology Rethinking the Ports Regulators Core

SAASOA Rethinking the Ports Regulatos Core Methodology Rethinking the Ports Regulators Core Methodology The key objective in regulating a monopoly Problems with the present approach The benefits of a price capping approach SAASOA

650 views • 31 slides
HW-SW Interfaces HW-SW Interfaces Abstraction and Design Abstraction and Design for

HW-SW Interfaces HW-SW Interfaces Abstraction and Design Abstraction and Design for

HW-SW Interfaces HW-SW Interfaces Abstraction and Design Abstraction and Design for Multi-Processor SoC for Multi-Processor SoC Dr. Ahmed Amine JERRAYA TIMA Laboratory 46 Avenue Felix Viallet 38031 Grenoble Cedex France Tel: +33 476 57 47

634 views • 36 slides
assets and rethinking strategies Ann Santry September 2012 Outline Who we are The

assets and rethinking strategies Ann Santry September 2012 Outline Who we are The

CIH Conference 4 April 2014 Rethinking assets and rethinking strategies Ann Santry September 2012 Outline Who we are The challenge Starting point for our review The research and review process Conclusions Creating homes,

535 views • 34 slides
Contradictions in the Desire to Work Past Pension Age Rethinking Retirement presentation ,

Contradictions in the Desire to Work Past Pension Age Rethinking Retirement presentation ,

Contradictions in the Desire to Work Past Pension Age Rethinking Retirement presentation , Manchester, 4 th November 2011 Ben Baumberg, SSPSSR (University of Kent) www.benbaumberg.com Later Working and the Changing Nature of Work Rethinking

524 views • 28 slides
8 Neural MT 2: Attentional Neural MT In the past chapter, we described a simple model for neural

8 Neural MT 2: Attentional Neural MT In the past chapter, we described a simple model for neural

8 Neural MT 2: Attentional Neural MT In the past chapter, we described a simple model for neural machine translation, which uses an encoder to encode sentences as a fixed-length vector. However, in some ways, this view is overly simplified, and

635 views • 9 slides
Rethinking Club Rethinking Club Promotion JUDO BC AGM | JUNE 2014 JENNIFER HOOD | JUMP

Rethinking Club Rethinking Club Promotion JUDO BC AGM | JUNE 2014 JENNIFER HOOD | JUMP

Rethinking Club Rethinking Club Promotion JUDO BC AGM | JUNE 2014 JENNIFER HOOD | JUMP GYMNASTICS INC. JENNIFER HOOD | JUMP GYMNASTICS INC. Sport in Canada The health and well-being of the nation and the medals won at major Games are

423 views • 16 slides
Rethinking public policies for employment promotion EGM on Employment UN-DESA & ILO 23-24

Rethinking public policies for employment promotion EGM on Employment UN-DESA & ILO 23-24

Rethinking public policies for employment promotion EGM on Employment UN-DESA & ILO 23-24 June 2011 Azita Berar Awad ILO Rethinking employment policy Focus on structural crisis of employment; focus on developing countries

333 views • 9 slides
Gradient Descent Finds Global Minima of Deep Neural Networks Simon S. Du, Jason D. Lee, Haochuan

Gradient Descent Finds Global Minima of Deep Neural Networks Simon S. Du, Jason D. Lee, Haochuan

Gradient Descent Finds Global Minima of Deep Neural Networks Simon S. Du, Jason D. Lee, Haochuan Li, Liwei Wang, Xiyu Zhai 1 Empirical Observations on Empirical Risk Zhang et al, 2017, Understanding Deep Learning Requires Rethinking

264 views • 8 slides
Development of a neural prosthesis for motor rehabilitation Andy Jackson 1 and Jaideep Mavoori 2 1

Development of a neural prosthesis for motor rehabilitation Andy Jackson 1 and Jaideep Mavoori 2 1

CSE599E Brain-Computer Interfaces, Spring 2006 Development of a neural prosthesis for motor rehabilitation Andy Jackson 1 and Jaideep Mavoori 2 1 Dept of Physiology and Biophysics and Washington National Primate Research Center, 2 Dept of

278 views • 23 slides

More recommend