PICaFACE : Controlling camera features with facial expressions - - PowerPoint PPT Presentation

▶

Jan 14, 2024 349 likes •606 views

PICaFACE : Controlling camera features with facial expressions Anja Brger, Aynira Wawersig Interaction Engineering - WS 17/18 Augsburg University of Applied Sciences Prof. Dr. Michael Kipp 1. MOTIVATION Why? simplification of

SLIDE 1

PICaFACE:

Controlling camera features with facial expressions

Anja Bürger, Aynira Wawersig Interaction Engineering - WS 17/18 Augsburg University of Applied Sciences

Prof. Dr. Michael Kipp

SLIDE 2

1. MOTIVATION

SLIDE 3

SLIDE 4

Why?

➔ simplification of one-handed interaction while taking pictures ➔ improvement of stability ➔ acceptance of usage?

SLIDE 5

2. RELATED WORK

Chen, Xiang „Anthony“/Schwarz, Julia/Harrison, Chris/Mankoff, Jennifer/Hudson, Scott E. (2014): Air+Touch: Interweaving Touch & In-air Gestures, in: Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. New York, NY, USA: ACM, S.519–525

Air + Touch: Interweaving Touch & In-air Gestures

SLIDE 6

faceType (Alice Strunkmann-Meister and Rodrigo Blásquez)

http://michaelkipp.de/interaction/projects/?/201516w/FaceType/, zuletzt abgerufen am 01.02.2018

SLIDE 7

3. INTERACTION TECHNIQUES

Defining Zoomcenter Panning the Picture Left mouse click Right mouse press

SLIDE 8

Control Condition: Mouse

Zoom in and out Release Left mouse press Left mouse click on button

SLIDE 9

Interaction Scenario Mouth + Eyebrows

Zoom in Zoom out Release Small mouth Wide mouth Raise Eyebrows

SLIDE 10

Interaction Scenario Head + Mouth

Zoom in Zoom out Release Tilt head forwards Tilt head backwards Open mouth wide

SLIDE 11

4. TECHNICAL REALIZATION/SETUP

Laptop + Webcam + Mouse Face gestures

SLIDE 12

6 test persons

Mouse only Mouth (zoom) + Eyebrows (release) Head (zoom) + Mouth (release)

1 task for each scenario = 3 tasks

questionnaire

5. USER TEST

SLIDE 13

Best-Case Picture

amount of false pixels

SLIDE 14

SLIDE 15

6. RESULTS

Mean: total time

SLIDE 16

Mean: total error rate zoom Mean: total error rate release

Mouse Mouth Head Mouse Eyebrow Mouth

SLIDE 17

Mean: Efficiency

percentage of correct pixels / total time in seconds

SLIDE 18

One Significant Difference

➔ Total release error rate: Mouse interaction significantly more reliable than

pening mouth for release

p = 0,0483

SLIDE 19

Most intuitive input

Head tilt Mouth wide & purse Zoom function Mouse Pan Open mouth Raise eyebrows Release function Mouse click

7. QUESTIONNAIRE

SLIDE 20

The most comfortable gestures

Open mouth Raise eyebrows Head tilt Mouth wide & purse Zoom function Release function

SLIDE 21

Gesture which would be used in public

Head tilt Mouth wide & purse Zoom function Open mouth Raise eyebrows Release function

SLIDE 22

8. LIVE DEMONSTRATION

SLIDE 23

9. FURTHER RESEARCH

➔ Clutch mechanism ➔ Technical refinements ➔ Controlling pace of zoom

SLIDE 24