Using keystroke logging in your research ... and in your classroom - PowerPoint PPT Presentation

Using keystroke logging in your research ... and in your classroom Mariëlle Leijten & Luuk Van Waes University of Antwerp | Belgium

Overview 1. Introduction Which areas of research use keystroke logging? 2. Research How do you set up a keystroke logging research study with Inputlog? 3. Teaching How do you provide your students with process feedback in the classroom? 4. Inputlog 9 ‐ Beta How to log Chinese script? 3

Inputlog  Windows (additional logging in MS Word)  Writing modes  keyboard and mouse movements & clicks  speech: Dragon Naturally Speaking Free download for researchers  focus: window monitoring (resources)  Analyses  Graphs  Pre and post processing  Play ‐ back www.inputlog.net Leijten, M., & Van Waes, L. (2013)

Writing process research Process observation provides data for research on:  cognitive writing processes  writing strategies  writing development  translation studies  L1 versus L2 writing  writing from sources  live subtitling  clinical diagnosis (e.g. dyslexia, dementia, aphasia)  literary writers  etc.

KSL with Inputlog: an introduction

General analysis

Research How do you set up a keystroke logging research study with Inputlog?

Designing keystroke logging research The Research Flow data collection data preparation data analysis data preparation data analysis reporting record preprocessing inputlog postprocessing statistical case/group 9 Leijten, M., & Van Waes, L. (2020 – in press). Designing Keystroke Logging Research in Writing, Chinese Journal of Second Language Writing

data collection data preparation data analysis data preparation data analysis reporting record preprocessing inputlog postprocessing statistical case/group New, previous or other document Copy task 10

data collection data preparation data analysis data preparation data analysis reporting record preprocessing inputlog postprocessing statistical case/group Data cleaning 11

data collection data preparation data analysis data preparation data analysis reporting record preprocessing inputlog postprocessing statistical case/group Data categorisation 12

data collection data preparation data analysis data preparation data analysis reporting record preprocessing inputlog postprocessing statistical case/group Basic analyses Specific analyses Visual analyses  general  source  process graph  linear  fluency  source network  summary  bigram  fluency graph  pause  word pause  revision  linguistic  s ‐ notatation  token  copy task 13

data collection data preparation data analysis data preparation data analysis reporting record preprocessing inputlog postprocessing statistical case/group Basic analyses Specific analyses Visual analyses  general  source  process graph  linear  fluency  source network  summary  bigram  fluency graph  pause  word pause  revision  linguistic  s ‐ notatation  token  copy task 14

Process graph

Pauses (ms) Characters Characters produced deleted text Document length Pause (threshold of  2000ms) Cursor position Time (minutes)

Pauses (ms) Characters Characters produced Document length Cursor position Consulting external source(s) Time (minutes) Sources Main document Writing in the main document

Pauses (ms) Characters Characters produced Document length Writing Cursor position at the point of utterance Consulting external source(s) Writing within the text produced so far Time (minutes) Time (minutes) Sources Sources Main document Main document Writing in the main document

Pauses (ms) Characters Characters produced Global revisions (in the beginning of the text) ‐ 60% Writing at the point of utterance Document length Local revisions at the point of utterance Cursor position Time (minutes) Time (minutes) Sources Sources Main document Main document

Process graphs Linear writing process Recursive writing process Singular global revision episode Multiple global revision episodes 20

Designing keystroke logging research The Research Flow data collection data preparation data analysis data preparation data analysis reporting record preprocessing inputlog postprocessing statistical case/group 21 Leijten, M., & Van Waes, L. (2020 – in press). Designing Keystroke Logging Research in Writing, Chinese Journal of Second Language Writing

Teaching The Inputlog report function How to bring process feedback to the classroom?

Bring process data to the classroom Challenges:  technical  pedagogical  statistical

How to bring the process to class? lost in data lots of data

Analyze 3000+ variables 15 variables

Process reports: user friendly

Process report: Example

28

Report

Process graph

Instructional movie 31

Pedagogy: Process feedback flow process report Benchmark

Inputlog 9 - Beta Logging Chinese script How to log Chinese script?

Logging Chinese script Thanks to: prof. WANG Junju CHENG Wei XU Cuiqin

Screenshot Inputlog 9 beta

Example

Next steps  Develop analyses for Chinese logging  Bring more ‘intelligence’ ‐ big data studies ‐ pattern analysis ‐ machine learning

www.inputlog.net Good luck on using keystroke logging in your research… and in your classroom