Contrle optimal de trajectoires locomotrices humaines Quang-Cuong - - PowerPoint PPT Presentation

contr le optimal de trajectoires locomotrices humaines
SMART_READER_LITE
LIVE PREVIEW

Contrle optimal de trajectoires locomotrices humaines Quang-Cuong - - PowerPoint PPT Presentation

Contrle optimal de trajectoires locomotrices humaines Quang-Cuong Pham 21 janvier 2010 Laboratoire de Physiologie de la Perception et de lAction Collge de France, Paris, France Context Stereotypy of locomotor trajectories Deterministic


slide-1
SLIDE 1

Contrôle optimal de trajectoires locomotrices humaines

Quang-Cuong Pham 21 janvier 2010 Laboratoire de Physiologie de la Perception et de l’Action Collège de France, Paris, France

slide-2
SLIDE 2

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Outline

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control Stochastic optimal control models Conclusions

1 / 41

slide-3
SLIDE 3

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Outline

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control Stochastic optimal control models Conclusions

1 / 41

slide-4
SLIDE 4

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Redundancy in the control of locomotion

Locomotor path Foot positions Starting position Target

Sequence of foot positions (path + velocity profile) Whole−body path

Task Whole−body trajectory

Neural commands 2 / 41

slide-5
SLIDE 5

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Redundancy in the control of arm movements

Hand path Joint angle Target Starting position

Task Hand trajectory

(path + velocity profile)

Muscle activations Hand path Neural commands Joint angles kinematics

Jordan and Wolpert, in The Cognitive Neuroscience, 1999 3 / 41

slide-6
SLIDE 6

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Spatial control of arm movements

Straight hand paths

Morasso, Exp Brain Res, 1981

Bell-shaped velocity profiles

Atkeson and Hollerbach, J Neurosci, 1985

◮ Stereotypy observed only for hand trajectories in Cartesian coordinates ◮ Control in terms of Cartesian coordinates of the hand, not in terms of e.g. joint

angles or muscle activity

4 / 41

slide-7
SLIDE 7

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Optimal control of arm movements

◮ Humans may select the hand trajectories that minimize a certain cost ◮ One popular model is the minimum jerk model developped by Flash and Hogan

Flash and Hogan, J Neurosci, 1985

min

x,y

Z 1 „d3x dt3 «2 + „d3y dt3 «2! dt Typical features:

◮ Straight, smooth, hand paths ◮ Bell-shaped velocity profiles ◮ Inverse relationship between

velocity and curvature (via-points)

5 / 41

slide-8
SLIDE 8

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Questions

◮ Is human locomotion controlled at the level of whole-body trajectories? ◮ Are locomotor trajectories optimal? According to what criteria? ◮ What mechanisms underly the formation of locomotor trajectories?

6 / 41

slide-9
SLIDE 9

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Outline

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control Stochastic optimal control models Conclusions

6 / 41

slide-10
SLIDE 10

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

General experimental methods

◮ Motion capture system: infrared cameras + light reflective markers ◮ Body position defined by shoulders’ midpoint

Light-reflective marker Shoulders' midpoint Locomotor trajectory 7 / 41

slide-11
SLIDE 11

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Average trajectories and variabilities

◮ Time rescaling so that t0 = 0 and t1 = 1 ◮ Definition of average trajectories and variabilities

trajectory deviation Instantaneous trajectory Sample trajectory Average velocity deviation Instantaneous velocity profile Average Sample velocity profile

8 / 41

slide-12
SLIDE 12

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Experiment 1: stereotypy of locomotor trajectories

◮ Reminder: control of arm movements in terms of Cartesian coordinates

  • f the hand

◮ What is planned and controlled in goal-oriented locomotion?

◮ Step-level: plan and execute sequences of precise foot positions (FP),

resulting in a whole-body trajectory

◮ Trajectory-level: plan a whole-body trajectory (in Cartesian space) and

implement it by appropriate sequences of foot positions

◮ Variability of the sequences of FP versus variability of whole-body

trajectories

9 / 41

slide-13
SLIDE 13

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Experiment 1: methods

◮ Protocol: walking towards and through a distant doorway (Arechavaleta et al, 2006) ◮ Constraints on Initial and final positions and walking directions ◮ 40 targets (a target = position × orientation) ◮ 6 subjects × 40 targets × 3 repetitions = 720 trajectories

Starting position and orientation 7 6 5 4 3 2 Y axis (in meters) 1 −1 −3 −2 −1 1 2 3 10 / 41

slide-14
SLIDE 14

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Experiment 1: results (trajectory stereotypy)

Straight Medium curvature Low curvature High curvature

0.5 1 1 0.5 1 1 1 0.5 1 1 0.5 1 1m 1m 1m 1m

Geometric paths Normalized velocity profiles Scaled time

ST LC MC HC

Categories

0.05 0.1 0.15 0.2 Max Traj Deviation (in m) ST LC MC HC

Categories

0.02 0.04 0.06 0.08 0.1

Max Norm Velo Deviation

Hicheur, Pham et al, Eur J Neurosci, 2007

Even for HC, maximum variability was ≤ 17cm

11 / 41

slide-15
SLIDE 15

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Experiment 1: results (foot positions variability)

1 2 3 4 5 6 7 1 1 2 3 4 5 6 7

  • 3
  • 2
  • 1

1 2 3

Rig ht Ste p Lef t St ep

ST LC MC HC Category 5 10 15 20 25 30 35 40 45 Traj and Step Deviations (in %) Trajectory Deviation Step Deviation

◮ variability of the sequences of FP

(≥20% of step length)

◮ variability of whole-body

trajectories (≤5% of trajectory length)

12 / 41

slide-16
SLIDE 16

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Experiment 1: conclusions

◮ Goal-oriented locomotion is not planned and controlled as a sequence of

precise “foot pointings”

◮ Rather, it is likely planned and controlled at the level of whole-body

trajectories

◮ This is reminiscent of the concept of spatial control of hand movements

(Morasso, Exp Brain Res, 1981)

13 / 41

slide-17
SLIDE 17

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Outline

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control Stochastic optimal control models Conclusions

13 / 41

slide-18
SLIDE 18

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Context

◮ Reminder: minimum jerk model for hand trajectories ◮ Common features of hand and locomotor trajectories:

◮ smoothness ◮ straightness for locomotor “reaching” ◮ inverse relationship between velocity and curvature

◮ Can the minimum jerk model also simulate locomotor trajectories?

14 / 41

slide-19
SLIDE 19

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Minimum Square Derivative models

◮ Minimize

min

x,y

Z 1 „dnx dtn «2 + „dnt dtn «2 dt for n = 1, 2, 3, 4 (min velocity, min acceleration, min jerk, mini snap)

◮ subject to the constraints (initial and final conditions)

x(0) = x0, x(1) = x1 y(0) = y0, y(1) = y1 ˙ x(0) = v x

0 ,

˙ y(0) = v y ˙ x(1) = v x

1 ,

˙ y(1) = v y

1

¨ x(0) = ax

0,

¨ y(0) = ay ¨ x(1) = ax

1,

¨ y(1) = ay

1

where the x0, x1, y0, v x

0 ,. . . are extracted from the experimental data

◮ For n = 3 (min jerk), the optimal trajectory is made of 5th-order polynomials

x(t) = c5x5 + c4x4 + c3x3 + c2x2 + c1x + c0 y(t) = d5y 5 + d4y 4 + d3y 3 + d2y 2 + d1y + d0

15 / 41

slide-20
SLIDE 20

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Results: minimum velocity and minimum acceleration

Minimum velocity

Scaled time 0.5 1 1 Normalized velocity Normalized velocity 1 0.5 Scaled time 1 1m 1m Simulated Actual

Minimum acceleration

1 Scaled time 0.5 1 Normalized velocity Normalized velocity 0.5 Scaled time 1 1m 1m 1

Pham et al, Eur J Neurosci, 2007

⇒ These models cannot simulate trajectories with large curvature

16 / 41

slide-21
SLIDE 21

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Results: minimum jerk and minimum snap

Minimum jerk

1m 1m Scaled time 0.5 1 Normalized velocity 1 Normalized velocity 1 Scaled time 0.5 1 Simulated Actual

Minimum snap

1m 0.5 Scaled time 1 1m Normalized velocity Normalized velocity 1 0.5 1 1 Scaled time

Pham et al, Eur J Neurosci, 2007

⇒ Good simulations for all categories: the simulated trajectory always lie within the variance ellipses

17 / 41

slide-22
SLIDE 22

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Results: quantitative comparisons

Max trajectory simulation error

Straight Low curv Medium curv High curv Category 0.2 0.4 0.6 0.8 1 Trajectory error in m MTD MTEv MTEa MTEj MTEs

Max velocity profile simulation error

Straight Low curv Medium curv High curv Category

0.1 0.2 0.3 0.4

Normalized velocity error MnVD MnVEv MnVEa MnVEj MnVEs

Pham et al, Eur J Neurosci, 2007

◮ Simulation error ≤13cm for min jerk and min snap, that is ≤4% of

trajectory length

◮ This is also smaller than the experimental variability (5%)

18 / 41

slide-23
SLIDE 23

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Conclusions

◮ The minimum jerk model (and also the minimum snap model) can

accurately predict the average locomotor trajectories

◮ The formation of hand and locomotor trajectories thus may obey the

same organizing principles

◮ This strengthens the “motor equivalence principle” hypothesis: “at the

higher levels of the motor system, there may exist kinematic representations of movements that are independent of the nature of the actual effector” (Bernstein, The co-ordination and regulation of movement, 1967)

19 / 41

slide-24
SLIDE 24

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control

Outline

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control Stochastic optimal control models Conclusions

19 / 41

slide-25
SLIDE 25

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control

Main assumption

Two main issues (indicated by the question marks in the classical diagram)

◮ Existence of online feedback control in visual and nonvisual

locomotion?

◮ Nature of the online feedback control?

Goal Goal

?

Open−loop process Online feedback

Optimal feedback control Trajectory tracking / ?

module Sensory feedback (visual, vestibular, proprioceptive...) Movement 20 / 41

slide-26
SLIDE 26

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control

Outline

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control Stochastic optimal control models Conclusions

20 / 41

slide-27
SLIDE 27

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control

Problem statement

How vision affects the average trajectories?

21 / 41

slide-28
SLIDE 28

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control

Experiment 2: methods

◮ Protocol: same as in Exp 1 with the door replaced by an arrow ◮ 2 conditions: Visual (V) vs Nonvisual(N) ◮ 14 subjects × 2 conditions × 11 targets × 3 repetitions

1m 5 4 1 2 3

S N E W

  • Starting

position

22 / 41

slide-29
SLIDE 29

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control

Experiment 2: results

Visual (V) vs Nonvisual (N)

◮ Small differences in average trajectories (Distance between the two

trajectories ≤ 30cm on average)

◮ Large differences in variability profiles (31cm for V vs 74cm for N)

Average traj and var ellipses (VF) Average traj and var ellipses (NF) Traj var profile (VF) Traj var profile (NF) Average velocity profile and variability (VF) Average velocity profile and variability (NF)

1 1m 00 1 0.9 5m 3m

1N 2N 3N 4N 5N 4E 5E 4W 5W 4S 5S Targets 0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 Max Traj Deviation/Separation (in m) Max Traj Deviation (VF) Max Traj Deviation (NF) Max Traj Separation (VF/NF)

Pham and Hicheur, J Neurophysiol, 2009 23 / 41

slide-30
SLIDE 30

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control

Experiment 2: conclusions

◮ Vision does not affect the average trajectories

⇒ Same open-loop processes governing visual and nonvisual locomotion

◮ Vision affects the variability profiles

⇒ Existence of vision-dependent feedback processes

24 / 41

slide-31
SLIDE 31

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control

Outline

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control Stochastic optimal control models Conclusions

24 / 41

slide-32
SLIDE 32

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control

Problem statement

◮ Reminder: vision does not affect average trajectories

5m 3m

◮ How vision affects the variability profiles? ◮ Variability profiles in conditions V vs N

25 / 41

slide-33
SLIDE 33

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control

Experiment 3: methods

◮ Same protocol as in Exp 2 ◮ 5 subjects × 2 conditions (V/N)

× 5 targets × 8 repetitions

◮ Straight targets: 1, 2 ; Angled

targets: 3, 4 , 5

◮ Intra-subject analysis 1m 1 2 5 4 3

Starting position

26 / 41

slide-34
SLIDE 34

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control

Experiment 3: results

Variability profiles in conditions V and N

NF

1 1m 1 1m 1

Subject L. H. Subject N. V. VF Target 2 Target 4 Target 5

1m 1 1m 1 1m 1 1m Pham and Hicheur, J Neurophysiol, 2009

◮ Larger variability in N than in V ◮ V: zero variability in straight targets, bump-shape in angled targets ◮ N: linearly increasing in straight targets, non-monotonic in angled targets

27 / 41

slide-35
SLIDE 35

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control

Experiment 3: two-sources hypothesis

Straight (targets 1 and 2) Angled (targets 4 and 5) V 0 + 0 0 + Bump

1m 1 1m 1

N Line + 0 Line + Bump ??

1m 1 1m 1 ◮ Bump: motor-complexity-dependent, vision-independent ◮ Line: motor-complexity-independent, vision-dependent

28 / 41

slide-36
SLIDE 36

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control

Experiment 3: two-sources hypothesis, verification

1m 1 1m 1 1m 1 1m 1 Subject L. H. Subject N. V. Target 4 Target 5 a: VF (angled) NF (angled) Sum (a) + b: NF (straight) (b)

Pham and Hicheur, J Neurophysiol, 2009 29 / 41

slide-37
SLIDE 37

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control

Experiment 3: conclusions

◮ Non-monotonic profiles ⇒ existence of online feedback control ◮ Two-sources hypothesis ⇒ the control mechanism in condition N can

be decomposed into:

◮ a vision-independent component (bump) ◮ a vision-dependent component (line)

◮ Bump-shape profile: interplay between execution noise and feedback

control

30 / 41

slide-38
SLIDE 38

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control

Outline

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control Stochastic optimal control models Conclusions

30 / 41

slide-39
SLIDE 39

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control

Problem statement

What is the nature of the online feedback?

◮ “Desired-trajectory” tracking operates in two steps

  • 1. Compute an optimal trajectory according to some cost
  • 2. Track this trajectory (correct any perturbations back to the desired

trajectory)

◮ Optimal feedback control: no intermediate representation, optimally correct

perturbations with respect to the task

Desired trajectory Feedback correction Feedback correction 31 / 41

slide-40
SLIDE 40

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control

Experiment 5: methods

◮ First session: no via-point ◮ Second session: 1 via-point placed on the average trajectory ◮ Third session: 3 via-points placed on the average trajectory

32 / 41

slide-41
SLIDE 41

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control

Experiment 5: results

No via-point

5m 3m

1 via-point

5m 3m

3 via-points

5m 3m

Variability profiles

Var profile (no via−point) Var profile (3 via−points) Var profile (1 via−point)

0.33 0.2m 0.5 0.67 1

◮ The simple “desired-trajectory” tracking hypothesis can be rejected ◮ However, sequentially tracking multiple “desired-trajectories” remains

possible

◮ Optimal feedback control can naturally explain the variability patterns

  • bserved

33 / 41

slide-42
SLIDE 42

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Outline

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control Stochastic optimal control models Conclusions

33 / 41

slide-43
SLIDE 43

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Context

◮ Deterministic models cannot explain variability profiles ◮ Here: stochastic models, more precisely some simplified optimal

feedback control models (Hoff and Arbib, J Mot Behav, 1993; Todorov and Jordan, Nat Neurosci, 2002)

◮ Clarify the relationship between the control mechanisms in visual and

nonvisual locomotion

34 / 41

slide-44
SLIDE 44

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Visual condition: description of the model

Basic idea of optimal feedback control: “goal-directed corrections”

  • 1. Discretize the movement into n

steps

  • 2. At step i, compute first a

minimimum jerk trajectory

  • 3. Add some “signal-dependent”

random perturbations to the provisional state s′(i + 1)

  • 4. Smoothly interpolate a new

trajectory between the previous state s(i) and the new perturbed state s(i + 1)

s(i) s(i+1) s’(i+1) Initially planned trajectory Target Re−planned trajectory Random perturbation

35 / 41

slide-45
SLIDE 45

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Visual condition: results

1m 0.8m 0.8m 00 1 00 1 Target 2 Online feedback control Actual var profile (actual) Target 5 Target 5 (simulated) Target 5 Pham and Hicheur, J Neurophysiol, 2009

⇒ This model can simulate both the trajectories and the variability profiles:

◮ almost zero in “straight” targets ◮ bump-shaped in “angled” targets

36 / 41

slide-46
SLIDE 46

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Nonvisual condition: online feedback model

◮ “Two-sources” hypothesis ◮ The first component can be

simulated by the same algorithm as in condition VI

◮ The second component is related

to state estimation and can be rendered by perturbing the target (can be discussed later)

Initially planned trajectory Re−planned trajectory Random perturbation s(i) s(i+1) Target (i) s’(i+1) Target (i+1)

37 / 41

slide-47
SLIDE 47

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Nonvisual condition: results

1m 0.8m 0.8m 1 00 1 Target 2 Target 5 Open−loop, noisy acceleration Open−loop, noisy jerk Online feedback control Actual var profile Open−loop, noisy velocity Target 5 (actual) Target 5 (simulated)

Pham and Hicheur, J Neurophysiol, 2009

⇒ This model can simulate the variability profiles:

◮ linearly increasing in “straight” targets ◮ non-monotonic in “angled” targets

Open-loop models cannot reproduce the non-monotonic behavior

38 / 41

slide-48
SLIDE 48

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Stochastic models: conclusions

◮ Existence of online feedback control in nonvisual locomotion confirmed ◮ Two-sources hypothesis confirmed ◮ In particular: visual and nonvisual locomotion not only share the same

  • pen-loop processes but also the same feedback processes

◮ In nonvisual locomotion, same control mechanisms as in visual, but with

respect to a corrupted target position

39 / 41

slide-49
SLIDE 49

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Outline

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Influence of vision on the average trajectories Influence of vision on the variability profiles “Desired-trajectory” versus optimal feedback control Stochastic optimal control models Conclusions

39 / 41

slide-50
SLIDE 50

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Summary of the results

◮ Locomotor trajectories are stereotyped. Goal-oriented locomotion is

likely planned and controlled at the level of whole-body trajectories in space

◮ Locomotor trajectories are planned and controlled at a high cognitive

level and, to some extent, independently of the sensory and motor conditions of locomotion

◮ Similar principles seem to underlie the formation of locomotor and hand

trajectories

◮ A combination of optimal open-loop and feedback processes governs the

formation of locomotor trajectories. The open-loop process is likely based on minimum jerk principle, the feedback process on optimal feedback control

40 / 41

slide-51
SLIDE 51

Context Stereotypy of locomotor trajectories Deterministic optimal control models Control mechanisms underlying the formation of trajectories Stochastic optimal control models Conclusions

Relations with humanoid robotics?

◮ Les principes de contrôle des trajectoires locomotrices humaines

(contrôle au niveau de la trajectoire, minimum-jerk, optimal feedback) peuvent-ils s’appliquer pour les robots humanoides?

◮ Quel serait l’intérêt?

◮ Robots plus efficients? ◮ Robots plus socialement acceptable? 41 / 41