HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1....
Transcript of HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1....
![Page 1: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/1.jpg)
HAPTIC CINEMATOGRAPHY :AUTHORING HAPTIC FEEDBACKFOR MOVIESCreative Haptic Expression : Trends and Tools
April 8th , 2016
Fabien DANIEAUTechnicolor R&[email protected]
![Page 2: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/2.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Content
1. Introduction
2. H-Studio
3. Haptic Cinematography
4. Principles for Haptic Cinematography
5. Conclusion
6. References
2
![Page 3: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/3.jpg)
INTRODUCTION
![Page 4: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/4.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Audiovisual Experience
◮ Evolution of the audiovisual experience◮ Improving the Quality of Experience◮ Focused on images and sound◮ Next step : sense of touch ? (Haptics)
4
![Page 5: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/5.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Haptics and Audiovisuals
◮ Haptics already used in VR◮ Early results on haptics for
AV◮ Haptics
may enrich AV experience[O’Modhrain and Oakley, 2003]
◮ New medium to expresscontent[Magnenat and Bonanni, 2006]
◮ New eld of study :Haptic-AudioVisuals[El Saddik et al., 2011]
Virtual Reality Setup [Cirio et al., 2011]
4D Cinema Setup
ChallengeHow to augment audiovisuals with haptic feedback ?
5
![Page 6: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/6.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Haptics and Audiovisuals
◮ Haptics already used in VR◮ Early results on haptics for
AV◮ Haptics
may enrich AV experience[O’Modhrain and Oakley, 2003]
◮ New medium to expresscontent[Magnenat and Bonanni, 2006]
◮ New eld of study :Haptic-AudioVisuals[El Saddik et al., 2011]
Virtual Reality Setup [Cirio et al., 2011]
4D Cinema Setup
ChallengeHow to augment audiovisuals with haptic feedback ?
5
![Page 7: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/7.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Work ow
◮ Based on architecture for video streaming◮ Three steps
◮ Production◮ Distribution◮ Rendering
Audiovisual
media
Haptic
effects
Capturing
Synthesizing
Automatic
extractionNetwork
Screen &
Speakers
Haptic
devices
Audiovisual
renderer
Haptic
renderer
Automatic
extraction
E
N
C
O
D
E
R
E
N
C
O
D
E
R
D
E
C
O
D
E
R
D
E
C
O
D
E
R
[Danieau et al., 2013]
6
![Page 8: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/8.jpg)
H-STUDIO
![Page 9: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/9.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Overview of the Authoring Tool
8
![Page 10: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/10.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Overview of the Authoring tool
◮ Edition of motion e ects◮ Capture of motion data◮ Manual edition thanks to force-feedback device◮ Automatic extraction of vibration e ects◮ Preview of haptic e ects
9
![Page 11: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/11.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Overview of the Authoring tool
◮ Edition of motion e ects◮ Capture of motion data◮ Manual edition thanks to force-feedback device◮ Automatic extraction of vibration e ects◮ Preview of haptic effects
9
![Page 12: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/12.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Acquisition
◮ Capture device◮ Camera◮ IMU : linear acceleration
◮ Content
10
![Page 13: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/13.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Preview of Haptic E ects
◮ Signal processing◮ Synchro with AV (haptic clap)◮ Low pass ltering◮ Gravity removal
◮ User feedback◮ Realistic movement
11
![Page 14: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/14.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
H-Studio 2
◮ Ported on Android device◮ Use embedded sensors
Edition with touchscreenFull body stimulationMultiple haptic e ects (vibration, temperature, motion, etc.)
[Mollet et al., 2015]
12
![Page 15: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/15.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
H-Studio 2
◮ Ported on Android device◮ Use embedded sensors◮ Edition with touchscreen
Full body stimulationMultiple haptic e ects (vibration, temperature, motion, etc.)
[Mollet et al., 2015] 12
![Page 16: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/16.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
H-Studio 2
◮ Ported on Android device◮ Use embedded sensors◮ Edition with touchscreen◮ Full body stimulation
Multiple haptic e ects (vibration, temperature, motion, etc.)
[Mollet et al., 2015] 12
![Page 17: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/17.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
H-Studio 2
◮ Ported on Android device◮ Use embedded sensors◮ Edition with touchscreen◮ Full body stimulation◮ Multiple haptic e ects (vibration, temperature, motion, etc.)
[Mollet et al., 2015] 12
![Page 18: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/18.jpg)
HAPTIC CINEMATOGRAPHY
![Page 19: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/19.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Haptic Cinematography
◮ How to associate haptic feedback to movies ?
Mainly used with action movies
Physical events : explosions, car chases, gun shots, etc.4D cinemas
Drama, comedy, romantic movies ?
Non-diegetic e ectsMove beyond enhancement of physical events only
14
![Page 20: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/20.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Haptic Cinematography
◮ How to associate haptic feedback to movies ?◮ Mainly used with action movies
◮ Physical events : explosions, car chases, gun shots, etc.◮ 4D cinemas
Drama, comedy, romantic movies ?
Non-diegetic e ectsMove beyond enhancement of physical events only
14
![Page 21: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/21.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Haptic Cinematography
◮ How to associate haptic feedback to movies ?◮ Mainly used with action movies
◮ Physical events : explosions, car chases, gun shots, etc.◮ 4D cinemas
◮ Drama, comedy, romantic movies ?
Non-diegetic e ectsMove beyond enhancement of physical events only
14
![Page 22: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/22.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Haptic Cinematography
◮ How to associate haptic feedback to movies ?◮ Mainly used with action movies
◮ Physical events : explosions, car chases, gun shots, etc.◮ 4D cinemas
◮ Drama, comedy, romantic movies ?
Non-diegetic e ectsMove beyond enhancement of physical events only
14
![Page 23: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/23.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Diegesis : de nition
◮ Non-diegetic e ect◮ E ect whose source is neither visible on the screen nor has
been implied to be present in the action◮ Example : non-diegetic sound
◮ Narrator’s commentary◮ Mood music
15
![Page 24: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/24.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Taxonomy of Haptic E ects
Haptic
Effects
Diegetic
Global
Local
Non-
Diegetic
Camera
Editing
Music
Context
[Danieau et al., 2014]
FocusStudy of cinematographic camera e ects
16
![Page 25: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/25.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Taxonomy of Haptic E ects
Haptic
Effects
Diegetic
Global
Local
Non-
Diegetic
Camera
Editing
Music
Context
[Danieau et al., 2014]
FocusStudy of cinematographic camera e ects
16
![Page 26: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/26.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Cinematographic Camera E ects
◮ Typical cameras e ects◮ Arcing◮ Traveling◮ Tilting◮ Zoom-in◮ Vertigo◮ Crane shot◮ Dutch angle
Two types of haptic feedback
Cinematic direct mappingSemantic haptic metaphor
Proof-of-Concept
7 video sequencesHapSeat
17
![Page 27: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/27.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Cinematographic Camera E ects
◮ Typical cameras e ects◮ Two types of haptic feedback
◮ Cinematic→direct mapping◮ Semantic→haptic metaphor
Proof-of-Concept
7 video sequencesHapSeat
17
![Page 28: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/28.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Cinematographic Camera E ects
◮ Typical cameras e ects
◮ Two types of haptic feedback◮ Cinematic→direct mapping◮ Semantic→haptic metaphor
◮ Proof-of-Concept
◮ 7 video sequences
◮ HapSeat
17
![Page 29: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/29.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Cinematic Model
◮ Follows camera movement◮ Example with Arcing, Tilting and Zoom-in
18
![Page 30: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/30.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Semantic Model
◮ Based on the semantic ofthe Camera E ect
◮ Crane shot→Flying away
◮ Dutch angle→Instability
◮ Arcing→Intensi cation
◮ Traveling→Crab walk
◮ Tilting→Inferiority
◮ Zoom-in→Walk forward
◮ Vertigo→Vertigo
◮ Designed with H-Studio19
![Page 31: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/31.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
User Study
◮ Objective : study of the in uence of the haptic e ects basedon camera motions on the QoE
◮ Hypothesis : New haptic e ects increases QoE◮ Variables
◮ 7 video sequences◮ 4 haptic conditions (cinematic, semantic, random, none)
◮ Measure◮ Pairwise comparison (78 couples)◮ Score computed for each model
◮ 38 participants (x̄ = 36.3, σx = 10.4)
20
![Page 32: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/32.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
User Study
◮ Haptic e ects enhance QoE
◮ Cinematic > Semantic≈ None > Random
◮ Semantic > None◮ Vertigo◮ Arcing◮ Tilting
◮ Discussion◮ Metaphors well
understood◮ Dynamics of haptic
feedback should besimilar to dynamics AVcontent
0
0,2
0,4
0,6
0,8
1
QoE for all sequences
Cinematic Random None Semantic
Score
Crane Shot Dutch Angle Traveling Zoom Vertigo Arcing Tilting0
0,2
0,4
0,6
0,8
1
QoE per sequence
Cinematic Semantic Random None
Sco
re
21
![Page 33: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/33.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Application
22
![Page 34: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/34.jpg)
PRINCIPLES FOR HAPTICCINEMATOGRAPHY
![Page 35: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/35.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Inspiration
◮ Guidelines for designing haptic e ects ?◮ Inspired from Disney’s 12 principles of animation
◮ realistic animations◮ law of physics, emotional timing, character appeal, etc.
[Thomas and Johnston, 1995] 24
![Page 36: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/36.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Principles for haptic cinematography ?
◮ Lot of tests, demonstrations, discussion with professionals◮ Work with student in cinematography◮ H-Studio◮ Blender Foundation Movies
9 Principles for the Haptic Cinematography [Guillotel et al., 2016]
25
![Page 37: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/37.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Principles for haptic cinematography ?
◮ Lot of tests, demonstrations, discussion with professionals◮ Work with student in cinematography◮ H-Studio◮ Blender Foundation Movies
9 Principles for the Haptic Cinematography [Guillotel et al., 2016]
25
![Page 38: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/38.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Principles for haptic cinematography ?
◮ Lot of tests, demonstrations, discussion with professionals◮ Work with student in cinematography◮ H-Studio◮ Blender Foundation Movies
9 Principles for the Haptic Cinematography [Guillotel et al., 2016]
25
![Page 39: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/39.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
9 Principles
1. Staging2. Continuity3. Realism4. Perception5. Anticipation6. Exaggeration7. Synchronism8. Kinetic Interpolation9. Diegesis
26
![Page 40: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/40.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
9 Principles
1. Staging
2. Continuity3. Realism4. Perception5. Anticipation6. Exaggeration7. Synchronism8. Kinetic Interpolation9. Diegesis
26
![Page 41: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/41.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
9 Principles
1. Staging2. Continuity
3. Realism4. Perception5. Anticipation6. Exaggeration7. Synchronism8. Kinetic Interpolation9. Diegesis
26
![Page 42: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/42.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
9 Principles
1. Staging2. Continuity3. Realism
4. Perception5. Anticipation6. Exaggeration7. Synchronism8. Kinetic Interpolation9. Diegesis
26
![Page 43: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/43.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
9 Principles
1. Staging2. Continuity3. Realism4. Perception
5. Anticipation6. Exaggeration7. Synchronism8. Kinetic Interpolation9. Diegesis
26
![Page 44: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/44.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
9 Principles
1. Staging2. Continuity3. Realism4. Perception5. Anticipation
6. Exaggeration7. Synchronism8. Kinetic Interpolation9. Diegesis
26
![Page 45: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/45.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
9 Principles
1. Staging2. Continuity3. Realism4. Perception5. Anticipation6. Exaggeration
7. Synchronism8. Kinetic Interpolation9. Diegesis
26
![Page 46: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/46.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
9 Principles
1. Staging2. Continuity3. Realism4. Perception5. Anticipation6. Exaggeration7. Synchronism
8. Kinetic Interpolation9. Diegesis
26
![Page 47: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/47.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
9 Principles
1. Staging2. Continuity3. Realism4. Perception5. Anticipation6. Exaggeration7. Synchronism8. Kinetic Interpolation
9. Diegesis26
![Page 48: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/48.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
9 Principles
1. Staging2. Continuity3. Realism4. Perception5. Anticipation6. Exaggeration7. Synchronism8. Kinetic Interpolation9. Diegesis
26
![Page 49: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/49.jpg)
CONCLUSION
![Page 50: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/50.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Conclusion
◮ Haptics→strong potential for enhancing AV◮ Authoring tool : H-Studio
◮ Capture◮ Manual edition◮ Preview with force-feedback device◮ Full body
◮ Haptic Cinematography◮ Taxonomy of haptic e ects◮ 9 principles
28
![Page 51: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/51.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
Thanks ! Questions ?
29
![Page 52: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/52.jpg)
REFERENCES
![Page 53: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/53.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
References I
Cirio, G., Marchal, M., Hillaire, S., and Lecuyer, A. (2011).Six degrees-of-freedom haptic interaction with uids.Visualization and Computer Graphics, IEEE Transactions on, 17(11) :1714–1727.Danieau, F., Fleureau, J., Guillotel, P., Mollet, N., Christie, M., and Lecuyer, A.(2014).Toward haptic cinematography : enhancing movie experiences with camera-basedhaptic e ects.MultiMedia, IEEE, 21(2) :11–21.Danieau, F., Lécuyer, A., Guillotel, P., Fleureau, J., Mollet, N., and Christie, M.(2013).Enhancing audiovisual experience with haptic feedback : a survey on HAV.volume 6, pages 193–205.El Saddik, A., Orozco, M., Eid, M., and Cha, J. (2011).Haptic technologies - bringing Touch to multimedia.Springer.Guillotel, P., Danieau, F., Fleureau, J., and Rouxel, I. (2016).Introducing basic principles of haptic cinematography editing.Eurographics Workshop on Intelligent Cinematography and Editing.
31
![Page 54: HAPTIC CINEMATOGRAPHY : AUTHORING HAPTIC ...fdanieau.free.fr/pubs/hs16_small.pdf9Principles 1. Staging 2. Continuity 3. Realism 4. Perception 5. Anticipation 6. Exaggeration 7. Synchronism](https://reader036.fdocuments.us/reader036/viewer/2022062508/604330f6ac6b5b430400c022/html5/thumbnails/54.jpg)
Content Introduction H-Studio Haptic Cinematography Principles for Haptic Cinematography Conclusion References
References II
Magnenat, N. and Bonanni, U. (2006).Haptics in virtual reality and multimedia.IEEE Multimedia, 13(3) :6–11.Mollet, N., Dillon, T., Danieau, F., and Le Clerc, F. (2015).A work ow for next generation immersive content.IBC.O’Modhrain, S. and Oakley, I. (2003).Touch TV : adding feeling to broadcast media.In European Conference on Interactive Television : from Viewers to Actors.Thomas, F. and Johnston, O. (1995).The Illusion of Life : Disney Animation.Hyperion, Disney edition.
32