360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I...

57
360 VIDEO

Transcript of 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I...

Page 1: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

360 VIDEO

Page 2: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

ABOUT ME

Hugh "Smokey" Dyar IV▸ 2nd Year Graduate Student in Emerging Media

▸ Freelance Photographer▸ Thesis on 360 video editing and cinemetography

▸ I Study The Craft Of Storytelling

Page 3: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

What I have learned about 360 filmmaking.

Page 4: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

So far.

Page 5: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

THIS PRESENTATION1. What is it?2. Concepts3. Structure

4. Tricks and Tips

Page 6: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

360 VIDEOWHAT IS IT?

Page 7: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

WHAT IS IT?

▸ It's video.▸ Rotation not position, inside of a sphere

▸ Viewer-controlled frame▸ Equirectangular projected 2:1 video

Page 8: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.
Page 9: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

WHAT IS IT?

HARDWARE LIMITATIONS▸ Spacial, stereo, or mono audio...?▸ Fixed focus, fixed "zoom".▸ Stitching errors

▸ Annoying to edit, no seamless workflow.▸ Limited Resolution

Page 10: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

HOW DO WE EXPERIENCE IT?

▸ Google Cardboard▸ Ipad/phone at arms length

▸ HMD's▸ Web Viewers▸ WebVR

▸ Youtube/Facebook

Page 11: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.
Page 12: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

PLATFORM CONSIDERATIONS

▸ Limited Depth Cues▸ Audio is a Hot Mess

▸ Goldilocks shooting distance.

Page 13: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

CONCEPTS

Page 14: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

EDITING IS HARD!▸ Did the viewer see what matters?▸ Is the viewer confused?

▸ Do they understand how they should behave?▸ How to prevent a jarring cut

Page 15: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

POINTS OF INTEREST (POI)▸ A point of interest is any point in a frame that a user may be likely to

look at, for whatever reason.▸ Visual Weight

▸ Narrative Significance▸ Tension

Page 16: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

IN FOCUS THINGS. BIG THINGS. COLORFUL/SATURATED THINGS. BRIGHT THINGS. THINGS CLOSER TO THE CAMERA. CONTRASTY THINGS. THINGS ON A PATH OF LEADING LINES. THINGS THAT ARE MOVING, OR

SUGGESTING MOTION. EYES ARE LOOKING AT IT. PEOPLE. FACES. THINGS WITH EYES. THINGS THAT ARE SPEAKING. THINGS THAT ARE MOVING, OR ONE THING MOVING TOWARDS THE CAMERA, OR ANYTHING BREAKING

A PATTERN OF MOTION (I.E. STATIC PERSON IN A SEA OF COMMUTERS). THINGS THAT WE EMPATHIZE WITH/CARE ABOUT (I.E. THE MAIN CHARACTER). THINGS THAT INTRIGUE US OR MAKE US CURIOUS. (I.E. A LOCKED TOY

CHEST THAT A CHILD SEEMS DEATHLY AFRAID OF WHAT’S INSIDE, WHILE A PARENT INSISTS EVERYTHING IS FINE). THINGS THAT MAKE NOISE. THINGS THAT ARE ABOUT TO CHANGE OR REVEAL SOMETHING. THE DIRECTION

THE CAMERA IS MOVING (EVEN AS PASSENGERS, WE DON’T SIT IN CARS FACING SIDEWAYS; WE LIKE TO LOOK WHERE WE ARE GOING). THINGS NEW TO THE SCENE. THINGS THAT ARE MAKING NOISE. THINGS THAT ARE ABOUT TO DO SOMETHING (ANTICIPATION; A BATTER WOUND UP AND READY TO SWING, A BOMB WITH A

TICKING NOISE). THINGS THAT ACTORS ARE LOOKING AT OR PAYING ATTENTION TO, OR HAVE SOME KIND OF ESTABLISHED RELATIONSHIP WITH. THINGS THAT ACTORS AREN’T PAYING ATTENTION TO (BUT SHOULD BE/STILL HAVE SOME KIND OF RELATIONSHIP. LIKE A HORROR MOVIE VILLAIN CREEPING AROUND A CORNER).

THINGS THAT TRY TO HIDE FROM US (THE VIEWER CAN “ACCEPTS A CHALLENGE” AND GO HUNTING FOR THE THING). THINGS WITH GIANT FLASHING ARROWS POINTED AT IT. THINGS THAT ARE LITERALLY ON FIRE.

Page 17: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

Points of... interest.

Page 18: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

TYPES OF SHOTS.

▸ Undirected▸ Directed

Page 19: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

UNDIRECTED

Page 20: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.
Page 21: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

DIRECTED

Page 22: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.
Page 23: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

MOTIVATIONS TO EDIT

▸ Jump time▸ Move around a space▸ Change location▸ Show importance▸ Switch linear stories▸ Provide tension

Page 24: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

WHEN POSSIBLE, LET THE AUDIENCE EDIT.

Page 25: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

WHEN TO GIVE UP CONTROL▸ Visual Saturation/Isolation▸ Intentional Searching (find this)▸ Unexpected Discovery (curiosity)▸ Examination/Atmosphere

Page 26: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

STRUCTURE

Page 27: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

What do 360 films look like?

Page 28: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

THE ONERA single video of a story unfolding around the viewer in real time.

Page 29: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

NARRATED ONE TAKEOner with non-diagetic Audio.

Page 30: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

THE VACATION SLIDES STORYSlideshow of video content. Narration provides story. Bulletproof.

Page 31: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.
Page 32: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

THE HERO'S JOURNEYCuts between locations utilizing POI in and out points. Not Bulletproof.

Page 33: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.
Page 34: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

TOTALY DIRECTED STORYEvery shot a directed shot. Lose the gaze, lose the story!

Page 35: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

LETS BACK UP.

Page 36: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.
Page 37: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

A FILM CAN MOVE AROUND THIS SPECTRUM!

Page 38: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

CHALLENGE: GO FROM UNDIRECTED TO DIRECTED.

Page 39: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.
Page 40: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

THE RESET SHOTAny shot that moves an audience from unknown gaze to known gaze.

Page 41: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

SO WHAT DO 360 FILMS LOOK LIKE?

Page 42: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.
Page 43: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

TRICKS AND TIPS

Page 44: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

YOU CAN TELL MORE THAN ONE STORY.

...do but don't. ▸ Allow for details that not everybody catches that help the story.

Page 45: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

AUDIO IS YOUR FRIEND

▸ You know the user is listening. ▸ Voice overs can be very effective.

▸ Audio and video don't really need to match.

Page 46: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

OFFSET

Page 47: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

METADATA

"Youtube 360 Video Metadata Tool"

Page 48: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

PREMIERE VIEWPORT SETTINGS

Page 49: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

DONT FORGET MINIMUM CAMERA DISTANCE

Page 50: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

DON'T FORGET MAXIMUM CAMERA DISTANCE

Page 51: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

DISTANCE MATTERS. MAYBE THE MOST?

Page 52: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

CAMERA HEIGHT MATTERS

Use photos and photospheres to help you think

Page 53: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

TEST IT IN MULTIPLE PLATFORMS.

Export and upload clips/sections to youtube.

Page 54: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

ITS EASY TO COVER UP THE FLOOR AND CEILING SPHINCTERS

With a logo or just black.

Page 55: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

DON'T BE AFRAID TO COMPOSITE.

Take a "plate" video of the empty room.Then of your actors and sound people. Overlap and mask out things you

don't want.

Page 56: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

DONT BE GIMMICKY.

Tell a story that could exist in other mediums, and tell it WELL in this one.

Page 57: 360 VIDEO - Carnegie Mellon Universityvisualstory.etc.cmu.edu/wp-content/uploads/2010/09/... · I Study The Craft Of Storytelling. What I have learned about 360 filmmaking. So far.

stuckinspheres.com