Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video...
Transcript of Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video...
![Page 1: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f198619c469954b5f2619f6/html5/thumbnails/1.jpg)
From Students…
…to Professionals
The Capstone Experience
Project PlanVideo Sentiment Analysis
Team TechSmithTony CapriglioneDong-Yoon Choi
Alex LambertKyle Seippel
Corey Wisser
Department of Computer Science and EngineeringMichigan State University
Fall 2016
![Page 2: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f198619c469954b5f2619f6/html5/thumbnails/2.jpg)
Functional Specifications
• Creates a way for a video author to see and analyze a viewer’s response without viewer action
• Customizable list of viewers for each video
The Capstone Experience Team TechSmith Project Plan 2
![Page 3: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f198619c469954b5f2619f6/html5/thumbnails/3.jpg)
Functional Specifications
• Allows users to see emotional responses at various points of a video
• Supports rewinding, fast-forwarding, and stopping by the user.
The Capstone Experience Team TechSmith Project Plan 3
![Page 4: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f198619c469954b5f2619f6/html5/thumbnails/4.jpg)
Design Specifications
• Videos are uploaded and assigned to specified viewers through the web application by the video author.
• Viewers will open the desktop app which serves as a custom video player to view videos that are assigned to them.
The Capstone Experience Team TechSmith Project Plan 4
![Page 5: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f198619c469954b5f2619f6/html5/thumbnails/5.jpg)
Design Specifications
• The uploaded video and the webcam recording of the viewer are shown side-by-side with the original video.
• Results from the emotional analysis are displayed below the webcam recording.
The Capstone Experience Team TechSmith Project Plan 5
![Page 6: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f198619c469954b5f2619f6/html5/thumbnails/6.jpg)
Screen Mockup: Custom Video Player
The Capstone Experience Team TechSmith Project Plan 6
John Smith
Video 1 Video 2 Video 3
Video 4 Video 5 Video 6
Video Player – Home
![Page 7: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f198619c469954b5f2619f6/html5/thumbnails/7.jpg)
Screen Mockup: Custom Video Player
The Capstone Experience Team TechSmith Project Plan 7
Home
John SmithVideo Player
![Page 8: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f198619c469954b5f2619f6/html5/thumbnails/8.jpg)
Screen Mockup: Website
The Capstone Experience Team TechSmith Project Plan 8
http://techsmith00.azurewebsites.net/home
Upload Your Video for
Sentimental Analysis
Invite Your Viewers
Email:
Upload
Results Log Off
![Page 9: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f198619c469954b5f2619f6/html5/thumbnails/9.jpg)
Screen Mockup: Website
The Capstone Experience Team TechSmith Project Plan 9
http://techsmith00.azurewebsites.net/results
Home Log Off
Happy: 75%Sad: 5%Angry: 5%Neutral: 15%
![Page 10: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f198619c469954b5f2619f6/html5/thumbnails/10.jpg)
Technical Specifications
• Databases
Videos stored in Azure BLOB
Users and Emotions stored in Azure SQL database
• Authentication
Windows Authentication
The Capstone Experience Team TechSmith Project Plan 10
![Page 11: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f198619c469954b5f2619f6/html5/thumbnails/11.jpg)
Technical Specifications
• The Viewer Client
Universal Windows Program
Designed with C#/XAML
• Video Uploader Client
ASP.NET
Designed with Bootstrap
The Capstone Experience Team TechSmith Project Plan 11
![Page 12: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f198619c469954b5f2619f6/html5/thumbnails/12.jpg)
System Architecture
The Capstone Experience Team TechSmith Project Plan 12
![Page 13: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f198619c469954b5f2619f6/html5/thumbnails/13.jpg)
System Architecture
The Capstone Experience Team TechSmith Project Plan 13
![Page 14: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f198619c469954b5f2619f6/html5/thumbnails/14.jpg)
System Components
• Hardware Platforms
iMacs running Windows 10 in VMware
Windows computers
Built in webcams
The Capstone Experience Team TechSmith Project Plan 14
![Page 15: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f198619c469954b5f2619f6/html5/thumbnails/15.jpg)
System Components
• Software Platforms / Technologies
ASP.NET MVC with an Azure cloud server
C# Universal Windows App
CSS/HTML/JavaScript/Bootstrap
Azure SQL database
Azure BLOB storage
Visual Studio 2015
Microsoft Cognitive Services
The Capstone Experience Team TechSmith Project Plan 15
![Page 16: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f198619c469954b5f2619f6/html5/thumbnails/16.jpg)
Testing
• Unit Test App (Universal Windows)
• Visual Studio Test Suite for .NET
• Database testing using XML
• Functional and iterative testing for all around bug fixing
The Capstone Experience Team TechSmith Project Plan 16
![Page 17: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f198619c469954b5f2619f6/html5/thumbnails/17.jpg)
Risks
• Risk 1 Extracting emotions for a webcam video with
limited API calls
Process webcam footage after video has concluded and make API calls in the C# Desktop App.
• Risk 2 Connect the uploaded video on the web server to
the viewer client
Invite people based on Microsoft Email and have user authenticate in the C# Desktop App.
The Capstone Experience Team TechSmith Project Plan 17
![Page 18: Video Sentiment Analysis - Michigan State University › 2016-08 › schedules › all... · Video Sentiment Analysis Team TechSmith Tony Capriglione Dong-Yoon Choi Alex Lambert Kyle](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f198619c469954b5f2619f6/html5/thumbnails/18.jpg)
Risks
• Risk 3
Dealing with webcam video after pausing and rewinding
Store the entire footage and modify playback of the original video to fit the tempo of the webcam
The Capstone Experience Team TechSmith Project Plan 18