Computer Graphics and Applicationsjain/cse591-18/ftp/ju591.pdf · Graphics Courses @ WU • CSE...
Transcript of Computer Graphics and Applicationsjain/cse591-18/ftp/ju591.pdf · Graphics Courses @ WU • CSE...
![Page 1: Computer Graphics and Applicationsjain/cse591-18/ftp/ju591.pdf · Graphics Courses @ WU • CSE 452: Computer Graphics – Basics in image processing, modeling and rendering – Prerequisite:](https://reader035.fdocuments.us/reader035/viewer/2022063011/5fc4cbf23e3ad4479b735ff0/html5/thumbnails/1.jpg)
Computer Graphics and Applications
Tao Ju
Dept. of Computer Science and Engineering
Washington University in St. Louis
![Page 2: Computer Graphics and Applicationsjain/cse591-18/ftp/ju591.pdf · Graphics Courses @ WU • CSE 452: Computer Graphics – Basics in image processing, modeling and rendering – Prerequisite:](https://reader035.fdocuments.us/reader035/viewer/2022063011/5fc4cbf23e3ad4479b735ff0/html5/thumbnails/2.jpg)
What is Computer Graphics?
• Modeling
• Rendering
• Animation
• Simulation
• Interaction
![Page 3: Computer Graphics and Applicationsjain/cse591-18/ftp/ju591.pdf · Graphics Courses @ WU • CSE 452: Computer Graphics – Basics in image processing, modeling and rendering – Prerequisite:](https://reader035.fdocuments.us/reader035/viewer/2022063011/5fc4cbf23e3ad4479b735ff0/html5/thumbnails/3.jpg)
Where is it used?
• Entertainment
• Industrial design
• Cultural heritage
• Education
• Bio-medicine
• …
“Avatar” “Starcraft” “Storytelling Alice”
Car design Interior design Visualization
Virtual surgery “Rome Reborn”
![Page 4: Computer Graphics and Applicationsjain/cse591-18/ftp/ju591.pdf · Graphics Courses @ WU • CSE 452: Computer Graphics – Basics in image processing, modeling and rendering – Prerequisite:](https://reader035.fdocuments.us/reader035/viewer/2022063011/5fc4cbf23e3ad4479b735ff0/html5/thumbnails/4.jpg)
Modeling
From point cloud
From 3D volumes (e.g., MRI/CT) From cross-sections
• Modeling from real-world data
From curve networks
![Page 5: Computer Graphics and Applicationsjain/cse591-18/ftp/ju591.pdf · Graphics Courses @ WU • CSE 452: Computer Graphics – Basics in image processing, modeling and rendering – Prerequisite:](https://reader035.fdocuments.us/reader035/viewer/2022063011/5fc4cbf23e3ad4479b735ff0/html5/thumbnails/5.jpg)
Modeling • Shape analysis
Feature matching
Segmentation
Feature curve extraction
Skeletonization
![Page 7: Computer Graphics and Applicationsjain/cse591-18/ftp/ju591.pdf · Graphics Courses @ WU • CSE 452: Computer Graphics – Basics in image processing, modeling and rendering – Prerequisite:](https://reader035.fdocuments.us/reader035/viewer/2022063011/5fc4cbf23e3ad4479b735ff0/html5/thumbnails/7.jpg)
Modeling
• Interactive shape analysis
![Page 10: Computer Graphics and Applicationsjain/cse591-18/ftp/ju591.pdf · Graphics Courses @ WU • CSE 452: Computer Graphics – Basics in image processing, modeling and rendering – Prerequisite:](https://reader035.fdocuments.us/reader035/viewer/2022063011/5fc4cbf23e3ad4479b735ff0/html5/thumbnails/10.jpg)
Animation
• 3D cage-based character animation
Model at a resting pose and its cage (black lines) Moving the cage deforms the model
![Page 12: Computer Graphics and Applicationsjain/cse591-18/ftp/ju591.pdf · Graphics Courses @ WU • CSE 452: Computer Graphics – Basics in image processing, modeling and rendering – Prerequisite:](https://reader035.fdocuments.us/reader035/viewer/2022063011/5fc4cbf23e3ad4479b735ff0/html5/thumbnails/12.jpg)
Bio App: Structural Biology
• Study of 3D protein structures
– Protein: a sequence of amino acids folded into a unique 3D shape
• One protein may exhibit different shapes in different environments
– Protein function derived from its structure
• Key to understanding biological processes and developing drugs
…
![Page 13: Computer Graphics and Applicationsjain/cse591-18/ftp/ju591.pdf · Graphics Courses @ WU • CSE 452: Computer Graphics – Basics in image processing, modeling and rendering – Prerequisite:](https://reader035.fdocuments.us/reader035/viewer/2022063011/5fc4cbf23e3ad4479b735ff0/html5/thumbnails/13.jpg)
Bio App: Structural Biology
• Cryo-EM imaging of large protein complexes (e.g., virus)
3D image of a virus A single protein Molecular Structure
? Challenge: building protein structures from low-resolution images
![Page 14: Computer Graphics and Applicationsjain/cse591-18/ftp/ju591.pdf · Graphics Courses @ WU • CSE 452: Computer Graphics – Basics in image processing, modeling and rendering – Prerequisite:](https://reader035.fdocuments.us/reader035/viewer/2022063011/5fc4cbf23e3ad4479b735ff0/html5/thumbnails/14.jpg)
Bio App: Structural Biology
Cryo-EM Volume Protein Structure
• Using shape analysis
![Page 15: Computer Graphics and Applicationsjain/cse591-18/ftp/ju591.pdf · Graphics Courses @ WU • CSE 452: Computer Graphics – Basics in image processing, modeling and rendering – Prerequisite:](https://reader035.fdocuments.us/reader035/viewer/2022063011/5fc4cbf23e3ad4479b735ff0/html5/thumbnails/15.jpg)
Bio App: Structural Biology
Cryo-EM Volume Coarse Protein Structure
β-sheet
α-helix
Plate
Tube
• Using shape analysis
![Page 16: Computer Graphics and Applicationsjain/cse591-18/ftp/ju591.pdf · Graphics Courses @ WU • CSE 452: Computer Graphics – Basics in image processing, modeling and rendering – Prerequisite:](https://reader035.fdocuments.us/reader035/viewer/2022063011/5fc4cbf23e3ad4479b735ff0/html5/thumbnails/16.jpg)
Bio App: Structural Biology
Cryo-EM Volume Skeleton Coarse Protein Structure
β-sheet
α-helix
Plate
Tube
Surface
Curve
• Using shape analysis
![Page 17: Computer Graphics and Applicationsjain/cse591-18/ftp/ju591.pdf · Graphics Courses @ WU • CSE 452: Computer Graphics – Basics in image processing, modeling and rendering – Prerequisite:](https://reader035.fdocuments.us/reader035/viewer/2022063011/5fc4cbf23e3ad4479b735ff0/html5/thumbnails/17.jpg)
Bio App: Structural Biology
Skeleton Score Helix Score Scored Psuedo-atoms
Located SSE elements
+ =
• Skeleton-based detection of secondary structure elements
![Page 18: Computer Graphics and Applicationsjain/cse591-18/ftp/ju591.pdf · Graphics Courses @ WU • CSE 452: Computer Graphics – Basics in image processing, modeling and rendering – Prerequisite:](https://reader035.fdocuments.us/reader035/viewer/2022063011/5fc4cbf23e3ad4479b735ff0/html5/thumbnails/18.jpg)
• Connectivity among helices based on the skeleton
– Using graph matching with protein primary sequence
– Current work: connectivity among sheets
Cryo-EM skeleton with identified helices
+
Connected helices Protein sequence with helix annotation
+
Bio App: Structural Biology
![Page 19: Computer Graphics and Applicationsjain/cse591-18/ftp/ju591.pdf · Graphics Courses @ WU • CSE 452: Computer Graphics – Basics in image processing, modeling and rendering – Prerequisite:](https://reader035.fdocuments.us/reader035/viewer/2022063011/5fc4cbf23e3ad4479b735ff0/html5/thumbnails/19.jpg)
Bio App: Structural Biology
• Gorgon
– Interactive protein modeling tool for low-resolution density maps
– Co-developed by WashU and Baylor College of Medicine
– 500+ registered users in 40+ countries, 3 training workshops in Houston
http://gorgon.wustl.edu (Google: “Gorgon”)
![Page 20: Computer Graphics and Applicationsjain/cse591-18/ftp/ju591.pdf · Graphics Courses @ WU • CSE 452: Computer Graphics – Basics in image processing, modeling and rendering – Prerequisite:](https://reader035.fdocuments.us/reader035/viewer/2022063011/5fc4cbf23e3ad4479b735ff0/html5/thumbnails/20.jpg)
Bio App: Others
• Neuroscience
– Comparing expression patterns of different genes in the mouse brain using geometric model of the brain
• Radiology
– Monitoring bone shape and density changes using geometric models of the foot bones
![Page 21: Computer Graphics and Applicationsjain/cse591-18/ftp/ju591.pdf · Graphics Courses @ WU • CSE 452: Computer Graphics – Basics in image processing, modeling and rendering – Prerequisite:](https://reader035.fdocuments.us/reader035/viewer/2022063011/5fc4cbf23e3ad4479b735ff0/html5/thumbnails/21.jpg)
Graphics Courses @ WU • CSE 452: Computer Graphics
– Basics in image processing, modeling and rendering
– Prerequisite: 247, 332
• CSE 554: Geometric computing for bio-medicine
– Algorithms in geometric modeling with bio-medical examples
– Prerequisite: 247, 332 (452 recommended)
• CSE 546: Computational Geometry
– Data structure and algorithms for spatial data
– Prerequisite: 247 (347 recommended)