Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram...

41
Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy’s National Nuclear Security Administration under contract DE-AC04-94AL85000.

Transcript of Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram...

Page 1: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Parallel Visualization

Kenneth Moreland

Sandia National LaboratoriesSandia is a multiprogram laboratory operated by

Sandia Corporation, a Lockheed Martin Company,for the United States Department of Energy’s

National Nuclear Security Administration under contract DE-AC04-94AL85000.

Page 2: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

The Parallel Visualization Pipeline

Read

Isosurface

Reflect

Render

Page 3: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

The Parallel Visualization Pipeline

Read

Isosurface

Reflect

Render

Read

Isosurface

Reflect

Render

Read

Isosurface

Reflect

Render

Read

Isosurface

Reflect

Render

Page 4: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Data Parallel Pipelines

• Duplicate pipelines run independently on different partitions of data.

Page 5: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Data Parallel Pipelines

• Duplicate pipelines run independently on different partitions of data.

Page 6: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Data Parallel Pipelines

• Some operations will work regardless.• Example: Clipping.

Page 7: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Data Parallel Pipelines

• Some operations will work regardless.• Example: Clipping.

Page 8: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Data Parallel Pipelines

• Some operations will work regardless.• Example: Clipping.

Page 9: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Data Parallel Pipelines

• Some operations will have problems.• Example: External Faces

Page 10: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Data Parallel Pipelines

• Some operations will have problems.• Example: External Faces

Page 11: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Data Parallel Pipelines

• Ghost cells can solve most of these problems.

Page 12: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Data Parallel Pipelines

• Ghost cells can solve most of these problems.

Page 13: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Data Partitioning

• Partitions should be load balanced and spatially coherent.

Page 14: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Data Partitioning

• Partitions should be load balanced and spatially coherent.

Page 15: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Data Partitioning

• Partitions should be load balanced and spatially coherent.

Page 16: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Load Balancing/Ghost Cells

• Automatic for Structured Meshes.• Partitioning/ghost cells for unstructured is “manual.”• Use the D3 filter for unstructured

• (Filters → Alphabetical → D3)

Page 17: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Partitioning on Spatial Structure: K-D Tree

Page 18: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

K-D Trees Provide Query Structures

What elements are closest to here?

Page 19: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Reconstructing Connectivity Information

May not be unique.

Neighbor info usually missing.

Page 20: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

The Parallel Visualization Pipeline

Read

Isosurface

Reflect

Render

Read

Isosurface

Reflect

Render

Read

Isosurface

Reflect

Render

Read

Isosurface

Reflect

Render

Page 21: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Parallel Rendering

Page 22: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Parallel Rendering

Page 23: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Tiled Displays

Page 24: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Rendering Translucent Geometry

Page 25: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Unstructured Volume Rendering in Parallel

Page 26: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Unstructured Volume Rendering in Parallel

Page 27: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Unstructured Volume Rendering in Parallel

Page 28: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Unstructured Volume Rendering in Parallel

Page 29: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Unstructured Volume Rendering in Parallel

Page 30: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Mesh Partitioning

Page 31: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

K-D Trees Provide Query Structures

What is the visibility order of the regions from this viewpoint? 1

2 3

4

5 6

7

8

Page 32: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

ParaView Architecture for Interactive Remote Parallel Visualization

• Three Tier• Data Server• Render Server• Client

Page 33: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Standalone

Client

DataServer

RenderServer

Page 34: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Client-Server

ClientData

ServerRenderServer

Socket

Page 35: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Client-Render Server-Data Server

ClientData

ServerRenderServer

Socket

Socket × N

Page 36: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Client-Server

ClientData

ServerRenderServer

Socket

Minimize CommunicationRender Remotely

Send Images

Page 37: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Rendering Modes

• Still Render• Full detail render.

• Interactive Render• Sacrifices detail for speed.• Provides quick rendering rate.• Used when interacting with 3D view.

Page 38: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Level of Detail (LOD)

• Geometric decimation.• Used only with Interactive Render

Original Data Divisions: 50x50x50 Divisions: 10x10x10

Page 39: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Image Size LOD

• ParaView’s parallel rendering overhead proportional to image size.• To speed up interactive rendering, ParaView can render smaller sized images and

inflate them.

Original Data Subsample Rate: 2 pixels Subsample Rate: 4 pixels Subsample Rate: 8 pixels

Page 40: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Color Depth LOD

• Squirt is used to transfer images from server to client.• Squirt is a run length encoder optimized for images.• Run lengths improved by masking out some color bits.

24-bit mask 19-bit mask 10-bit mask

Page 41: Parallel Visualization Kenneth Moreland Sandia National Laboratories Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin.

Summary

• Most visualization algorithms are embarrassingly parallel.• Ghost cells can eliminate need for communication.

• Simulation dumps are often missing connectivity information.• Geometry sizes grow quickly, image sizes don’t.

• Sort-last rendering scales well in this regard.• Avoid bottlenecks caused by saturating any process with geometry.

• Remote interactivity is important.• Parallel resources are seldom local.

• Interactivity can be maintained with levels of detail.• Always be clear what you are using.• Make sure the full detail shows up eventually.