HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is...
Transcript of HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is...
![Page 1: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/1.jpg)
April 4-7, 2016 | Silicon Valley
Thomas J. True, July 25, 2016
HDR PROGRAMMING
![Page 2: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/2.jpg)
2
AGENDA
HDR Overview
Human Perception
Colorspaces
Tone & Gamut Mapping
ACES
HDR Display Pipeline
Best Practices
Final Thoughts
Q & A
![Page 3: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/3.jpg)
3
WHAT IS HIGH DYNAMIC RANGE?
HDR is considered a combination of:
• Bright display: 750 cm/m2 minimum, 1000-10,000 cd/m2 highlights
• Deep blacks: Contrast of 50k:1 or better
• 4K or higher resolution
• Wide color gamutWhat’s a nit?
A measure of light emitted per unit area.
1 nit (nt) = 1 candela / m2
![Page 4: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/4.jpg)
4
BENEFITS OF HDR
Richer colors
Realistic highlights
More contrast and detail in shadows
Reduces / Eliminates clipping and compression issues
HDR isn’t simply about making brighter images
Improved Visuals
![Page 5: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/5.jpg)
5
HUNT EFFECTIncreasing the Luminance Increases the Colorfulness
By increasing luminance it is possible to show highly saturated colors without using highly saturated RGB color primaries
Note: you can easily see the effect but CIE xy values stay the same
![Page 6: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/6.jpg)
6
STEPHEN EFFECTIncreased Spatial Resolution
More visual acuity with increased luminance. Simple experiment – look at book page indoors and then walk with a book into sunlight
![Page 7: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/7.jpg)
7
HOW HDR IS DELIVERED TODAY
High-end professional color grading displays
- Dolby Pulsar (4000 nits), Dolby Maui, SONY X300 (1000 nit OLED)
UHD TVs
- LG, SONY, Samsung… (1000 nits, high contrast, UHD-10, Dolby Vision, etc)
Rec. 2020 UHDTV wide color gamut
SMPTE ST-2084 Dolby Perceptual Quantizer (PQ) Electro-Optical Transfer Function (EOTF)
SMPTE ST-2094 Dynamic metadata specification
![Page 8: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/8.jpg)
8
REAL WORLD VISIBLE LUMINANCE RANGE
7.0 * 1010 cd/m2 Lightning flash3.2 * 109 cd/m2 Sun (zenith)4.3 * 105 cd/m2 Sun (horizon)1.2 * 105 cd/m2 60W incandescent light bulb3.0 * 104 cd/m2 White paper in noon sunlight1.3 * 104 cd/m2 Clear sky (horizon)4.2 * 103 cd/m2 Full moon3.6 * 103 cd/m2 White paper in daylight shade1.3 * 102 cd/m2 White paper under office light1.0 * 102 cd/m2 White of computer monitor or TV1.0 * 102 cd/m2 Wax candle flame1.0 * 102 cd/m2 Clear sky, twilight2.4 * 10-1 cd/m2 Brightest star (Sirius)1.3 * 10-3 cd/m2 Absolute threshold (single flash)4.0 * 10-4 cd/m2 Starless night sky7.5 * 10-7 cd/m2 Absolute threshold (steady light)
Range of 10^17 Luminance Levels
![Page 9: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/9.jpg)
9
REAL WORLD VISIBLE LUMINANCE RANGE
• Limited to 10^5 – 10^6 with a 95% contrast ratio of ~10000:1 (18 stops)
• Example: Full Moonlight – Can see details on the moon surface while simultaneously seeing details in the illuminated ground surface. (4200 cd/m2 to 0.012 cd/m2)
• Dark Adaptation
• Slow, can take up to 30 minutes to see in the dark
• Light Adaptation
• Fast, less that a second to a minute to adapt to bright light
• HDR displays should have a larger 10^7 dynamic range
Human Visual Response
![Page 10: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/10.jpg)
10
COLOR PRECISIONHow do we avoid banding?
7/25/2016
![Page 11: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/11.jpg)
11
0.0001 0.001 0.01 0.1 1 10 100 1000 10000
HUMAN PERCEPTION
Visibility of banding [Barten 1999]
Image luminance (cd/m2)
Contrast Ratio (%)
Banding invisible
Banding visible
![Page 12: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/12.jpg)
12
COLOR PRECISIONsRGB
0.0001 0.001 0.01 0.1 1 10 100 1000 10000
Image luminance (cd/m2)
Contrast Ratio (%)
sRGB 8b/color
sRGB 10b/color
![Page 13: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/13.jpg)
13
COLOR PRECISIONDigital Cinema - 12bit, gamma 2.6, full white = 48 cd/m2
0.0001 0.001 0.01 0.1 1 10 100 1000 10000
Image luminance (cd/m2)
Contrast Ratio (%)
Digital Cinema
![Page 14: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/14.jpg)
14
COLOR PRECISIONSMPTE ST-2084 - A new 12-bit HDR Transmission Standard
0.0001 0.001 0.01 0.1 1 10 100 1000 10000
Image luminance (cd/m2)
Contrast Ratio (%)
ST-2084 12b/color
![Page 15: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/15.jpg)
15
COLOR PRECISIONFP16 - For GPU Rendering
0.0001 0.001 0.01 0.1 1 10 100 1000 10000
Image luminance (cd/m2)
Contrast Ratio (%)
FP16
![Page 16: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/16.jpg)
16
REAL WORLD VISIBLE COLORSPointer’s Gamut of Naturally Occurring Colors
x
y
The CIE 1931 chart defines a coordinate systemfor all possible colors that the human eye can see
[Pointer 1980] the colors of ‘real world’ objects
![Page 17: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/17.jpg)
17
COLORSPACESComparison of Common Colorspaces
sRGB (1996)• Designed around CRT• Same primaries as Rec. 709• 33% of visible colors• 70% of Pointer’s Gamut
AdobeRGB (1998)• Includes printable colors• Same red and blue• Purer green
DCI-P3• Digital cinema projectors
Rec 2020• UHDTV Standard• 60% of visible colors• 99% of Pointer’s Gamut
scRGB (Vista)• [-0.5, 7.5] • (1,1,1) matches sRGB white
![Page 18: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/18.jpg)
18
COLORSPACESImpact on Rendering
Same colors can be represented in the different spaces, but…
• Modulus operations will yield different results based on the color primaries used
• Material * Light is color space dependent
• Purple in one color space will be brown in another
• Issue is orthogonality of primaries in the other color space
• Rendering always implies a set of primaries
• Important to keep colorspace consistent through development
• Transform final result to different colorspace primaries
![Page 19: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/19.jpg)
19
Challenges with Color Primaries
COLORSPACES
* = ? ? ?
sRGB DCI BT.2020
* = ? ? ?
Primaries in a color space are not orthogonal when transformed into another color space. This changes the
results of modulation.
![Page 20: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/20.jpg)
20
SCENE LINEAR VS OUTPUT LINEAR COLOR
Scene Referred (Scene Linear)
• Linear colors as they represent light in the scene
• Photons striking the virtual film
Output Referred (Output Linear or Display Referred)
• Linear colors as they are represented by the display
• Photos emitted by the display
• May have an EOTF applied.
![Page 21: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/21.jpg)
21
TONE MAPPING
Compresses or clips the color data into the output range
Compresses shadows and high lights
Enhances mid-tone contrast
Irreversible, data is lost
Conversion from Scene Referred to Output Referred
![Page 22: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/22.jpg)
22
TONE MAPPING
HDR displays still limited (1000 nit max)
Real world luminance is much higher
• Sun over 1000x more luminous
• 100w bulb over 10x more luminous
Permits differentiation of luminance levels
No one true tone mapper, choice depends on the desired aesthetics
HDR adds complexities that could be ignored in LDR
Why Tone Map for HDR?
![Page 23: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/23.jpg)
23
TONE MAPPING
Scale and clip to [0,1]
Same general problems as in LDR
- Hard clip at the limit of the capabilities of the display
- Sun and light bulb likely to have same luminance on screen
Scene may look dull
Needs to account for the larger luminance range when scaling / clipping
- Otherwise, scene will just get brighter
Linear
![Page 24: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/24.jpg)
24
TONE MAPPING
Classic x/(x+1)
No concept of output brightness
- In HDR, images just get a lot brighter
Example: 0.18 will change from 12-45 nits to 150+ nits
- 0.18 is often considered the color of asphalt after exposure
- Result is a bright road
Limited control
Reinhard
![Page 25: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/25.jpg)
25
TONE MAPPING
Algorithmic operator(similar to Reinhard)
Compressed range using an adaptive log scale
Provides argument for display output luminance
Better adapts to display brightness
Drago
![Page 26: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/26.jpg)
26
TONE MAPPING
S-curve in logarithmic space
Enhances mid-tones
Compresses shadows and highlight
Approximates the behavior of traditional film
Filmic
![Page 27: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/27.jpg)
27
GAMUT MAPPING
Stretching or compressing one color space to fit within another.
Remapping of the chromaticity values
Many different methods to remap the color space (clip, soft clip, scale, etc)
All methods have non-trivial caveats (hue shifts, memory colors, etc)
Mapping of Unrepresentable Colors to Representable Colors
![Page 28: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/28.jpg)
28
ACES
Standard for digital post-production
Driven by the Academy of Motion Pictures
Provides framework for end-to-end processing and preservation of data
Defines reference transforms as part of the framework
Tone mapping for different classes of displays
Open-source and available on GitHub
Reference is written in Color Transform Language
Academy Color Encoding System
![Page 29: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/29.jpg)
29
ACESPipeline Components
Input
Device
Transform
ACEScc
LookModificationTransform
ReferenceRenderingTransform
Output
Device
Transform
F
r
a
m
e
b
u
f
f
e
r
D
i
s
p
l
a
y
IDTConvert to ACEScc
LMTApply Look3D LUT
RRTDevice-IndependentTone Mapping
O
C
E
S
ODTDevice-DependentTone Mapping
Scene Referred / Linear Color Data
![Page 30: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/30.jpg)
30
ACES
Tone mapper is a filmic sigmoid-style-curve
Defined by segmented quadratic spline in reference implementation
Two splines joined at middle gray
Operates per-channel in a wide color space
Results in natural desaturation at the shoulder
Input middle gray is set at 0.18
Tone Mapper
![Page 31: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/31.jpg)
31
ACES
Parameterized ODT developed by NVIDIA
Allows adaptation of the reference transforms to a wider set of uses
Alter output middle gray level
Alter input and output range of tone mapper
Saturation adjustment
Contrast adjustment
Parameterized ACES
![Page 32: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/32.jpg)
32
HDR DISPLAY PIPELINE
1) Create content with sRGB primaries as done today for LDR.
2) Render high-quality HDR using physically-based shading.
3) Post process in the scene referred space
4) Apply color grading to the rendered scene referred image
5) Tone map with a filmic ACES-derived tonemapper
6) Keep backbuffer in FP16 scRGB
7) Composite 8-bit sRGB referenced UI as normal
Practical Path to Utilizing Current UHD Displays
![Page 33: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/33.jpg)
33
HDR DISPLAY PIPELINELogical Pipeline for HDR Output
Linear Scene
RGBA16F
UI sRGB8
Post-
ProcessColor
GradeTone Map
Composite
& Encode
EOTF
Backbuffer
FP16 or RGB10
![Page 34: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/34.jpg)
34
DISPLAYING HDR ON WINDOWS
Create backbuffer as R16G16B16A16_FLOAT/FP16 - Ensures enough color precision
DirectX: Create DXGI_FORMAT_R16G16B16A16_FLOAT swap chain
OpenGL: Specify WGL_PIXEL_TYPE_ARB = WGL_TYPE_RGBA_FLOAT_ARBwith color depth 16 (WGL_RED_BITS_ARB = 16, WGL_GREEN_BITS_ARB = 16, WGL_BLUE_BITS_ARB = 16)
Make window fullscreen exclusive - Prevents OS compositor from destroying data
Query HDR capability from NVAPI
Call NVAPI to send HDR metadata and enable HDR
Output linear tonemapped scene to FP16 scRGB backbuffer in scRGB colorspace
Quick Start Guide
![Page 35: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/35.jpg)
35
DISPLAYING HDR ON WINDOWSUse NVAPI to Enumerate GPUs and Connected Displays
// Enumerate GPUs and connected displays
NvPhysicalGpuHandle *nvGPUHandle = (NvPhysicalGpuHandle *)calloc(NVAPI_MAX_PHYSICAL_GPUS, sizeof(NvPhysicalGpuHandle));;
NvU32 nvGPUCount;NvU32 *nvConnectedDisplayIdCount = (NvU32 *)calloc(NVAPI_MAX_DISPLAYS, sizeof(NvU32));
NV_GPU_DISPLAYIDS **nvConnectedDisplayIds = (NV_GPU_DISPLAYIDS **)calloc(NVAPI_MAX_PHYSICAL_GPUS,
sizeof(NV_GPU_DISPLAYIDS));
if (EnumerateGPUsAndDisplays(nvGPUHandle, &nvGPUCount, nvConnectedDisplayIds,nvConnectedDisplayIdCount) != NVAPI_OK)
{MessageBox(NULL, TEXT("GPU and Display Enumeration Failed."), applicationTitle,
MB_OK | MB_ICONINFORMATION);return 0;
}
![Page 36: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/36.jpg)
36
DISPLAYING HDR ON WINDOWSQuery HDR Capabilities of Each Display from NVAPI
// On each GPU, get the HDR capabilities of each active display.NvU32 gpu = 0;NvU32 display = 0;while (gpu < nvGPUCount){
while (display < nvConnectedDisplayIdCount[gpu]){
NV_HDR_CAPABILITIES hdrCapabilities;if (NvAPI_Disp_GetHdrCapabilities(display, &hdrCapabilities) != NVAPI_OK){
MessageBox(NULL, TEXT("NVAPI GetHdrCapabilities Failed."), applicationTitle, MB_OK | MB_ICONINFORMATION);
return 0;}
// If HDR is supported, breakif (hdrCapabilities.isST2084EotfSupported)
break;
display++;}gpu++
}
![Page 37: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/37.jpg)
37
DISPLAYING HDR ON WINDOWSCall NVAPI To Send HDR Meta Data and Enable HDR
// If HDR is supported, enable itif (hdrCapabilities.isST2084EotfSupported) {
NV_HDR_COLOR_DATA hdrColorData = {};memset(&hdrColorData, 0, sizeof(hdrColorData));
hdrColorData.version = NV_HDR_COLOR_DATA_VER;hdrColorData.cmd = NV_HDR_CMD_SET;hdrColorData.static_metadata_descriptor_id = NV_STATIC_METADATA_TYPE_1;hdrColorData.hdrMode = NV_HDR_MODE_UHDA;
if(NvAPI_Disp_HdrColorControl(display, &hdrColorData) != NVAPI_OK){
MessageBox(NULL, TEXT("NVAPI HdrColorControl Failed."), applicationTitle, MB_OK | MB_ICONINFORMATION);
return 0;}
}
![Page 38: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/38.jpg)
38
DISPLAYING HDR ON LINUX
![Page 39: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/39.jpg)
39
DISPLAYING HDR ON LINUXNot Possible Today Due to Lack of Infrastructure
32-bit XServer prevents color deeper than R10G10B10A2.
No infrastructure for metadata transfer
Will be discussed at XDC 2016 Conference September 21-23 in Helsinki, Finland
![Page 40: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/40.jpg)
40
HDR BEST PRACTICESPhysically-Based Rendering
Makes light interactions more correct / plausible.
- Results in proper highlights, not just a hack that looks good in LDR
Creates values on a scale consistent with the real world
- [0,1] brightness level doesn’t make sense in an HDR world
- Will need to make compromises (FP16 won’t represent the brightest sun)
7/25/2016
![Page 41: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/41.jpg)
41
HDR BEST PRACTICESColorspace
Keep using sRGB primaries.
Keeps consistency with the present art pipeline
- No surprises for artists
- No gamut mapping problems on LDR displays
Will still reap the benefits of brightness and brighter saturated colors
Starting point. Plan to be more aggressive in the future.
7/25/2016
![Page 42: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/42.jpg)
42
HDR BEST PRACTICESGamut Remapping
Stretches rendering done with sRGB primaries to more extreme ones.
- Produces richer / more saturated colors
- May work OK for some applications, not so much for others
Will present challenges with existing artwork
- Unnatural skin tones
- Hue shifting
- Memory color
7/25/2016
![Page 43: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/43.jpg)
43
HDR BEST PRACTICESLuminous Effects
Make things that glow, glow at a level consistent with the light source
- Emissive level and light source should be correlated
Looks odd when a specular high light outshines a light source
7/25/2016
![Page 44: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/44.jpg)
44
HDR BEST PRACTICESScene Referred Post-FX
Perform operations that require linear lighting prior to tone mapping.
- Bloom
- Motion blur
- Depth of field
Operating scene-referred maintains consistency
- Same operation for HDR and LDR
7/25/2016
![Page 45: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/45.jpg)
45
HDR BEST PRACTICESColor Grading
Ideally done in scene-referred space
- Makes operations consistent LDR/HDR
- Avoids tone mapping “fix-ups”
7/25/2016
![Page 46: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/46.jpg)
46
HDR BEST PRACTICESLuminance-Aware Tone Mapping
Many operators designed to work within a generic [0-1] space.
- How bright is 1.0?
- Scaling to a 1000 nit display would display asphalt at 100 nits
Need an operator that understands the output luminance
- Middle gray stays at a reasonable level
- Colors only compressed where they need to be
Use ACES or Drago
7/25/2016
![Page 47: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/47.jpg)
47
HDR BEST PRACTICESUI Compositing
UI typically authored in straight RGB
- Need to composite properly into the color space of the HDR scene
Using scRGB backbuffer provides simple solution
- Same sRGB primaries with (1, 1, 1) as the brightness level for white
- Blending just works.
7/25/2016
![Page 48: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/48.jpg)
48
HDR BEST PRACTICESUI Blending Challenges
UI may look dimmer / duller than intended
- Due to adaptation of the eye to the brighter colors of the HDR display
- Scale up the UI luminance to conteract this
Transparent elements may suffer glow throw effects
- Example: 1000 nit highlight behind a transparent dialog with white text
- Solution: Clip / Apply simple LDR tone map to scene elements underneath
7/25/2016
![Page 49: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/49.jpg)
49
HDR SDKHDR Display Sample Code
Simple app demonstrating ACES tone mappers + HDR display
Allows setting HDR metadata to enable HDR on UHD TVs
Offers standard ACES tone mappers + customized ACES tone mappers
Provides EXR and HDR file format loading to visualize HDR data
Offers exposure scaling and range ‘enhancement’ tools
http://developer.nvidia.com/high-dynamic-range-display-development/
7/25/2016
![Page 50: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/50.jpg)
50
OTHER NOTESRandom Stuff
HDMI 2.0a is required.
- On Quadro GPUs will need an active DP 1.2 -> HDMI 2.0a dongle.
7/25/2016
![Page 51: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/51.jpg)
51
THINGS TO COMESupport for HDR is Evolving
Native OS Support for HDR
• Will remove requirement for full-screen exclusive window
• Include support for HDR10/UDH metadata transmission replacing NVAPI functions.
GPU Hardware support
DP 1.4 metadata support
7/25/2016
![Page 52: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/52.jpg)
52
MORE INFORMATION
http://developer.nvidia.com/high-dynamic-range-display-develpment
• White Paper
• SDK
[Barten 1999] Peter G.J. Barten, ‘Contrast Sensitivity of the Human Eye and its Effects on Image Quality’
[Pointer 1980] M.R. Pointer, ‘the Gamut of Real Surface Colors’
7/25/2016
![Page 53: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/53.jpg)
April 4-7, 2016 | Silicon Valley
Q & A
![Page 54: HDR Rendering On NVIDIA GPUs...HDR displays still limited (1000 nit max) Real world luminance is much higher • Sun over 1000x more luminous • 100w bulb over 10x more luminous Permits](https://reader033.fdocuments.us/reader033/viewer/2022051806/5ffbf340e38051544342d3d1/html5/thumbnails/54.jpg)
April 4-7, 2016 | Silicon Valley
THANK YOU!