Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for...

28
Stereo Matching Low-Textured Survey 1. Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2. A Robust Stereo Matching Method for Low Texture Stereo Images 1

Transcript of Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for...

Page 1: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

1

Stereo Matching Low-Textured Survey

1. Stereo Matching-Based Low-Textured Scene Reconstruction

for Autonomous Land Vehicles (ALV) Navigation

2. A Robust Stereo Matching Method for Low Texture Stereo

Images

Page 2: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

2

Outline

• Introduction• Proposed Paper 1 • Proposed Paper 2• Conclusion • Result

Page 3: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

3

Introduction

• Low-textured–Matching costs of the stereo pairs are almost

similar.

• In low-textured regions– Local algorithms are guaranteed to fail.– Global algorithms are too time-consuming.

Page 4: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

4

Introduction

• Solution of Local Approach– Bigger window size.

• Low-textured regions are larger than the size of the aggregation window.

Page 5: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

5

Introduction

• The size of aggregation windows should be – large enough to include intensity variation.– small enough to avoid disparity variation.

• An adaptive method for selecting the optimal aggregation window for stereo pairs.

Page 6: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

6

Introduction

• Low computation time and high quality of disparity map.

• Different strategies are applied in the well-textured and low-textured regions.

Page 7: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

7

Introduction

Page 8: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

8

Outline

• Introduction• Proposed Paper 1– Proposed Method– Texture Detection– Approaches

• Proposed Paper 2• Conclusion• Result

Page 9: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

9

Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles

(ALV) Navigation

Image Analysis and Signal Processing (IASP), 2011 International Conference on

Mechatronics & Automation School, National University of Defense Technology, Changsha, Hunan, China

Tingbo Hu

Tao Wu

Hangen He

Page 10: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

10

Proposed Method

• Local algorithms are used to matching the pixels in well-textured regions.

• A new matching algorithm combining plane priors and pixel dissimilarity is designed for the low-textured regions.

Page 11: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

11

Proposed Method

• In low-textured regions, the intensities of the pixels are almost identical.–Material and the Normal Vectors are consistent.

Page 12: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

12

Proposed Method

• A low-textured region is likely to correspond to a 3D plane.

Page 13: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

13

Texture Detection

• .

• .

Page 14: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

14

Approach - Local

• In the well-textured regions–Moravec Normalized Cross Correlation (MNCC)

Page 15: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

15

Approach - Plane

• In the low-textured regions

Page 16: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

16

Approaches

• .Low textured

Well textured

Page 17: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

17

Disparity Map

Page 18: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

18

Outline

• Introduction• Proposed Paper 1• Proposed Paper 2– Proposed Method– Edge Detection– Aggregation

• Conclusion• Result

Page 19: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

19

A Robust Stereo Matching Method for Low Texture Stereo Images

Computing and Communication Technologies, 2009. RIVF '09. International Conference on

Department of Information Media Technology Faculty of Information Science and Technology, Tokai University

Le Thanh SACH

Kiyoaki ATSUTA

Kazuhiko HAMAMOTO

Shozo KONDO

Page 20: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

20

Proposed Method

• Utilizes the edge maps computed from the stereo pairs to guide the cost aggregation.

Page 21: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

21

Proposed Method

Page 22: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

22

Edge Detection

Page 23: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

23

Edge Map

Page 24: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

24

Edge Detection

Page 25: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

25

Aggregation

• Horizontal Aggregation

Page 26: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

26

Aggregation

• Vertical Aggregation

Page 27: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

27

Conclusion

• Different strategies are applied in different kinds of regions.

• The computational complexity of Paper 2 cost aggregation method is independent of the window size.

Page 28: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust.

28

Result