you will implement the epipolar geometry and normalized cross correlation (NCC) to find correspondences across two calibrated camera images

INSTRUCTIONS TO CANDIDATES

ANSWER ALL QUESTIONS

Two-view Geometry and Correspondence Matching

For this project, you will implement the epipolar geometry and normalized cross correlation (NCC) to find correspondences across two calibrated camera images. You are provided with the extrinsics between two cameras and their individual intrinsics. The goal is: given two captured images by the two cameras, your program is able to automatically find the correspondence between them using fundamental matrix transformation and NCC matching.

Input Data

(1) You are provided two image files:

The two examples above demonstrate two images captured by the left and right cameras at the same time. By selecting one pixel on the right image (example 1) , an epipoloar line is automatically found from the left image and the correspondence is identified by NCC (indicated by the green circle). Example 2 shows a similar example

 but selecting a pixel from the left the image and found the correspondence from the right one.

(2) The calibration result file (processed by Matlab Toolbox):

This sample shows the two cameras’ intrinsics and extrinsics:

fc_left - the left camera’s focal length (fx and fy) cc_left - the left camera’s center offset (cx and cy)

Rotation vector - the relative rotation between the left and right cameras. Translation vector - the relative position between the left and right cameras.

The data after the   “±” symbol are the error deviation, you can simply ignore them. Also the “skew” and “distortion” are parameters about the lens, which are not necessary for the project.

What you should achieve?

(1) Successfully load and display two (left and right) color images at the same time. (10%)

(2) Successfully load the intrinsics and extrinsics file (.txt) into OpenCV matrix. (10%)

(3) Successfully use camera intrinsics and extrinsics to assemble a fundamental matrix. (25%)

(4) User selects a pixel on the left image by left mouse clicking. Your code should successfully render a corresponding epipolar line on the right image. This epipolar line should pass through the correspondence on the right image. (25%)

(5) Successfully implement NCC to find correspondence from the right image. (25%) 

(6) Write up a “.pdf” document with several pairs of sample images showing the rendered epipolar line and correspondence results. (5%)

Attachments:

Expert's Answer

945 Times Downloaded

Related Questions

. Introgramming & Unix Fall 2018, CRN 44882, Oakland University Homework Assignment 6 - Using Arrays and Functions in C

DescriptionIn this final assignment, the students will demonstrate their ability to apply two ma

. The standard path finding involves finding the (shortest) path from an origin to a destination, typically on a map. This is an

Path finding involves finding a path from A to B. Typically we want the path to have certain properties,such as being the shortest or to avoid going t

. Develop a program to emulate a purchase transaction at a retail store. This program will have two classes, a LineItem class and a Transaction class. The LineItem class will represent an individual

Develop a program to emulate a purchase transaction at a retail store. Thisprogram will have two classes, a LineItem class and a Transaction class. Th

. SeaPort Project series For this set of projects for the course, we wish to simulate some of the aspects of a number of Sea Ports. Here are the classes and their instance variables we wish to define:

1 Project 1 Introduction - the SeaPort Project series For this set of projects for the course, we wish to simulate some of the aspects of a number of

. Project 2 Introduction - the SeaPort Project series For this set of projects for the course, we wish to simulate some of the aspects of a number of Sea Ports. Here are the classes and their instance variables we wish to define:

1 Project 2 Introduction - the SeaPort Project series For this set of projects for the course, we wish to simulate some of the aspects of a number of