Camera Calibration - Interior parameters

The central perspective projection model is only an idealization (and simplification) of the actual optical geometry commonly found in cameras. Camera calibration is concerned with identifying how much the geometry of image formation differs in a real camera. One major difference is found in the optical distortions due to lens. Radial lens distortion causes variations in angular magnification with angle of incidence. It is usually expressed as a polynomial function of the radial distance from the point of symmetry (usually coinciding with the PP): .

Tangential lens distortion is the displacement of a point in the image caused by misalignment of the component of the lens. The displacement is usually described by 2 polynomials for displacements in x and y.

Image Refinement
The image plane of a camera is neither completely flat, nor absolutely orthogonal to the optical axis. This is usually corrected via fiducial marks or a reseau of crosses on a glass plate fixed to camera body at the image plane. Bilinear transforms or LSE are usually used to evaluate the corrective terms.

Resection - Exterior parameters

Once the interior (calibration) parameters are known, their remains 6 exterior orientations parameters to determine (3D translation and rotation). This evaluation is called resection. At least 3 non-collinear targets such as point A above, called control points, are needed. When more than 3 control points are available, a more rigorous statistical apporach can be used. E.g. the collinearity equations above can be linearized and a LSE used. Good initial values are required however, for the LSE process to converge to appropriate values.

2.3 - The Geometry of Two Cameras

Intersection
Having an object point A and two homologues a1 and a2, projected in 2 images assumed calibrated and resected, the collinearity equations are used to retrieve the 3D space coordinates of A, a process called intersection (see Fig. 2.9, p.26). The problem is over-constrained, having 4 equations and 3 unknowns, and LSE can be used again. Note that thers is then onle one dof, thus results are of low reliability. Independent resections of cameras followed by intersections of object space targets lead to small dimensional problems to resolve (6x6 and 3x3 matrices only), but are of lesser reliabilty and accuracy than the method of bundle adjustment, where large systems of equations are solved simultaneously.

Coplanarity Equation
Relative orientation is the evaluation of the exterior orientation elements of one camera w/r to the photo coordinate system of another camera. Consider once again the target A with images at a1 and a2. Then the vectors :are coplanar, where b is the camera base (of the stereo pair). They lie in the epipolar plane of A and the 2 perspective centers Assuming that the base vector is non-zero and using we get the coplanarity equation for target A :At least 3 targets are necessary (i.e., 6 constraints or coordinates) to determine the 5 elements of relative Orientation :After relative orientation has been performed, we can use the measured photo-coordinates of the 2 homologues of a target in order to evaluate, by intersection, its coordinates relative to the (x1,y1,z1) axes. Such coordinates are called model coordinates. Consider the vectors s and t, in opposite directions to a1 and a2 (i.e., pointing toward the target A). In practice, there will be no intersection of these 2 vectors in object space, because such vectors are derived from inexact photomeasurements, calibrated principal distances and estimates of exterior relative orientation elements of the camera at O2. The parallax vector p joins s and t near the true target position: p = -1s + b + 2t , where 1 and 2 are scalars proportional to the distance of target A to O1 and O2, respectively. The target A should lie in principle along the parallax vector. In order to specify a unique position of A on p, some constraints must be introduced. For example, in aerial mapping it is appropriate to require that the x and z component of vector p be zero. The non-zero component of p is then referred to as residual parallax or y-parallax. In close range photogrammetry one requires instead that p should have minimum length, and takes its mid-point as the position of target A.

Epipolar geometry
Given the location of the homologue of A in the camera image at O1, the homologue of A in the camera image at O2 will lie along an epipolar line: the intersection of the epipolar plane, defined by the target and the 2 camera centers O1 and O2, and either of the image plane. Any search procedure to locate a2 as a probable match to a1 can be confined to the epipolar line. In practice, however, because none of the values used to derive the equation of the line is exact, the search takes place alon a narrow band centered on the epipolar line.

Direct Linear Transformation (DLT)

DLT is a linear treatment of what is essentially a non-linear problem, so it gives only approximate values. However, DLT can be used successfully in work with non-metric cameras that do note require rigourous design and estimates of data quality, such as is the case with low cost non-metric cameras, used without fiducial marks or a rseau for image refinement,

DLT consists in first recasting the (explicit) collinearity equations into linear equations in implicit parameters. Using a sufficient number of control points (6 or more for a single image), the implicit parameters are solved via these linear equations. Finally, the explicit camera parameters can be solved in direct colsed-form from the implicit parameters.

2.4 - Multistation Convergent Geometry

Consider a system of n cameras disposed around an object having a typical target Ai which gives rise to an image point aij in camera j. Each target Ai is imaged in many cameras, potentially all. Then all the collinearity equations, taken together, form a set of equations which is called functional model of the photogrammetry system : F(x, b, a) = 0 , where x is a vector representing the u elements whose values are required (i.e., the parameters to be estimated), b is vector representing the m measured elements and a is a vector representing elements whose values are known constants; thus, we aim at evaluating x given b and a. Generally no unique solution exists for x, but least square estimation (LSE) provides means for obtaining a useful one. If cameras have been calibrated a priori, the calibrated values may be included in a and kept fixed, or included in b and x to be re-evaluated. If no prior calibration is available, the calibration elements can be included in x only, a procedure known as self-calibration.

Least Square Estimation (LSE)

Main advantages:

Redundancy for increased accuracy: LSE provides a systematic method for computing unique values of coordinates and other elements in photogrammetry based on a large number of redundant measurements of different kinds and weights. Precision of estimates: It allows for covariance matrices of estimates to be readily derived from the covariance matrix of the measurements. Network design: If a covariance matrix of the measurements is assumed, a priori analysis can be used to design a camera/object configuration and measurement scheme to meet crteria relating to precision, reliability and accuracy. Flexibility: Elements can be treated as unknowns, or as measurements, or as constants depending on circumstances. Also, algorithms within a LSE process can be devised to suit particular measurements tasks.

Main disadvantage:

Sensitivity to outliers: The non-linear nature of the functional model requires in practice to start with good approximate values of the unknowns, so that iterated linear solutions can be carried out in preference to a non-linear LSE process.

Bundle adjustment :

The process of evaluating coordinates of targets and exterior orientation parameters of the cameras using least squares based on collinearity equations. When (interior) parameters that defined the camera calibration are also evaluated, the process is called a self-calibrating bundle adjustment.