| Operators |
reconstruct_points_stereo — Reconstruct 3D points from calibrated multi-view stereo images.
reconstruct_points_stereo( : : StereoModelID, Row, Column, CovIP, CameraIdx, PointIdx : X, Y, Z, CovWP, PointIdxOut)
The operator reconstruct_points_stereo reconstructs 3D points from point correspondences found in the images of a calibrated multi-view stereo setup. The calibration information for the images is provided in the camera setup model that is associated with the stereo model StereoModelID during its creation (see create_stereo_model). Note that the stereo model type must be 'points_3d', otherwise the operator will return an error.
The point correspondences must be passed in the parameters Row, Column, CameraIdx, and PointIdx in form of tuples of the same length. Each set (Row[I],Column[I],CameraIdx[I],PointIdx[I]) represents the image coordinates (Row, Column) of the 3D point (PointIdx) in the image of a certain camera (CameraIdx).
The reconstructed 3D point coordinates are returned in the tuples X, Y, and Z, relative to the coordinate system of the camera setup model (see create_camera_setup_model). The tuple PointIdxOut contains the corresponding point indices.
The reconstruction algorithm works as follows: First, it identifies point correspondences for a given 3D point by collecting all sets with the same PointIdx. Then, it uses the Row, Column, and CameraIdx information from the collected sets to project lines of sight from each camera through the corresponding image point [Row,Column]. If there are at least 2 lines of sight for the point PointIdx, they are intersected and the result is stored as the set (X[J],Y[J],Z[J],PointIdxOut[J]). The intersection is performed with a least-squares algorithm, without taking into account potentially invalid lines of sight (e.g., if an image point was falsely specified as corresponding to a certain 3D point).
To compute the covariance matrices for the reconstructed 3D points, statistical information about the extracted image coordinates, i.e., the covariance matrices of the image points (see , e.g., points_foerstner) are needed as input and must be passed in the parameter CovIP. Otherwise, if no covariance matrices for the 3D points are needed or no covariance matrices for the image points are available, an empty tuple can be passed in CovIP. Then no covariance matrix for the reconstructed 3D points is computed.
The covariance matrix of an image point is:
The covariance matrices are symmetric 2x2 matrices, whose entries in the main diagonal represent the variances of the image point in row-direction and column-direction, respectively. For each image point, a covariance matrix must be passed in CovIP in form of a tuple with 4 elements:
Thus, |CovIP|=4*|Row| and CovIP[I*4:I*4+3] is the covariance matrix for the I-th image point.
The computed covariance matrix for a successfully reconstructed 3D point is represented by a symmetric 3x3 matrix:
The diagonal entries represent the variances of the reconstructed 3D point in x-, y-, and z-direction. The computed matrices are returned in the parameter CovWP in form of tuples each with 9 elements:
Thus, |CovWP|=9*|X| and CovWP[J*9:J*9+8] is the covariance matrix for the J-th 3D point. Note that if the camera setup associated with the stereo model contains the covariance matrices for the camera parameters, these covariance matrices are considered in the computation of CovWP too.
If the stereo model has a valid bounding box set (see set_stereo_model_param), the resulting points are clipped to this bounding box, i.e., points outside it are not returned. If the bounding box associated with the stereo model is invalid, it is ignored and all points that could be reconstructed are returned.
Handle of the stereo model.
Row coordinates of the detected points.
Column coordinates of the detected points.
Covariance matrices of the detected points.
Default value: []
Indices of the observing cameras.
Suggested values: 0, 1, 2
Indices of the observed world points.
Suggested values: 0, 1, 2
X coordinates of the reconstructed 3D points.
Y coordinates of the reconstructed 3D points.
Z coordinates of the reconstructed 3D points.
Covariance matrices of the reconstructed 3D points.
Indices of the reconstructed 3D points.
reconstruct_surface_stereo, intersect_lines_of_sight
3D Metrology
| Operators |