gen_spherical_mosaicT_gen_spherical_mosaicGenSphericalMosaicGenSphericalMosaicgen_spherical_mosaic (Operator)

Name

gen_spherical_mosaicT_gen_spherical_mosaicGenSphericalMosaicGenSphericalMosaicgen_spherical_mosaic — Create a spherical mosaic image.

Signature

gen_spherical_mosaic(Images : MosaicImage : CameraMatrices, RotationMatrices, LatMin, LatMax, LongMin, LongMax, LatLongStep, StackingOrder, Interpolation : )

Herror T_gen_spherical_mosaic(const Hobject Images, Hobject* MosaicImage, const Htuple CameraMatrices, const Htuple RotationMatrices, const Htuple LatMin, const Htuple LatMax, const Htuple LongMin, const Htuple LongMax, const Htuple LatLongStep, const Htuple StackingOrder, const Htuple Interpolation)

void GenSphericalMosaic(const HObject& Images, HObject* MosaicImage, const HTuple& CameraMatrices, const HTuple& RotationMatrices, const HTuple& LatMin, const HTuple& LatMax, const HTuple& LongMin, const HTuple& LongMax, const HTuple& LatLongStep, const HTuple& StackingOrder, const HTuple& Interpolation)

HImage HImage::GenSphericalMosaic(const HHomMat2DArray& CameraMatrices, const HHomMat2DArray& RotationMatrices, const HTuple& LatMin, const HTuple& LatMax, const HTuple& LongMin, const HTuple& LongMax, const HTuple& LatLongStep, const HTuple& StackingOrder, const HTuple& Interpolation) const

HImage HImage::GenSphericalMosaic(const HHomMat2DArray& CameraMatrices, const HHomMat2DArray& RotationMatrices, double LatMin, double LatMax, double LongMin, double LongMax, double LatLongStep, const HString& StackingOrder, const HString& Interpolation) const

HImage HImage::GenSphericalMosaic(const HHomMat2DArray& CameraMatrices, const HHomMat2DArray& RotationMatrices, double LatMin, double LatMax, double LongMin, double LongMax, double LatLongStep, const char* StackingOrder, const char* Interpolation) const

HImage HImage::GenSphericalMosaic(const HHomMat2DArray& CameraMatrices, const HHomMat2DArray& RotationMatrices, double LatMin, double LatMax, double LongMin, double LongMax, double LatLongStep, const wchar_t* StackingOrder, const wchar_t* Interpolation) const   (Windows only)

static void HOperatorSet.GenSphericalMosaic(HObject images, out HObject mosaicImage, HTuple cameraMatrices, HTuple rotationMatrices, HTuple latMin, HTuple latMax, HTuple longMin, HTuple longMax, HTuple latLongStep, HTuple stackingOrder, HTuple interpolation)

HImage HImage.GenSphericalMosaic(HHomMat2D[] cameraMatrices, HHomMat2D[] rotationMatrices, HTuple latMin, HTuple latMax, HTuple longMin, HTuple longMax, HTuple latLongStep, HTuple stackingOrder, HTuple interpolation)

HImage HImage.GenSphericalMosaic(HHomMat2D[] cameraMatrices, HHomMat2D[] rotationMatrices, double latMin, double latMax, double longMin, double longMax, double latLongStep, string stackingOrder, string interpolation)

def gen_spherical_mosaic(images: HObject, camera_matrices: Sequence[float], rotation_matrices: Sequence[float], lat_min: Union[float, int], lat_max: Union[float, int], long_min: Union[float, int], long_max: Union[float, int], lat_long_step: Union[float, int], stacking_order: MaybeSequence[Union[str, int]], interpolation: Union[str, int]) -> HObject

Description

gen_spherical_mosaicgen_spherical_mosaicGenSphericalMosaicGenSphericalMosaicGenSphericalMosaicgen_spherical_mosaic creates a spherical mosaic image MosaicImageMosaicImageMosaicImageMosaicImagemosaicImagemosaic_image from the input images passed in ImagesImagesImagesImagesimagesimages. The pose of the images in space, which is used to compute the position of the images with respect to the surface of the sphere, can be determined with stationary_camera_self_calibrationstationary_camera_self_calibrationStationaryCameraSelfCalibrationStationaryCameraSelfCalibrationStationaryCameraSelfCalibrationstationary_camera_self_calibration. The camera and rotation matrices computed with stationary_camera_self_calibrationstationary_camera_self_calibrationStationaryCameraSelfCalibrationStationaryCameraSelfCalibrationStationaryCameraSelfCalibrationstationary_camera_self_calibration can be used in CameraMatricesCameraMatricesCameraMatricesCameraMatricescameraMatricescamera_matrices and RotationMatricesRotationMatricesRotationMatricesRotationMatricesrotationMatricesrotation_matrices. A spherical mosaic can only be created from images that were taken with a stationary camera (see stationary_camera_self_calibrationstationary_camera_self_calibrationStationaryCameraSelfCalibrationStationaryCameraSelfCalibrationStationaryCameraSelfCalibrationstationary_camera_self_calibration).

The mosaic is computed in spherical coordinates (longitude and latitude). The row axis of MosaicImageMosaicImageMosaicImageMosaicImagemosaicImagemosaic_image corresponds to the latitude, while the column axis corresponds to the longitude. The part of the sphere that is computed by gen_spherical_mosaicgen_spherical_mosaicGenSphericalMosaicGenSphericalMosaicGenSphericalMosaicgen_spherical_mosaic is determined by LatMinLatMinLatMinLatMinlatMinlat_min, LatMaxLatMaxLatMaxLatMaxlatMaxlat_max, LongMinLongMinLongMinLongMinlongMinlong_min, and LongMaxLongMaxLongMaxLongMaxlongMaxlong_max. These parameters are specified in degrees and determine a rectangular part of the latitude and longitude coordinates. The latitude -90 corresponds to the north pole (i.e., the straight up viewing direction), while 90 corresponds to the south pole (i.e., the straight down viewing direction). The longitude 0 corresponds to the straight ahead viewing direction. Negative longitudes correspond to viewing directions to the left, while positive longitudes correspond to viewing directions to the right. Hence, to obtain a complete image of the sphere, LatMinLatMinLatMinLatMinlatMinlat_min = -90, LatMaxLatMaxLatMaxLatMaxlatMaxlat_max = 90, LongMinLongMinLongMinLongMinlongMinlong_min = -180, and LongMaxLongMaxLongMaxLongMaxlongMaxlong_max = 180 must be used. In many cases, the mosaic will not cover the entire sphere. In these cases, it is useful to select the desired part of the sphere with the above parameters. This can be done by explicitly specifying the desired rectangle. However, often it is desirable to determine the smallest rectangle that encloses all images automatically. This can be done by using LatMinLatMinLatMinLatMinlatMinlat_min < -90, LatMaxLatMaxLatMaxLatMaxlatMaxlat_max > 90, LongMinLongMinLongMinLongMinlongMinlong_min < -180, and LongMaxLongMaxLongMaxLongMaxlongMaxlong_max > 180. Only the parameters that lie outside the normal range of values are determined automatically.

The angle step per pixel in MosaicImageMosaicImageMosaicImageMosaicImagemosaicImagemosaic_image can be selected with LatLongStepLatLongStepLatLongStepLatLongSteplatLongSteplat_long_step, which also is an angle specified in degrees. With this, the resolution of the mosaic image can be controlled. If LatLongStepLatLongStepLatLongStepLatLongSteplatLongSteplat_long_step is set to 0 the angle step is calculated automatically by trying to preserve the pixel size of the original images as well as possible.

The mode in which the images are added to the mosaic is given by StackingOrderStackingOrderStackingOrderStackingOrderstackingOrderstacking_order. For StackingOrderStackingOrderStackingOrderStackingOrderstackingOrderstacking_order = 'voronoi'"voronoi""voronoi""voronoi""voronoi""voronoi", the points in the mosaic image are determined from the Voronoi cell of the respective input image. This means that the gray values are taken from the points of the input image to whose center the pixel in the mosaic image has the smallest distance on the sphere. This mode has the advantage that vignetting and uncorrected radial distortions are less noticeable in the mosaic image because they typically are symmetric with respect to the image center. Alternatively, with the choice of parameters described described in the following, a mode can be selected that has the same effect as if the images were painted successively into the mosaic image. Here, the order in which the images are added to the mosaic image is important. Therefore, an array of integer values can be passed in StackingOrderStackingOrderStackingOrderStackingOrderstackingOrderstacking_order. The first index in this array will end up at the bottom of the image stack while the last one will be on top. If 'default'"default""default""default""default""default" is given instead of an array of integers, the canonical order (images in the order used in ImagesImagesImagesImagesimagesimages) will be used. Hence, if neither 'voronoi'"voronoi""voronoi""voronoi""voronoi""voronoi" nor 'default'"default""default""default""default""default" are used, StackingOrderStackingOrderStackingOrderStackingOrderstackingOrderstacking_order must contain a permutation of the numbers 1,...,n, where n is the number of images passed in ImagesImagesImagesImagesimagesimages. It should be noted that the mode 'voronoi'"voronoi""voronoi""voronoi""voronoi""voronoi" cannot always be used. For example, at least two images must be passed to use this mode. Furthermore, for very special configurations of the positions of the image centers on the sphere, the Voronoi cells cannot be determined uniquely. With StackingOrderStackingOrderStackingOrderStackingOrderstackingOrderstacking_order = 'blend'"blend""blend""blend""blend""blend", an additional mode is available, which blends the images of the mosaic smoothly. This way seams between the images become less apparent. The seam lines between the images are the same as in 'voronoi'"voronoi""voronoi""voronoi""voronoi""voronoi". This mode leads to visually more appealing images, but requires significantly more resources. If the mode 'voronoi'"voronoi""voronoi""voronoi""voronoi""voronoi" or 'blend'"blend""blend""blend""blend""blend" cannot be used for whatever reason the mode is switched internally to 'default'"default""default""default""default""default" automatically.

The parameter InterpolationInterpolationInterpolationInterpolationinterpolationinterpolation selects the desired interpolation mode for creating the mosaic. 'bilinear'"bilinear""bilinear""bilinear""bilinear""bilinear" and 'bicubic'"bicubic""bicubic""bicubic""bicubic""bicubic" interpolation is available for all modes of StackingOrderStackingOrderStackingOrderStackingOrderstackingOrderstacking_order. 'nearest_neighbor'"nearest_neighbor""nearest_neighbor""nearest_neighbor""nearest_neighbor""nearest_neighbor" is only available if StackingOrderStackingOrderStackingOrderStackingOrderstackingOrderstacking_order is set to 'default'"default""default""default""default""default" or 'voronoi'"voronoi""voronoi""voronoi""voronoi""voronoi".

Execution Information

Parameters

ImagesImagesImagesImagesimagesimages (input_object)  (multichannel-)image-array objectHImageHObjectHImageHobject (byte / uint2 / real)

Input images.

MosaicImageMosaicImageMosaicImageMosaicImagemosaicImagemosaic_image (output_object)  (multichannel-)image objectHImageHObjectHImageHobject * (byte / uint2 / real)

Output image.

CameraMatricesCameraMatricesCameraMatricesCameraMatricescameraMatricescamera_matrices (input_control)  hom_mat2d-array HHomMat2D, HTupleSequence[float]HTupleHtuple (real) (double) (double) (double)

(Array of) 3x3 projective camera matrices that determine the internal camera parameters.

RotationMatricesRotationMatricesRotationMatricesRotationMatricesrotationMatricesrotation_matrices (input_control)  hom_mat2d-array HHomMat2D, HTupleSequence[float]HTupleHtuple (real) (double) (double) (double)

Array of 3x3 transformation matrices that determine rotation of the camera in the respective image.

LatMinLatMinLatMinLatMinlatMinlat_min (input_control)  angle.deg HTupleUnion[float, int]HTupleHtuple (real / integer) (double / int / long) (double / Hlong) (double / Hlong)

Minimum latitude of points in the spherical mosaic image.

Default value: -90

Suggested values: -100, -90, -80, -70, -60, -50, -40, -30, -20, -10

Restriction: LatMin <= 90

LatMaxLatMaxLatMaxLatMaxlatMaxlat_max (input_control)  angle.deg HTupleUnion[float, int]HTupleHtuple (real / integer) (double / int / long) (double / Hlong) (double / Hlong)

Maximum latitude of points in the spherical mosaic image.

Default value: 90

Suggested values: 10, 20, 30, 40, 50, 60, 70, 80, 90, 100

Restriction: LatMax >= -90 && LatMax > LatMin

LongMinLongMinLongMinLongMinlongMinlong_min (input_control)  angle.deg HTupleUnion[float, int]HTupleHtuple (real / integer) (double / int / long) (double / Hlong) (double / Hlong)

Minimum longitude of points in the spherical mosaic image.

Default value: -180

Suggested values: -200, -180, -160, -140, -120, -100, -90, -80, -70, -60, -50, -40, -30, -20, -10

Restriction: LongMin <= 180

LongMaxLongMaxLongMaxLongMaxlongMaxlong_max (input_control)  angle.deg HTupleUnion[float, int]HTupleHtuple (real / integer) (double / int / long) (double / Hlong) (double / Hlong)

Maximum longitude of points in the spherical mosaic image.

Default value: 180

Suggested values: 10, 20, 30, 40, 50, 60, 70, 80, 90, 100, 120, 140, 160, 180, 200

Restriction: LongMax >= -90 && LongMax > LongMin

LatLongStepLatLongStepLatLongStepLatLongSteplatLongSteplat_long_step (input_control)  angle.deg HTupleUnion[float, int]HTupleHtuple (real / integer) (double / int / long) (double / Hlong) (double / Hlong)

Latitude and longitude angle step width.

Default value: 0.1

Suggested values: 0, 0.02, 0.05, 0.1, 0.2, 0.5, 1

Restriction: LatLongStep >= 0

StackingOrderStackingOrderStackingOrderStackingOrderstackingOrderstacking_order (input_control)  string(-array) HTupleMaybeSequence[Union[str, int]]HTupleHtuple (string / integer) (string / int / long) (HString / Hlong) (char* / Hlong)

Mode of adding the images to the mosaic image.

Default value: 'voronoi' "voronoi" "voronoi" "voronoi" "voronoi" "voronoi"

Suggested values: 'blend'"blend""blend""blend""blend""blend", 'voronoi'"voronoi""voronoi""voronoi""voronoi""voronoi", 'default'"default""default""default""default""default"

InterpolationInterpolationInterpolationInterpolationinterpolationinterpolation (input_control)  string HTupleUnion[str, int]HTupleHtuple (string / integer) (string / int / long) (HString / Hlong) (char* / Hlong)

Mode of interpolation when creating the mosaic image.

Default value: 'bilinear' "bilinear" "bilinear" "bilinear" "bilinear" "bilinear"

Suggested values: 'nearest_neighbor'"nearest_neighbor""nearest_neighbor""nearest_neighbor""nearest_neighbor""nearest_neighbor", 'bilinear'"bilinear""bilinear""bilinear""bilinear""bilinear", 'bicubic'"bicubic""bicubic""bicubic""bicubic""bicubic"

Example (HDevelop)

* For the input data to stationary_camera_self_calibration, please
* refer to the example for stationary_camera_self_calibration.
stationary_camera_self_calibration (4, 640, 480, 1, From, To, \
                                    HomMatrices2D, Rows1, Cols1, \
                                    Rows2, Cols2, NumMatches, \
                                    'gold_standard', \
                                    ['focus','principal_point'], \
                                    'true', CameraMatrix, Kappa, \
                                    RotationMatrices, X, Y, Z, Error)
gen_spherical_mosaic (Images, MosaicImage, CameraMatrix, \
                      RotationMatrices, -100, 100, -200, 200, 0, \
                      'default','bilinear')

* Alternatively, if kappa should be determined, the following calls
* can be made:
stationary_camera_self_calibration (4, 640, 480, 1, From, To, \
                                    HomMatrices2D, Rows1, Cols1, \
                                    Rows2, Cols2, NumMatches, \
                                    'gold_standard', \
                                    ['focus','principal_point','kappa'], \
                                    'true', CameraMatrix, Kappa, \
                                    RotationMatrices, X, Y, Z, Error)
cam_mat_to_cam_par (CameraMatrix, Kappa, 640, 480, CamParam)
change_radial_distortion_cam_par ('fixed', CamParam, 0, CamParOut)
gen_radial_distortion_map (Map, CamParam, CamParOut, 'bilinear')
map_image (Images, Map, ImagesRect)
gen_spherical_mosaic (ImagesRect, MosaicImage, CameraMatrix, \
                      RotationMatrices, -100, 100, -200, 200, 0, \
                      'default','bilinear')

Result

If the parameters are valid, the operator gen_spherical_mosaicgen_spherical_mosaicGenSphericalMosaicGenSphericalMosaicGenSphericalMosaicgen_spherical_mosaic returns the value TRUE. If necessary an exception is raised.

Possible Predecessors

stationary_camera_self_calibrationstationary_camera_self_calibrationStationaryCameraSelfCalibrationStationaryCameraSelfCalibrationStationaryCameraSelfCalibrationstationary_camera_self_calibration

Alternatives

gen_cube_map_mosaicgen_cube_map_mosaicGenCubeMapMosaicGenCubeMapMosaicGenCubeMapMosaicgen_cube_map_mosaic, gen_projective_mosaicgen_projective_mosaicGenProjectiveMosaicGenProjectiveMosaicGenProjectiveMosaicgen_projective_mosaic

References

Lourdes Agapito, E. Hayman, I. Reid: “Self-Calibration of Rotating and Zooming Cameras”; International Journal of Computer Vision; vol. 45, no. 2; pp. 107--127; 2001.
Olivier Faugeras, Quang-Tuan Luong: “The Geometry of Multiple Images: The Laws That Govern the Formation of Multiple Images of a Scene and Some of Their Applications”; MIT Press, Cambridge, MA; 2001.

Module

Matching