Image Mosaicing and Registration
KritiKal’s Mosaicing Engine is a cross platform real time system for generating high quality panoramas (wide angle images) from live or offline inputs. The engine can work in two modes:-
- Automatic mode: On availability of video input, a mosaic can be automatically created for the entire duration of the session. The engine automatically creates longest possible mosaic segments from input frames.
- Interactive mode: User can operate via a User Interface to select zones of interest to create mosaic(s) of the zones selected.
Mosaicing Engine based solutions can have diverse uses across digital artists, insurance firms, cartographers and military personnel, for applications like:
- Creating high resolution backgrounds
- High resolution scans of large drawings: A drawing that can't be scanned in a single go can be scanned in parts. These sub-scans can then be stitched together to generate a high resolution scan of the original drawing.
- Vision based health monitoring of large vehicles: Cameras mounted at the entry / exit points of port terminals (for example) can generate panoramas of the various sides of a vehicle. These panoramas can be used for surface inspection and health/insurance monitoring measures for the vehicles.
- Reconnaissance: Videos captured by aerial vehicles during flight can be used to generate a terrain map, making it easier to interpret the spatial layout of the various targets of interest.
- Geo registration: Panoramas constructed by aerial vehicles during flight can be registered with satellite image. The registration can be used for finding changes, updating maps or even for flight path correction.
- Wide Area Surveillance: Creating panoramas using input from panning cameras, covering large areas across national borders (for example). Intruders could then be detected and tracked over the panoramas.
- Free (perspective) mosaic generation: In the absence of any additional information, images are processed in sequence and joined together to form a mosaic. Such mosaics may contain perspective distortion.
- Infinite Geo (orthographic) mosaic generation with additional telemetry input: Additional telemetry information can be used to rectify input images to obtain orthographic views. These orthorectified images are used as input for panorama generation. If it is not necessary to preserve real world geometry, infinite mosaics can also be created in the absence of telemetry information.
- Radial distortion correction: Radial distortion effect causes straight lines, especially towards the boundary of the image, to appear as curved lines. These distortions can be specially acute with fish eye lenses etc. Our mosaicing engine provides can perform radial distortion correction as a pre-processing step.
- Intelligent recovery subsystem to skip noisy frames distorting the panorama: Images that are noisy or cause the panorama under construction to distort can be skipped automatically.
- Multiple blending schemes: When two images with overlapping content are joined to increase the field of view, artifacts can appear at the boundaries. These artifacts can be reduced or removed by using blending schemes available with the mosaicing engine.
- Efficient and robust custom image data structure to support ‘infinitely’ long mosaics. In order to reduce computation requirements to handle such huge images a custom structure has been designed. It also enables efficient processing of panoramic images.
- Real time system: The engine can processes images and generate panoramas in real time on standard desktops.
- Custom post processing features can be added as per the requirements of the client. Some examples:-
- Enhancement of certain regions within the mosaic by applying appropriate filters.
- Extraction of information like distance between two points or area of a certain region, etc. (in orthomosaics)
- Overlaying aerial mosaic on a specified digital map and displaying mission path over the mosaic.