I have two cameras side by side. I'd like to register two images taken from each camera. I think global transformation will not work for this issue since changes of distances between two images for the closer objects are significantly higher. What should I do in this case? I tried to read some papers but I am not sure which one is the perfect match for me. Do you have any suggestions such as "read this paper", "apply this algorithm", "know this and that" etc.

edit: I forgot to say that the project is real-time. Image registration will be implemented in the GPU.

  • 2
    $\begingroup$ Good question! I hope someone can help you. Have you tried SIFT/SURF/global alignment? You're probably right that it will have some issues, but it's a reasonable thing to try first. See also cs.stackexchange.com/q/47234/755, though it doesn't answer this question (and this isn't a duplicate). $\endgroup$
    – D.W.
    Nov 21, 2016 at 17:38
  • $\begingroup$ I actually read this one before asking this question. The answer is quite helpful but general. By the way, I'll try. Thank you. $\endgroup$ Nov 21, 2016 at 19:08
  • $\begingroup$ You should read about stereo image/stereo vision. Basically you can not register the images without building a 3D model. If the cameras` relative location is fixed it should not be too difficult (although it is definitely not trivial) and it is called calibrated stereo. Otherwise it becomes a bit more tricky and is called uncalibrated stereo $\endgroup$ Jan 30, 2017 at 14:20

1 Answer 1


Since you need to implement image registration for real-time your should have fast registration algorithm, such as differential total variation (DTV) or binary gradient angle descriptor. However, these methods implement for challenge dataset or multimodal in consideration of your images are mono-modal meanwhile these methods should work perfectly in your case.

Your algorithm should include these steps:

  1. Image descriptor to extract the images features.
  2. Feature selection: find the most similar features (this step is important to remove outliers which is common)
  3. Minimise the distance between the related image features to get the optimal transformation.
  4. Apply image transformation on the floating image.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.