Additional Results

Move your mouse over captions to switch between input and results. Click for full resolution.
 

Quantitative comparison

More results on real data with PSNR. Our method ("Ours") is compared with several algorithms. "DT-GIF" is the result obtained by the guided filter version of the detail transfer method [Petschnigg et al, He et al]. "DJF" is the imaged produced by the deep joint filter [Li et al]. "Huawei" is the output image by Huawei P9's black box software. Captured ground truth is shown in "GT".


Mono     Mono (warped+mask)     DCRaw (27.90dB)     DT-GIF (34.32dB)     DJF (30.73dB)     Huawei (32.72dB)     Ours (34.71dB)     GT
 

Mono     Mono (warped+mask)     DCRaw (30.67dB)     DT-GIF (37.83dB)     DJF (34.68dB)     Huawei (35.41dB)     Ours (38.48dB)     GT
 

Qualitative comparison

More samples without ground truth image. Unreliable correspondences are highlighted in "Monochrome (warped)".


Mono     Mono (warped)     Mono (warped+mask)     DCRaw     DT-GIF     DJF     Huawei     Ours
 

Mono     Mono (warped)     Mono (warped+mask)     DCRaw     DT-GIF     DJF     Huawei     Ours
 

Improve camera processed images

Here we demonstrate that our method can be used to improve images processed by Huawei P9 smartphone's black box software, by simply removing the Bayer downsampling matrix in our optimization problem and replacing the input image with the camera image (see "Huawei"). Unreliable correspondences are highlighted in "Mono (warped+mask)". "DCRaw" is the demosaicked image by DCRaw without denoising. The final result is shown in "Huawei+Ours".


Mono     Mono (warped)     Mono (warped+mask)     DCRaw     Ours     Huawei     Huawei+Ours
 

Mono     Mono (warped)     Mono (warped+mask)     DCRaw     Ours     Huawei     Huawei+Ours
 

An example where colorization would fail

We also provide an example scene where colorizing the monochrome image would lead to color ambiguity in occluded region (see the colorful beads occluded in the color image "DCRaw" but seen in the unwarped monochrome image "Mono"). Therefore it is more robust to reconstruct images directly on the RGB camera. "DCRaw" is the demosaicked image by DCRaw without denoising. PSNR is computed against the ground truth ("GT") captured by extending exposure time and decreasing ISO accordingly.


Mono     Mono (warped)     Mono (warped+mask)     DCRaw (30.94dB)     Ours (38.68dB)     GT
 

Appendix

For details on solving the joint optimization problem, please see: [appendix.pdf]

 

References

Petschnigg, G., Szeliski, R., Agrawala, M., Cohen, M., Hoppe, H., Toyama, K.: Digital photography with flash and no-flash image pairs. ACM Transaction on Graphics (Proceddings SIGGRAPH 2004) 23(3) (August 2004) 664–672

He, K., Sun, J., Tang, X.: Guided image filtering. IEEE Transactions on Pattern Analysis and Machine Intelligence 35(6) (2013) 1397–1409

Li, Y., Huang, J.B., Narendra, A., Yang, M.H.: Deep joint image filtering. In: European Conference on Computer Vision. (2016)