Microlens Light Field Imaging Method Based on Bionic Vision and 3-3 Dimensional Information Transforming

doi:10.11947/j.JGGS.2019.0208

Journal of Geodesy and Geoinformation Science ›› 2019, Vol. 2 ›› Issue (2): 70-78.doi: 10.11947/j.JGGS.2019.0208

Previous Articles Next Articles

Microlens Light Field Imaging Method Based on Bionic Vision and 3-3 Dimensional Information Transforming

Shoujiang ZHAO¹,Fan LIU³,Peng YANG¹,Hongying ZHAO¹,Anand ASUNDI²,Lei YAN¹,Haimeng ZHAO¹()

^1. The Institute of Remote Sensing and Geographic Information System, the School of Earth and Space Sciences, Peking University, Beijing Key Laboratory of Spatial Information Integration and 3S Engineering Application, Beijing 100871, China
^2. The School of Mechanical and Aerospace Engineering, Nanyang Technological University, 639798, Singapore
^3. The School of Information Engineering, Capital Normal University, Beijing 100048, China

Received:2013-03-21 Accepted:2019-04-02 Online:2019-06-20 Published:2020-03-20
Contact: Haimeng ZHAO E-mail:zhaohaimeng@163.com
About author:Shoujiang ZHAO(1996—), male, PhD candidate, the School of Earth and Space Sciences, Peking University, majors in photogrammetry and remote sensing.E-mail: 1601110606@pku.edu.cn
Supported by:
The National Major Project Research and Development Project(2017YFB0503003);The National Natural Science Foundation of China(61101157);The National Natural Science Foundation of China(60602042)

Abstract

Abstract:

This paper adopts the 3-3-2 information processing method for the capture of moving objects as its premise, and proposes a basic principle of three-dimensional (3D) imaging using biological compound eye. Traditional bionic vision is limited by the available hardware. Therefore, in this paper, the new-generation technology of microlens-array light-field camera is proposed as a potential method for the extraction of depth information from a single image. A significant characteristic of light-field imaging is that it records intensity and directional information from the lights entering the camera. Herein, a refocusing method using light-field image is proposed. By calculating the focusing cost at different depths from the object, the imaging plane of the object is determined, and a depth map is constructed based on the position of the object’s imaging plane. Compared with traditional light-field depth estimation, the depth map calculated by this method can significantly improve resolution and does not depend on the number of light-field microlenses. In addition, considering that software algorithms rely on hardware structure, this study develops an imaging hardware that is only 7cm long based on the second-generation microlens camera’s structure, further validating its important refocusing characteristics. It thereby provides a technical foundation for 3D imaging with a single camera.

Key words: bionic compound eye; single-shot; light field; 3D-3D transform imaging; microlenses; stereo photogrammetry

Shoujiang ZHAO,Fan LIU,Peng YANG,Hongying ZHAO,Anand ASUNDI,Lei YAN,Haimeng ZHAO. Microlens Light Field Imaging Method Based on Bionic Vision and 3-3 Dimensional Information Transforming[J]. Journal of Geodesy and Geoinformation Science, 2019, 2(2): 70-78.

Figures/Tables 12

Fig.1

Fig.2

Fig.3

Tab.1

Fig.4

Fig.5

Fig.6

Fig.7

Fig.8

Fig.9

Fig.10

Fig.11

References 26

[1]	GAO Pengqi . Research on UAV Moving Target Detection Inspired by Compound Eye[D]. Beijing: Peking University, 2009.
[2]	SUN Huabo . Moving Target Detection Using Bionic Compound Eyes Based on 3-3-2 Processing Mode of Remote Sensing Information[D]. Beijing: Peking University, 2012.
[3]	RAYTRIX. “The Raytrix Camera” [EB/OL].[2017-08-10].
[4]	NG R . Digital Light Field Photography[D]. Stanford, CA, USA: Stanford University, 2006.
[5]	NG R, LEVOY M, BRÉDIF M , et al. Light Field Photography with a Hand-held Plenoptic Camera[R]. Stanford Tech Report CTSR 2005-02, 2005.
[6]	LYTRO. “The Lytro Camera”[EB/OL].[2017-08-10].
[7]	YANG Peng, WANG Zhaomin, YAN Yizhen , et al. Close-range Photogrammetry with Light Field Camera:from Disparity Map to Absolute Distance[J]. Applied Optics, 2016,55(27):7477-7486.
[8]	DANSEREAU D G, PIZARRO O, WILLIAMS S B . Decoding, Calibration and Rectification for Lenselet-based Plenoptic Cameras [C]//Proceedings of 2013 IEEE Conference on Computer Vision and Pattern Recognition. Portland: IEEE, 2013.
[9]	CRIMINISI A, KANG S B, SWAMINATHAN R , et al. Extracting Layers and Analyzing Their Specular Properties Using Epipolar-plane-image Analysis[J]. Computer Vision and Image Understanding, 2005,97(1):51-85.
[10]	MATOUŠEK M, WERNER T, HLAVÁČ V . Accurate Correspondences from Epipolar Plane Images [C]//Proceedings of Computer Vision Winter Workshop. Bled, Slovenia: Slovenian Pattern Recorgnition Society, 2001.
[11]	BOLLES R C, BAKER H H, MARIMONT D H . Epipolar-plane Image Analysis:An Approach to Determining Structure from Motion[J]. International Journal of Computer Vision, 1987,1(1):7-55.
[12]	DANSEREAU D, BRUTON L . Gradient-based Depth Estimation from 4D LightFields [C]//Proceedings of 2004 International Symposium on Circuits and Systems. Vancouver: IEEE, 2004: 23-26.
[13]	WANNER S, GOLDLUECKE B . Variational Light Field Analysis for Disparity Estimation and Super-resolution[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014,36(3):606-619.
[14]	WANNER S, GOLDLUECKE B . Globally Consistent Depth Labeling of 4D Light Fields [C]//Proceedings of 2012 IEEE Conference on Computer Vision and Pattern Recognition. Providence: IEEE, 2012: 16-21.
[15]	TAO M W, HADAP S, MALIK J , et al. Depth From Combining Defocus and Correspondence Using Light-field Cameras [C]//Proceedings of 2013 IEEE International Conference on Computer Vision. Sydney: IEEE, 2013: 1-8.
[16]	ZHANG Shuo, SHENG Hao, LI Chao , et al. Robust Depth Estimation for Light Field via Spinning Parallelogram Operator[J]. Computer Vision and Image Understanding, 2016,145:148-159.
[17]	JEON H G, PARK J, CHOE G , et al. Accurate Depth Map Estimation from a Lenslet Light Field Camera [C]//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston: IEEE, 2015: 7-12.
[18]	GEORGIEV T G, LUMSDAINE A . Focused plenoptic camera and rendering[J]. Journal of Electronic Imaging, 2010: 19-19.
[19]	LUMSDAINE A and GEORGIEV T . The focused plenoptic camera [C]//IEEE International Conference on Computational Photography. IEEE, 2010: 1-8.
[20]	GEORGIEV T G, LUMSDAINE A . Superresolution with Plenoptic 2.0 Cameras[J]. Signal Recovery & Synjournal, 2009.
[21]	SUN H, ZHAO H, MOONEY P , et al. A Novel System for Moving Object Detection Using Bionic Compound Eyes[J]. Journal of Bionic Engineering, 2011,8(3):313-322.
[22]	SUN H, YAN L, MOONEY P , et al. A new method for moving object detection using variable resolution bionic compound eyes[J]. International Journal of Physical Sciences, 2011,6(24):5618-5622.
[23]	LUO Boren . The 3D Reconstruction of the Target Field View Based on the Bionic Compound Eye[D]. Beijing: Peking University, 2014.
[24]	LUO B R, YAN L, LIU H L , et al. A method for moving target capture using 3D profile information based on bionic compound eye [C]//International Conference on Computer Vision in Remote Sensing. IEEE, 2012, 173-176.
[25]	KANADE T, OKUTOMI M . A Stereo Matching Algorithm with An Adaptive Window:Theory and Experiment[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1994,16(9):920-932.
[26]	HOG M, SABATER N, VANDAME B , et al. An Image Rendering Pipeline for Focused PlenopticCameras[J]. IEEE Transactions on Computational Imaging, 2016,3(4):811-821.

Parameter	Value
F#	2.8
f	25mm
d	27.3pix
u	2.2μm

Microlens Light Field Imaging Method Based on Bionic Vision and 3-3 Dimensional Information Transforming

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 12

References 26

Related Articles 0

Recommended Articles

Metrics

Comments