This repository shares the data and software related to this article:
Accurate smartphone camera simulation using 3D scenes
Zheng Lyu, Thomas Goossens, Brian Wandell, Joyce Farrell
This paper describes image systems validation of a smartphone camera. We constructed and measured a Cornell Box and created a simulation of a Google Pixel 4a camera. This is an end-to-end simulation (scene radiance to raw digital values) of the image system. We then acquired images of the box using the Google Pixel 4a and compared a number of properties of the measured data with the simulations.
The calculations in this repository depend on ISETCam and ISET3d (v3). The calculations are illustrated in the LiveScripts that are linked below.
- Figures 1 and 2 - Cornell box physical measurements and optics modeling
- Figure 3 - Color channel calibration and correction
- Figure 4 - Qualitative comparison of measured and simulated images
- Figure 5 - Relative illumination
- Figure 6 and 7 - Optics validations (linespread and MTF)
- Figure 8 - Sensor noise validation
- Figure 9 - Inter-reflections validation
- Figure 10 - Color channel validation
- Figure 11 - Conversion gain estimation from digital values
A link to the pre-publication arXiv paper
ARXIV Abstract
We assess the accuracy of a smartphone camera simulation. The simulation is an end-to-end analysis that begins with a physical description of a high dynamic range 3D scene and includes a specification of the optics and the image sensor. The simulation is compared to measurements of a physical version of the scene. The image system simulation accurately matched measurements of optical blur, depth of field, spectral quantum efficiency, scene inter-reflections, and sensor noise. The results support the use of image systems simulation methods for soft prototyping cameras and for producing synthetic data in machine learning applications.