#HMD Distortion Correction Toolbox for MATLAB

This toolbox provides a non-parametric distortion correction method for Optical See-Through Head-Mounted Display (OST-HMDs).

How to Use it

On MATLAB, you just need to run the following:

>> main_undistorty_optics

(We tested the code on MATLAB 2015a/b with the Statistics Toolbox.) If the program runs successfully, you would see an estimation result of an optical distortion learned from a sample dataset:

(A viewpoint-dependent optical distortion generated by a learned 4D-2D function given a test viewpoint)

Problem Background

When we wear an OST-HMD, optical aberration from the display's optics distorts our field of view:

This results in a misaligned Augmented Reality rendering, and our method aims to correct it:

Our method is based on geometrical optics. We measure light rays in the scene trace how an optics of the display distorts the ray when we place an OST-HMD in front of the view point. By correcting many of these correspondences, we learn a mapping between the original light rays to the distorted. In out code, we achieve this by using a Kernel regression.

For more detail, please refer to our papers listed in the bottom of this document .

References:

The original paper is:
Pre-print, Talk-slides

@article{DBLP:journals/tvcg/ItohK15,
   author = {Yuta Itoh and Gudrun Klinker},
   title = {Light-Field Correction for Spatial Calibration of Optical See-Through Head-Mounted Displays},
   year = {2015},
   month = {April},
   journal = {IEEE Transactions on Visualization and Computer Graphics (Proceedings Virtual Reality 2015)},
   volume = {21},
   number = {4},
   pages = {471--480},
   doi = {http://doi.ieeecomputersociety.org/10.1109/TVCG.2015.2391859},
}

Follow-up paper which extends this calibration method to the image distortions (not included in the current code):
Pre-print, Talk-slides

@InProceedings{DBLP:conf/ismar/ItohK15,
  Title                    = {{Simultaneous Direct and Augmented View Distortion Calibration of Optical See-Through Head-Mounted Displays}},
  Author                   = {Yuta Itoh and Gudrun Klinker},
  Booktitle                = {14th {IEEE} International Symposium on Mixed and Augmented Reality, {ISMAR} 2015, FUkuoka, Japan, Sep. 29 - Oct. 3, 2015},
  Year                     = {2015},
  Pages                    = {43--48},
  Bibsource                = {dblp computer science bibliography, http://dblp.org},
  Crossref                 = {DBLP:conf/ismar/2015}
}