Gyeongmin "Chris" Choe

Gyeongmin "Chris" Choe, Ph.D

Research Scientist, Facebook Reality Labs Email: cgchoe [at] fb.com

I'm a research scientist at Facebook Reality Labs. Prior to joining Facebook, I have spent about 3 years in Samsung Research America to research and develop AI, computer vision and image processing algorithms for Samsung's flagship Galaxy smartphones. I received my Ph.D in Computer Vision from KAIST in 2018. I was a visiting researcher at Robotics Institute, CMU in 2015.

Work Experiences

Facebook Reality labs

2021 - Current, Menlo Park, CA

Senior Research Scientist, AI Computer Vision and Deep learning for Augmented Reality

Samsung Research America

2018 - 2021, Plano, TX

Senior Research Engineer, AI Computer Vision, Image/Video Processing for Flagship Galaxy Smartphone Cameras

Synthetic AI HDR

Sensor-realistic Synthetic Data Engine for Multi-frame High Dynamic Range Photography,

J Hu, G Choe, Z Nadir, O Nabil, SJ Lee, H Sheikh, Y Yoo, M Polley, IEEE Conference on Computer Vision and Pattern Recognition (CVPR) - Ntire Workhop, 2020


*intelligent Zoom

CLICK-AND-LOCK ZOOM CAMERA USER INTERFACE, G Choe, HR Sheikh, JS Lee, Y Yoo - US Patent App. 16/947,274, 2021

* Click-and-lock zoom patent has been technology transferred to Galaxy S21. This video is from Galaxy S21 Ultra: Untold Stories – Camera | Samsung "https://www.youtube.com/watch?v=PtzRsTzAijw"

AI Optical flow and Video processing

Two US patents regarding optical flow and video processing are under review, G.Choe etal - US Patent, Filed on 2021

Research at kaist & CMU

3D depth estimation and enhancement.

RAL 2017 - RANUS

RANUS: RGB and NIR Urban Scene Dataset for Deep Scene Parsing,

Gyeongmin Choe, Seong-heum Kim, Sunghoon Im, Joon-Young Lee, Srinivasa Narasimhan, and In So Kweon,

IEEE Robotics and Automation Letters (RAL), Feb. 2018


CVPR 2016 - NISAR

Simultaneous Estimation of Near IR BRDF and Fine-Scale Surface Geometry,


Gyeongmin Choe, Srinivasa G. Narasimhan, and In So Kweon,

IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2016. Spotlight

IJCV 2017 - KINIR

Refining Geometry from Depth Sensors using IR Shading Images,

Gyeongmin Choe, Jaesik Park, Yu-Wing Tai and, In So Kweon,

International Journal of Computer Vision (IJCV), Mar. 2017

ECCV 2016 - Deep NIR

Fine-scale Surface Normal Estimation using a Single NIR Image,

Youngjin Yoon*, Gyeongmin Choe*, Namil Kim, Joon-Young Lee, and In So Kweon,

European Conference on Computer Vision (ECCV), Oct. 2016.

TPAMI 2018 - Lf Depth

Depth from a Light Field Image with Learning-based Matching Costs,

Hae-Gon Jeon, Jaesik Park, Gyeongmin Choe, Jinsun Park, Yunsu Bok, Yu-Wing Tai, and In So Kweon,

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2018

TPAMI 2018- RS Depth

Accurate 3D Reconstruction for Small Motion Clip for Rolling Shutter Cameras ,

Sunghoon Im, Hyowon Ha, Gyeongmin Choe, Hae-Gon Jeon, Kyungdon Joo and In So Kweon,

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2018

Salient View Selection for Visual Recognition of Industrial Components, S Kim, G Choe, M Park, IS Kweon, IEEE RA-L, ICRA 2020

High Quality Structure from Small Motion for Rolling Shutter Cameras, S Im, H Ha, G Choe, H Jeon, K Joo, and IS Kweon, ICCV 2015.


Reflection Removal using Disparity and Gradient-Sparsity via Smoothing Algorithm ,

Tharatch Sirinukulwattana, Gyeongmin Choe, and In So Kweon,

IEEE International Conference on Image Processing (ICIP), Sep. 2015

A Taxonomy and Evaluation of Dense Light Field Depth Estimation Algorithms ,

O Johannsen etal.

IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) Workshop - Light Field for Computer Vision, Jul. 2017.

Depth from Accidental Motion using Geometry Prior ,

Sunghoon Im, Gyeongmin Choe, Hae-Gon Jeon, and In So Kweon,

IEEE International Conference on Image Processing (ICIP) [Top 10% paper], Sep. 2015.

Exploiting Shading Cues in Kinect IR Images for Geometry Refinement,

Gyeongmin Choe, Jaesik Park, Yu-Wing Tai, and In So Kweon,

IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2014.

Accurate Depth Map Estimation from a Lenslet Light Field Camera,

Hae-Gon Jeon, Jaesik Park, Gyeongmin Choe, Jinsun Park, Yunsu Bok, Yu-Wing Tai, and In So Kweon,

IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2015.



Educations

Ph.D, KAIST (Integrated master's and doctor's course) Feb. 2012 - Aug.2018

Computer Vision

Advisor: Prof. In So Kweon

Visiting Ph.D student, CMU Jul. 2015 - Dec.2015

Advisor: Prof. Srinivasa Narasimhan

B.S, KAIST Feb. 2008 - Feb.2012

Mechanical Engineering

Patents

CLICK-AND-LOCK ZOOM CAMERA USER INTERFACE, US Patent App. 16/947,274, 2021

Asymmetric normalized correlation layer for deep neural network feature matching, US Patent App. 16/712,882, 2020

METHOD AND APPARATUS OF FINE-SCALE SURFACE NORMAL ESTIMATION USING SINGLE NIR IMAGE, AND NEURAL NETWORK LEARNING METHOD

kr 10-2017-0112107 / Application date: Sep. 2017

APPARATUS AND METHOD FOR DEPTH MAP GENERATION

kr 10-1745493-0000 / Registration date: Jun. 2017

DEVICE AND METHOD FOR OBTAINING ACCURATE 3D INFORMATION USING DEPTH SENSOR AND INFRARED SHADING CUES

kr 10-1707939-0000 / Registration date: Feb. 2017

METHOD AND APPARATUS FOR ACQUIRING DEPTH MAP FROM ALL-AROUND CAMERA

kr 10-2016-0167525 / Application date: Dec. 2016

METHOD AND SYSTEM FOR ESTIMATING SURFACE GEOMETRY AND REFLECTANCE

kr 10-2016-0167526 / Application date: Dec. 2016


Reviewer

IEEE Transactions on Image Processing (TIP)

IEEE International Conference on Computer Vision and Pattern Recognition (CVPR)

IEEE International Conference on Robotics and Automation (ICRA)

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR)

Asian Conference on Computer Vision (ACCV)

Computer Vision and Image Understanding (CVIU)

Computational Visual Media Conference (CVM)

Computer Science and Application Engineering (CSAE)

Awards

- Grant, ICCV Doctoral Consortium, Venice, Italy, Oct. 2017

- Depth estimation challenge: robustness champion, CVPR workshop on Light Fields for Computer Vision, Jul. 2017 [Prize]

- Best Poster Presentation Award, IPIU 2017, Korea, Feb. 2017 [Prize]

- Best Poster Award, The 11th IWRCV, Korea, Dec. 2016 [Prize]

- Grand prize (1st place), BK 21 plus overseas study report competition, KAIST, Jul. 2016 [Prize]

- Best Poster Award, The 10th IWRCV, China, Nov. 2015 [Prize]

- Official Best 10% Paper Selection, ICIP 2015 Organizing Committee, Sep. 2015

- Oral presentation, The 9th IWRCV, Japan, Dec. 2014

- Certificate, International Computer Vision Summer School (ICVSS 2014), Sicily, Italy, Jul. 2014 [Certificate]

- Silver prize (2nd place), 20th HumanTech Paper Award, Samsung Electronics Corp., Feb. 2014 [Prize]

- Student volunteer, Asian Conference on Computer Vision (ACCV 2012), Daejeon, Korea, Nov. 2012

- Full scholarship, KAIST, Feb. 2008 ~ Feb. 2012

- Scholarship, Samsung Electronics Corp., Feb. 2008

- Silver Prize(2nd place), 13th HumanTech Paper Award, Samsung Electronics Corp., Feb. 2007