Skip to content

This is an android application that gets the depth map of an image. It gets the perspective and distance of objects from the focal point using AnyNet.

Notifications You must be signed in to change notification settings

mmarxe/Real-Time-Image-Depth-Mapping

Repository files navigation

Real-Time Image Depth Mapping

This is an adaptation of the AnyNet Deep Learning Model approach to create real time depth maps from mobile devices using CameraX and PyTorch-Lite.

Installation

Download source code and open it using Android Studio and run.

git clone https://github.com/macsakini/Real-Time-Depth-Map-Application/tree/main

Model

This implementation has been done on android and it used PyTorch lite model (PTL format). For other platforms, we have attached other model formats including TensorFlow, TensorFlow Lite and ONNX. The training notebook has also been included and is available from this link:

Model Notebook and Implementation.

Other Model Formats.

TensorFlow, TF-Lite and ONXX Formats.

Demo

drawing

Future Implementations

  • Frame Rate CountdownLatch Implementation.
  • Frame Rate processing Optimisation using threads.
  • Android GPU adaptation.
  • Buffering capabilities.
  • Background processing.

Citation

@article{wang2018anytime,
  title={Anytime Stereo Image Depth Estimation on Mobile Devices},
  author={Wang, Yan and Lai, Zihang and Huang, Gao and Wang, Brian H. and Van Der Maaten, Laurens and Campbell, Mark and Weinberger, Kilian Q},
  journal={arXiv preprint arXiv:1810.11408},
  year={2018}
}

About

This is an android application that gets the depth map of an image. It gets the perspective and distance of objects from the focal point using AnyNet.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published