InShape is a Miro plugin which uses image processing and OCR for converting a PNG/JPEG diagram into coloured shapes and text.
This is not real-time. Processing this image takes ~7 sec.
The three main features are
- shape recognition i.e. get a Region of Interest (ROI) and compute surface ration
- color extraction i.e get the RGB histograms from the ROIs and extract most dominant color
- optical character recognition (OCR) i.e. send a ROI to Tesseract.js and voilà !
See here.
