Using ipywebrtc using raw byte datastream

[sunilkpai]

Hi, I have an application where I want to have video streaming and snapshot taking ability, but the source of the data is an external camera with a C++ sdk (which I converted to Python using ctypes) rather than a webcam. Assuming I know image size and the data is 16-bit unsigned integer, how would I use ipywebrtc to stream this raw data?

I like the ability to have a videostream in the background (for example, in an output view in JupyterLab) while processing snapshots of the video stream in the notebook itself. My core issue is that the data is being streamed from a URL through proprietary frame grabbing code to a numpy array. I'm not sure if there is a way to turn this into a streaming object in the background that can be processed in later cells based on snapshots taken when those cells are run?

[maartenbreddels]

I wonder if the best way here is to expose the camera via https://github.com/aiortc/aiortc and connect the browser to it somehow. Would be a great experiment.