I'm a senior in high school and this year I have to do a project for my electronic class, I was hoping to get some advice from people with some experience. My idea is kind of complicated and has a lot of different sensors but not too crazy, the problem begins with possible image processing. I have a camera who need to check for flashing light and send the video to a screen without the frames of the flashing (like just skipping the frame, so the video is always a frame in delay but the person won't notice it). The fashing light is supposed to be like in a party or in a video game you get a warning on. The idea is to notice the extreme changing of lighting and to not show it on the screen. My teacher is afraid that doing image processing might be too complicated and video processing as well... I don't have any knowledge in it, and I have a little background in Python and other languages, do you think it is possible? Can anyone give me an advice or a good video/tutorial to learn from? Thank you in advance:)

CodePudding user response：

your probleme if quite diificult, cause it envolved unknown environnement in a dynamic time range.

if you admit as an axiom that your camera has for exemple a frame rate of 20 FPS, the chances that your difference between Frame f' and next frame f 1 are quite low.

UNLESS you have a huge color change du to ligth flash, So you can process with an image similarity such as ssim or psim https://www.pyimagesearch.com/2017/06/19/image-difference-with-opencv-and-python/

if your image is over a certain treshold that you have to define ( can use also a kalmann filter to dynamically reajust the difference treshold)

so it will probably mean that your flash light is on.

CodePudding user response：

Although it's a visual coding program (per se), Bonsai is a great open source software for doing what's in your description; as well, Bonsai supports applications that require combinations of different hardware (e.g. microcontrollers, cameras) and software components (e.g. Python).

To provide a similar application as an example, I have setup a workflow where Bonsai captures images sent from a Basler camera, it processes the input video frame-by-frame, and when it detects, within the cropped frame (that I cropped around an red LED), a threshold change in pixel intensity (i.e. the red LED turns ON or OFF), it sends an output signal (i.e. 5 volts) to an Arduino microcontroller while saving the image frame as a png file as well as a avi video file along with a vector of True/False (corresponding to the ON or OFF red LED frames) and corresponding timestamps that are saved as csv files, etc. Although this isn't identical to what you've described, I'm sure you can setup a similar Bonsai workflow to accomplish your goal.

Citation: https://www.frontiersin.org/articles/10.3389/fninf.2015.00007/full