DSW Vision 2 'Flow alpha' (currently macOS only)

Hi there!
Here is my little plugin

VCV Vision plugin (currently macOS only)

AML Ambient Light Voltage module

Outputs voltage based on Ambient Light Sensor in Mac computers. (do not use camera)

I have an idea to make another module based on OpenCV, basically you will be able to control multiple voltages by waving multiple color blobs in front of a camera, lol :smiley:

6 Likes

Argh, my poor rails! I won’t be able to sleep until you make the screws line up with the mounting holes.

(Cool idea, by the way. :slight_smile: )

1 Like

Just tried it on my iMac and it does work. First time I’ve played notes on a synth by waiving my hands in front of the camera :smile: I do need to dial the Scale knob to the extremes though. It gave me an idea: There must be a ton of sensors on any modern PC, that you can tap into to generate values (and so, voltages). Thermal output came to mind, hint hint, nudge nudge…

Will you submit this to the Plugin Manager?

2 Likes

Haha! Now it’s time to buy yourself an Arduino with light sensor for it, Lars!

Just imagine: you’re opening heavy VCV patch, cpu starts to heat up and controlling some LFO by that for example… Isn’t that cool?

1 Like

Opencv working within rack.

Implemented prototype in python, current idea ‘Flow’ is deriving four magnitude movement directions from camera, python prototype sends it over CoreMidi to Rack.
On my machine I get really low FPS with python.
C++ with OpenCL should improve performance, but I have been struggling to port python prototype over.

Prototype for interested

I have been working on new module.
It is called Flow. Like https://en.wikipedia.org/wiki/Optical_flow
Using OpenCV and web camera it is able to extract vectors describing motion.

Can someone test if it works at all? :smiley:

https://github.com/diimdeep/DSW-Vision/releases/download/2.0alpha1/DSW-Vision-Flow.alpha1.zip (macOS only!)

Warning. Early alpha, expect memory leaks, crashes.

2 Likes

Might we be able to give it any video feed - like a file?

1 Like

Link is dead and i can’t build module right now.
I have opencv4 installed via brew. Maybe i need another version?

This is the end of ‘make’ command:

...
clang: **error:** no such file or directory: 'dep/lib/opencv4/3rdparty/libittnotify.a'
clang: **error:** no such file or directory: 'dep/lib/opencv4/3rdparty/libippiw.a'
clang: **error:** no such file or directory: 'dep/lib/opencv4/3rdparty/libade.a'
make: *** [plugin.dylib] Error 1

Yes, but didn’t tried to implement this.

1 Like

Oops, here it is https://github.com/diimdeep/DSW-Vision/releases/download/2.0alpha1/DSW-Vision-Flow.alpha1.zip

I didn’t want to ask users to install something separate.
So I decided to roll my own built script and I decided on static linking.
But homebrew prebuilt opencv has too many extra dependencies and too much to link.

There is built script for opencv

cd dep
make dep
cd ..
make

It’s better to put the build scripts in the root Makefile so you can run make dep as normal instead of running an entirely different Makefile.

2 Likes

Thank you so much for this fantastic module, one of the top three Vcv modules. Works like a charm here… It replaces my D-Beam modulations from the last ten years. Thank you again!!!

Is there a V1 version possible?

Are you still working on this by any chance? I am working on a little project that might require me to integrate OpenCV to VCV, and I was hoping somebody had figured it all out before me (making it build properly for every OS seems like a daunting task, haha). I took a look at your repo - just knowing that it’s feasible is going to save me a lot of work!