Hello,

I'm trying to understand how to convert a range of pixels (from a picture or a video) into sound. The sound doesn't need to be complex for now, just an oscillator would fit.

My idea is to make a big zoom on a part of a video (left top corner), progressively the frame of the video is moving to the right top corner, after it turns to the bottom. And so on. Each time, the frame encounters new pixels, it converts it in a sound.

Any ideas, suggestions, objects I could use? Using video in PD is quite new to me...

Many thanks:)

well, there is the tried and tested 'metasynth' way of using the vertical axis for pitch, the horizontal axis for time, the brightness for colour, and then i think there were some more esoteric options like the amount of red being routed to filter cutoff, the amount of green to delay feedback, etc.

as far as actually getting these details out of image, i have very little experience, but i reckon if you just have a bit of a read through the GEM documentation, you'll probably find what you're after.

ok, metasynth seems to be a good begin. I'll try this now.
Thanks

it's propriety software, but you can maybe find a free copy of the user's manual or something and get a bit of an idea.

i once had a free copy that a friend must have installed on my mac while i was sleeping or something

Someone has accomplished something similar using gridflow http://puredata.hurleur.com/sujet-4836-read-image-picture-file . I've tried running it using a video file and it still seems to work

In gridflow also take a look at the [#in] object as it can accept data that doesn't have headers (raw data) e.g. [#in grid myfilename.zzz, headerless, type s]

@BenStrongExotic If you want to know what is going on with compression and data rates in your audio/video files I would recommend https://mediaarea.net/en/MediaInfo/Download It allows you to right-click select for a complete analysis.
Looking at the information side-by-side with the original file will show you why the file size has changed.

The best conversion tool I have found is free, so no crack required....... http://www.squared5.com/.... Although it is a bit old it still copes with most formats..... and can strip audio, resample video to fixed frame-rates etc.
David.

@JerrySmith1021 The software you proposed looks great, but costs. I mainly use pd to capture sounds from the soundcard using soundflower for routing. Allways a bit of a hustle though. To extract sound from Video i found that http://www.aunsoft.com/video-to-audio-converter-mac-free/ is a great tool, because of the eas' of use and the speed.

Moderators might note that BenStrongExotic, Piggy, JerrySmith1021, rhusff, sahrenity, and JAMES77 have posted only about video conversion software -- no post history about Pd itself.

So I believe this thread has now morphed into a spam thread about unrelated software. There are millions of places online with better information about video formats and conversion, and no reason why it's at all germane to this forum. Probably the last several posts should be deleted (and maybe lock this thread).

hjh