I am wondering if anyone is working on making a library to connect Kinect with Pure Data.

I know there is already a Proccessing library out - so I imagine one could connect the kinect to Proccessing and then connect Proccessing to PD through OSC

Problem is that I have Windows 7 and the Proccessing library for W7 isnt out yet.

If anyone is experimenting with this and has gotten somwhere I would be interested in hearing about it.

Best regards

So I got Tuio Kinect + Pd working last night... proof of concept here:

Very cool =) Are you willing to share you patch?

of course... this is a Pd forum, isn't it ?!?!

pretty simple though...

Tuio Kinect ( https://code.google.com/p/tuiokinect/ )

Tuio Pd Client ( http://www.tuio.org/?software )

worked right out of the box! (though i had libfreenect installed already...)

I just cleaned it up and added some oscillators...

but here it is...

EDIT attachments dont seem to be working right now... will try later

EDIT ... there it is. Didn't realize I had to compress it....

http://www.pdpatchrepo.info/hurleur/kinectCam.pd.zip

hey,

never tried TUIO, but i have osceleton working on my macbook pro really smooth. you get x, y, and z for each articulation of each user, in OSC to use directly in pd. follow this tutorial and it should work in a few hours. any questions ask me

http://tohmjudson.com/?p=30

cheers

funny, im building libusb as i write this (saw the post off of CDM)...
will let you know if i hit any snags...

sure, good luck .... i had trouble with macports and had to install homebrew. tell me if anything

install went fine (already had macports...).
got the processing examples working...
haven't tried sending osc to Pd yet, but that should be trivial.

thanks!

im running NITE (openNI) for the skeleton tracking on ubuntu 10.10
worked like a charm after making a fresh linux install.
for sending osc coordinates to pd, i use osceleton from sensebloom.

More informations, here :
https://github.com/Sensebloom/OSCeleton

Pure Data examples :
https://github.com/pd-projects/pd-kinect-skeleton/

My note about the installation :

Install - OpenNI
http://www.openni.org/downloadfiles/openni-binaries/20-latest-unstable

Install - SensorKinect - hack avin2
https://github.com/avin2/SensorKinect

Install - Nite
http://www.openni.org/downloadfiles/openni-compliant-middleware-binaries/33-latest-unstable

Install - OSCeleton
https://github.com/Sensebloom/OSCeleton

Exemples Pure Data et OSCeleton
https://github.com/pd-projects/pd-kinect-skeleton/

./osceleton -mx 2 -my -2 -mz -1 -ox -1 -oy 0.75 -oz 1

Attention avec Nite on peut avoir une erreur du type :
error CS0006: cannot find metadata file `System.Windows.Forms.dll'

Il faut installer alors :
sudo apt-get install libmono-winforms1.0-cil libmono-winforms2.0-cil

Regarder le readme dans le package d'avin2 car il donne quelques conseils assez judicieux

hey here are vids of me using kinect with pure data. first results, but it's getting there. if you want to use my patches or need help with installation or anything, let me know

gab

Gab_lecup,

I would gladly ask for some examples and or installation help. I am just trying to get into kinect with PD and it is a hard beginning. What I am looking for is a solution to control music or video without standing in front of kinect for couple seconds in an unnatural position like with synapse or processing skeleton stuff.
Thanks for advance:

Popesz

hello,

for an installation help, if you're on mac, try this great tutorial:
http://tohmjudson.com/?p=30
i found homebrew to work better than macports. the final step is for max/msp, but same logic in pd~.
i'd be glad to send you an example patch, it just depends on what you're looking for. anyways if you're going to use squeleton tracking you're going to have to do the calibration pose for a few seconds, so that won't help you ...
tell me if you want a patch anyways, or just how to receive the osc message in pd~.
good luck

gab

popesz,

If you're on windows, take a look at this program: http://jordanrs.blogspot.com/2011/08/maxmsp-to-kinect-via-osc-for-offical.html

It's for sending OSC to Max using the Kinect for Windows SDK. I think in the comments there is a link to a version that has been rewritten for the latest SDK version, v1. I find that it tracks quicker than OSCeleton and doesn't need 'the pose' either. The next version of the SDK is supposed to have better tracking again so this may improve in the future.

I've recreated his Max patch in pd which you can find attached.

I'm currently working on a patch to convert the OSC to MIDI but I'm not very good with pd so it's taking quite a while and may not be perfect. I'll upload it when it's more done.

http://www.pdpatchrepo.info/hurleur/Kinect_For_PD.rar

gab,

I would like to see your patch(es).

kinetec

ok here is the patch.
this is to receive the osc from OSCeleton, denormalise it, and extract individual parameters to describe movement. it'd take a while to explain each parameter, so i'll do it if you ask.
hope this helps, tell me if you use it i'd be curious.
cheers

http://www.pdpatchrepo.info/hurleur/DemoPatch1.pd

hi, i'm working on windows and after all these links I still did not really udnerstand if there's a library or some way to implement kinect with pure data..can you explain me how to do it and what I need please?

thank you

L.

hey there,
ok i'm on mac, using OSCeleton to translate kinect data to osc. i followed this tutorial (sureley it's easier on pc): http://tohmjudson.com/?p=30
once you have osc running download my patch and it should work...

thank you
ok so I can follow it also on a pc? also that link is about Max..is it working the same for pd? then what about cnmats object?

Thank you for your time