I've been wondering about using kinect to play music. It would track your hand positions and depth to control the tone and volume respectively. If you raise your hand to the top right, you'd get the highest note; lowest left produces the lowest.
To answer your question, yes it is possible to get Image and depth on the raspberry pi!Here is how to.If you want to use just video (color, not depth) there is already a driver in the kernel! You can load it like this: modprobe videodevmodprobe gspcamainmodprobe gspcakinectYou get a new /dev/videoX and can use it like any other webcam!If you need depth (which is why you want a kinect), but have a kernel older than 3.17, you need another driver that can be found here:. If you have 3.17 or newer, then librekinect functionality is enabled by toggling the gspcakinect module's command-line depthmode flag: modprobe gspcakinect depthmode=1Both work well on the current Raspbian. If you can manage to plug your kinect camera to the raspberry Pi, install guvcview first to see if it does works.
Sudo apt-get install guvcviewThen, type guvcview in the terminal and it should open an option panel and the camera control view. If all of that does works and that you want to get the RAW data to do some image treatments, you will need to compile OpenCV (it takes 4 hour of compiling) and after that, you just will need to program whatever you want. To compile it, just search on Google, there are lots of tutorial. Well, as far as I know there are no successful stories about getting images from Kinect on RaspberryPi.On github there is an in libfreenect repository about such problem. In user zarvox say that RPi haven't enough power to handle data from Kinect.Personally I tried to connect Kinect with RPi using and, but have no success.
And that was not a clever decision because it's impossible to work with Microsoft Kinect on Linux using OpenNI2 due to (Well, actually it is not so impossible. You can use + OpenNI2 on Linux to hookup Kinect.
But anyway this workaround is not suitable for RaspberryPi, because OpenNI2-FreenectDriver uses libfreenect).But anyway there are some good tutorials about how to connect to RaspberryPi:,. And how to connect Kinect to more powerfull arm-based CubieBoard2:.
If you intend to do robotics the simplest thing is to use the Kinect library on ROSOderwise you can try OpenKinect, They provide the libfreenect library that let you acess to the accelerometers the image & much moreis a good exemple with code & all the details you need to connect to the Kinect & operate the motors using libfreenect.You will need a powered USB hub to power the Kinect & to install libusb.A second possiblity is to use the library which provides a SDK to develop midleware libraries to interface to your application there is even an OpenNi lib for processing.