Kinect Development - University of Wisconsin-Platteville

Kinect Development - University of Wisconsin-Platteville

Kinect Development By: Richard Isely III Outline What is the Kinect History How it started

Microsoft Project The Components of the Kinect What they are/How they work Development Issues Solution Hacking the Kinect

OpenKinect Microsoft SDK Demo What is the Kinect? Image from: http://uncrate.com/p/2010/11/kinect-xl.jpg

History It all started with the Wii Moores Big Plans Project loses momentum Project Natal Alex Kipman takes over project

PrimeSense Chosen to Create Prototype Demo for Executives Components of the Kinect Image From: http://guide-images.ifixit.net/igi/xKZqFJXNYEGTvYbI.medium Components of the Kinect

Major components IR Projector IR Camera VGA Camera Microphone Array Motorized Tilt Image From:

http://www.everybodyplays.co.uk/images/screenshots/picsforarticles/kinec g VGA Camera Allows the Player to be shown on screen. Take still shots. Microphone Array

Four Microphones Position Detection Noise Cancelation http://social.microsoft.com/Forums/getfile/18629/ Microphone Array (Development Issue)

Voice Recognition Background Noise Various Accents Microphone Array (Solution) Background Noise MSR Team develops Audio processing

Solution Audio Processing Tricks Various Accents Acoustical Model built into the Array Motorized Tilt Built into the base of the Kinect

54 Degree tilt range 27 Degrees up 27 Degrees down Records Actual angle of Kinect IR Projector and Camera (Depth Sensor)

Whats being projected Time of Flight How the Kinect does it Image From: http://bbzippo.files.wordpress.com/2010/11/dsc00014s_thumb.jpg?w=700&h=528 IR Projector and Camera

(Depth Sensor) Continued ps1080 Chip What it produces Depth Image Image From: http://www.primesense.com/images/technology/Chip_Diagram.gif Using the Depth Image

Pixel Data 16-bit number Depth Data Given in millimeters Player Data Range 0-6

Depth Image (Development Issue) Initializing Recognition Losing Player Mid-Game Body Type Issue Depth Image (Solution)

Breaking up the data From 1 Blob to 31 body parts Body parts to joints Joints to Skeletal image Decision Tree Depth Image

(Solution) Depth Image (Solution) Hacking the Kinect Race to create a driver Bounty set

Cracked in 7 days OpenKinect PrimeSense Releases Libraries Microsoft SDK First Release (June 17th, 2011) Skeletal Recognition

Voice Recognition Beta Version Latest Release and new Kinect Near mode Commercial Development C++, C#, and VB

Demo Conclusion What the future may hold Possible Application Cheap form of motion detection Commercial Availability

Sources [1] Ashley, James and Jarrett Webb. Beginning Kinect Programming with the Microsoft Kinect SDK. Apress, 2012. [eBook]. [2] Hall, Jonathan, Sean Kean, and Phoenix Perry. Meet the Kinect: An Introduction to Programming Natural User Interfaces. Apress, 2011. [eBook] [3] Borenstein, Greg. Making Things See: 3D vision with Kinect,

Processing, Arduino, and MakerBot. Make, 2012. [eBook] [4] Kinect for Windows. Microsoft Support. Sat. 10 Mar. 2012. Sources (continued) [5] OpenNI. PrimeSense. Sun. 11 Mar. 2012.

[6] About PrimeSense. PrimeSense. Sun. 11 Mar. 2012. [7] OpenKinect: About. OpenKinect. Sat. 17 Mar. 2012 [8] Kinect for Windows Quickstart Series. Channel9. By:

Dan Fernandez. Sat. 17 Mar. 2012

Recently Viewed Presentations

  • Chapter six - missstott.weebly.com

    Chapter six - missstott.weebly.com

    says that he wants to die as himself. "I don't want them to change me in there. Turn me into some kind of monster that I'm not…I keep wishing I could think of a way to…to show the Capitol that...
  • Sybex CCNA 640-802 Chapter 13: IPv6 Instructor &

    Sybex CCNA 640-802 Chapter 13: IPv6 Instructor &

    Instructor & Todd Lammle Chapter 13 Objectives The CCNA Topics Covered in this chapter include: What is IPv6? Why do we need IPv6? IPv6 Addressing Address types Special Addresses Autoconfiguration Configuring IPv6 Tunneling * What is IPv6? People refer to...
  • The Reagan and Bush Years Chapter 25 1980

    The Reagan and Bush Years Chapter 25 1980

    A.) America a nation ready for change in 1980 Low Spirits People lacked confidence in government. The turbulent 1960s, Watergate, the Soviet invasion of Afghanistan, the Iranian hostage crisis, and long gasoline lines put Americans in an uneasy mood. Critics...
  • e AP5 Lean Manufacturing Broken Capillary Tubes Team

    e AP5 Lean Manufacturing Broken Capillary Tubes Team

    Team Members: Blake Samic Brent Adams Dan Healy Chris Kantus Chad Linville Aaron Frees Advocacy Team: Kyle Minnick - Mentor Thiago Tognetti- Mentor
  • Systems Engineering Mike Pryzby Swales Aerospace August 16-17,

    Systems Engineering Mike Pryzby Swales Aerospace August 16-17,

    1553 for low speed, Spacewire for high speed interfaces. USO part of bus C&DH. Ka. Dedicated Primary at WSMR. Direct Injection Fuel Budget Baselined. Data Storage. SRR or Hard Drive. USO in bus or LOLA instrument. Mono Prop vs Bi...
  • DECEMBER 2019 PARLIAMENTARY ELECTION AGENTS BRIEFING 18 November

    DECEMBER 2019 PARLIAMENTARY ELECTION AGENTS BRIEFING 18 November

    Margaret Reed is the Acting Returning Officer for the Henley, Oxford West and Abingdon and Wantage constituencies. The Electoral Registration Officer is responsible for maintaining the registers of electors and absent voters lists. Margaret Reed is also the Electoral Registration...
  • Science Underpinning Restoration

    Science Underpinning Restoration

    We better be! New and re-invigorated Restoration efforts. HREP Restoration Plan (Dan Miller) TNC Re-start of Army Corps process (Andy Peck) New potential funding streams
  • Africa - West Linn-Wilsonville School District

    Africa - West Linn-Wilsonville School District

    Soc. & Eco. Opportunities. Humanitarian. Reasons. European. Racism "White. Man's. ... The Dutch started a colony at Cape Town in 1652 to supply their ships going to Asia. Starting in the 1800s, the British take an interest in South Africa....