By: Blaze Sanders Commercial Space = “New Space” 10/15/2011.
Space by Space
-
Upload
jennifer-wong -
Category
Documents
-
view
223 -
download
0
description
Transcript of Space by Space
![Page 1: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/1.jpg)
Student: Jennifer Wong Advisor: Kris Mun
Interactive Spaces and Technology:
& a guide to working with the kinect.
2012SpS
b
p a c e
y
S p a c e
![Page 2: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/2.jpg)
Interactive Spaces and Technology:
Connecting people through Physical Social Interaction and Virtual Space
![Page 3: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/3.jpg)
table of contents
:: project introduction
1
:: research
10
:: technology “how to”
12
:: conclusion
13
![Page 4: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/4.jpg)
![Page 5: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/5.jpg)
project introcutionreason
#storefronts #vacancy # urban_street_scape #urban_development #kinect #virtual_spaces #tangibility
![Page 6: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/6.jpg)
proposal brief Vacantstorefrontsarebecomingincreasinglypressing
problems,especiallyintoday’seconomicclimate.Astudydoneby
theReitveldAcademyinTheNetherlandsareidentifyingthatagood
numberofstorefrontsandretailspacesaroundtheworldarebeingleft
uninhabitedduetohighrentalratesandalessenedneedforaphysical
shoppresence.Manybusinessesareforcestoshutdownbecauseofa
lackofsalesduetonotonlyadownedeconomy,butalsoadecreasein
foottrafficinurbanareas.
Urbanareasareslowlyfadingbecauseofanincreaseinonline
communicationandmediaculture.AsWilliamMitchellnotedinhis
article,E-Bodies,themovementtotheweballowsforplaceandtime
AdressedupstorefrontwindowintheUKusedasawaytochangethestreetappearancetolookmorelivelyafteramajorityofthestoresclosed.
![Page 7: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/7.jpg)
tobecomeincreasinglyunlimited.Moreindividualsarespendingtime
online,socializing,workingandpurchasingathome,andspending
moretimeentrenchedinthedigitalworldviatheirmobiledevices.
Walkingdownthestreets,youcanfindmultiplepeoplestaringdown
attheirdigitalcommunicationdevicesoversocializingwithindividuals
aroundthem.
Thisprojecthopestotakeadvantageoftheembeddedideaof
technologyinourlivesanduseittore-vitalizetheurbanstorefronts.By
takingthesevacantstorefrontsandinfusingthemwithcommunication
andinteractiontechnology,wecanturntheseabandonedspacesinto
atactilemodernvirtualspaceforsocialization.
Thisprojecttakesalookathowthenewandfuturetechnology
oftheMicrosoftKinectand3DProjectionHolographictechnologycan
createanimmersivesocialexperience.Thesedigitalspaceswillbe
linkedtoavirtualnetwork.Individualscanoccupythesevirtualsettings
andbecause‘virtualized’.A3Drepresentationofthemandanyother
individualsonthenetworkwillbebroadcastedoutsothatthesame
ThenumberofclosedandvacantstoresinNewYorkCity,thenumbershavebeensteadilyrisingthroughouttheyears.
![Page 8: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/8.jpg)
socialgatheringcouldappearallaroundtheworldatthesametime,
bridgingspaces.
Anetworkofaudioandvisualsensorswillvirtualizeanindividual
andconnecttheminamoresocialandhumanisticwaycomparedto
themorecommononlinecommunicationssuchasChatRouletteand
SmallWorld,aFacebookapp.Individualswouldmeetinasocialsetting
intheirrealphysicalforms;beabletointeractwitheachother;and
manipulateeachothers’physicalspaces,creatingaphysical-virtual
socialexperience.
ThroughtheuseofthecapabilitiesofaKinect,aimagemapped
3Dmodelcanbecapturedandprojectedonasurfaceasa3Dimage.
Thenthroughtheuseofaudiosensorsanddevices,conversations
canberelayedthroughthenetworkinthesamemediumtheywere
delivered.Thenetworkofspaceswouldsimulateasingularroomwith
multipleindividualspresent.Theintentionistocreateatactileand
physicalvirtualsocialinteractionthroughthemergingofthephysical
andvirtualspheres.
![Page 9: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/9.jpg)
![Page 10: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/10.jpg)
diagram
![Page 11: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/11.jpg)
![Page 12: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/12.jpg)
** Idea:
To make the newly vacated spaces a space for social gathering among people from aroun the world. Reclaiming the urban street facades as areas that will be the beginning the engagement and communication with people from around the world.
Amsterdam Los AngelesShanghaiNew York
Virtual Enviornment in retail space connected on a worldwide network
idea diagram
![Page 13: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/13.jpg)
** Idea:
To make the newly vacated spaces a space for social gathering among people from aroun the world. Reclaiming the urban street facades as areas that will be the beginning the engagement and communication with people from around the world.
Amsterdam Los AngelesShanghaiNew York
Virtual Enviornment in retail space connected on a worldwide network
![Page 14: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/14.jpg)
composite
![Page 15: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/15.jpg)
![Page 16: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/16.jpg)
![Page 17: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/17.jpg)
new technology
research
#kinect #holographic_imaging #head_tracking #hand_tracking #projection_techniques
![Page 18: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/18.jpg)
“TheprototypeforMicrosoft’sKinectcameraandmicrophonefamouslycost$30,000.AtmidnightThursdaymorning,you’llbeabletobuyitfor$150asanXbox360peripheral.”
Camera TheKinect’scamerausesbothhardwareandsoftwaretogeneratetwodifferenttypesofimages.1:3DmovingimagescapturedbydepthsensorsusingreferencepointsthataremappedintothephysicalspacebytheKinect.TheKinectusesinfaredsensorssothatlightdoesnotaffectthe3Dimageproduced2:2Dimagesofthefieldofviewcapturedbyacamera,thatcanbelatermountedonthe3Dcapture
Firmware TheKinectusesalgorithmstoprocesstheincomingdatacaptured
Microsoft Kinectoverview
![Page 19: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/19.jpg)
throughitsinfaredsensorstotranslatethedataintoa3Dmodel.Thisfirmwarecanalsodistinguishhumanbodiesthroughparts,joints,movement,andevenfaces. ThisishowtheKinectdistinguishestheinformaitonitrecievesinordertoreactappropriatelywhentherightgesturesaregiven.
![Page 20: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/20.jpg)
ProducedbyArsTechnica:
TheKinectforWindowsSDK,abetaversionofwhichisalreadyavailabletodevelopers,isbeingpreparedforacommercialrolloutinearly2012.
Thecurrentbetaversionistargetedatacademics,enthu-siasts,andresearcherswhousethemotion-sensingcapabilitiesoftheKinectforXbox360technologytocreatenewapplications.Kinectappshavealreadypoppedupinhealthcare,education,andotherindustries,Microsoftnotedinanannouncementtoday.Despitebeingdesignedforvideogames,theKinect—whichhas600patentsbehindit—hasmovedbeyondthegamingworldbothbecauseofitsusefulnessanditsprice:theKinectletspeoplebuyadevicewith3Dmotioncapture,facialandvoicerecognition,microphones,depthsensors,andanRGBcamerafor$149.
Whilethesoftwaredevelopmentkitreleasedearlierthisyeartargetsnon-commercialprojects,Microsofttodaysaid“theKinectforWindowscommercialprogramwilllaunchearlynextyear,givingglobalbusinessesthetoolstheyneedtodevelopapplicationsonKinectthatcouldtaketheirbusinessesandindustriesinnewdirec-tions.”Microsoft’sannouncementdidnotdetailthetermsunderwhichtheKinectSDKwillbereleasedcommercially.
Microsoftofficialsalsodiscussedtheforthcomingcommer-cialSDKwiththeFinancialTimes,whichdetailstheMicrosoftpilotprograminvolving“morethan200companiesforuseoftheKinectacross25industries,fromhealthcaretoeducation,advertisingandtheautomotiveindustry.”
Forexample,Toyotadevelopedavirtualshowroomallowingcarstobeexploredwithgestures,andaSpanishtechnologygroupcalledTedesysisusingaKinectdevicelinkedtoaPCandmoni-tor,allowingsurgeons“towavetheirwaythroughpatientrecordsonscreenduringoperations,”theFinancialTimesnotes.Microsoft
Microsoft KinectSDK for windows article
![Page 21: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/21.jpg)
XboxofficialAlexKipmantoldthepaper“12monthsfromnow,edu-cational,academicandcommercialapplicationswilllooknothinglikewhattheyaretoday.”
TheKinectforWindowsSDKbetaincludesdrivers,APIsforrawsensorstreamsandhumanmotiontracking,alongwithmorethan100pagesoftechnicaldocumentation.Itistargetedatdevel-operswhouseC++,C#,orVisualBasic.KinectapplicationsaredesignedtobeusedinconjunctionwithWindows7,andpresum-ablytheforthcomingWindows8willreceivethesametreatment.
------
TheindustrystandardofusingtheKinecthasincreased.ThepoweroftheKinectisslowlystartingtobeutilizedandintegratedintoalldifferentfields.
![Page 22: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/22.jpg)
Holographic projection
programming4fun--YouTube
![Page 23: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/23.jpg)
head tracking
JohnnyLee(johnnylee.net)
Johnnyhascreatedaprogramthat’sapieceofcodefordevel-operstoworkwithusingC#DirextX.Thesoftwareneedstoknowyourdisplayandsensorbarsizeandwillhelptrackthemotionofyourheadasyouweartheglasses.
Hisinstructions:
1.ConnectyourwiimotetoyourPCviaBluetooth.Ifyoudon’tknowhowtodothis,youcanfollowthistutorial.I’vebeentolditworkswithotherBluetoothdrivers,butIhavenottestedthemmyself.2.DownloadtheWiiDesktopVR(v02)sampleprogram.ReadtheRE-ADMEfileonprogramusageandconfiguration.Launchthe“WiiDesk-topVR.exe”inthemainfolder.Apotentiallymorestable/Vista/64-bitcompatibleversionhasbeencreatedbyAndreaLeganza.Therealsomaybemorevariantsontheweb.
TheCodeisbuiltupontheWiimotelibrary.
>Canusetheideaofstereoscopicdisplayswhenlookingatthescreenwiththeuseofshutter/polarizedglasses.Thisworksbetterwiththeheadtrackingsothatyougetasenseoftherealdepthandthechangeintheperception.
![Page 24: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/24.jpg)
1. Technical stuff: Kinect.
>>fortheKinect,thelocationbechangedtoacornerasopposedtohavingthemasastraightonshotwhichwillprovidebetter3Dimagingtobeused.Thatwiththeuseofsomeothersoftwareandopenwareprograms,Iwouldbeabletocreatehandlesina3DenvironmenttomovetheKinectcaptured3Dmodel.
Tocreatea3Dobjectthatcanbemanipulated,Ishouldtrytheprojectionofthecompilationonablackperforatedscreen.OnecatchwouldbethatIwouldneedaprojectorwithahigherluminoutputtoaround3,000fromthenormal<2,000thatmostprojectorsget.Theincreaseincontrastratiowillmaketheshadowsappeardarkerthanifitweretobeprojectedontoascreengivingabetterfeelingofthedepthofanimage.
Project addition
![Page 25: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/25.jpg)
2. Moveable floor.
>>ideaofthefloorbeingmadeupofindividual3dimensionalpixels,alsoknownasvoxels.Thesevoxelswouldcontaininformationandberesponsivetotheindividualsinvolvedinthecommunication.Thesevoxelswouldnotonlybeabletobemanipulatedbetweentheusersasaninteractionpiece,suchasmovingpiecesupanddown,changingcolorsorwavesthroughtheroom,butthesevoxelswouldbeabletobemanipulatedsothatseparateroomsandspacescouldbecreatedformoreprivateconversations.Theconstructionofspacesinthegivenareaiscompletelyleftopentotheindividualswithintheroom.
3. Sound.
>>twosolutionstothesounds,bothofwhichprovidesoundtosuchanamazingquality.Hedescribedthetwotypesofspatialaudiothatisavailable,wavefieldsynthesisandambisonics.Wavefieldsynthesisisasingularlongspeakerthatisabletoproducesoundathighspecificityand‘shoot’ittopointsofaroomsimilartoalaser.AmbisonicsistheuseofmultiplespeakersthataredelayedwithcertaintimingthatcanbecontrolledwithOSC(opensoundcontrolandcanuseOSC-ulator).
4. Interaction
>>themoreinteractionbetweentheindividualswitheachotherinadigitalbutyetphysicalsensewillstarttoinfluencetheusersideaofarealinteraction.Themainpurposeoftheprojectistopromotetheinteractionbetweenindividualsevenwithagreatamountofdistancebetweenthem.Theseinteractionsshouldcauseemotionsandresponsesfromtheindividualsastheycommunicatewitheachother.Theunderstandingofinteractionswillgreatlyaffectthesuccessorfailureofanypublicurbanproject.
![Page 26: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/26.jpg)
technical
![Page 27: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/27.jpg)
![Page 28: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/28.jpg)
Before the progression of the project there are a few things I needed to look at and address:
How is this related/relevant to architecture?
Theuseofthetechnologyinordertoaffectthewayaroomfunctionsandbehaveswillchangethewayarchitectureisdesigned.Whenaspacetakesontheideaofbeingamultiuseroom,butremainsasis(asquareorrectangle),architecturebecomesthedesignofsomethingsosimpleanyprogramcanfit.Butwhentheprogramcanstarttoalterthespatialconditions,therearenowanewsetofvariablesthatarchitectscanstarttomanipulateandunderstandformakingmorehumanconnections.
Inthisproject,themanipulationofspaceisonlyonequalitythatwillchangethewayarchitectsseespaceasbeingmoretemporal.ThenextistheuseoftheKinecttoexpandroomsandspaceswithouthavingtoactuallyexpandthespaces.Theperceptionofalargerspacewillalreadychangethesocialconditionsthatmostpeopleareusedto.
How is this going to revive urban space?
Withmoreandmoreurbanspacesbecomelesshabitedbecauseoffewerinteractions.Bybringingadifferenttypeofinteractionintotheurbanspace,agreaterdrawofbeingabletocommunicatethroughafullbodyexperiencecanengagemoreindividuals.
Bytakingcommunicationoutofafullydigitalspaceandintoaphysicalspace,theinteractionsbetweenindividualswillstarttochangeanddrawinterestbecausethisphysicalhumanizationofpeopleinadigitalwaywillstarttobringpeopleoutfromtheirhidingspotsinourdigitaltechnologydrivenworld.
What is really real?
Realityisastateofperception,weknowthingsarerealbecausewehavebeentoldthingsarereal.Throughafullbody,communicationandexperientialinteraction,theonlythingthat
bigger picture questions
![Page 29: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/29.jpg)
seperatesthattypeofdigitalinteractionfromaclaimed‘real’lifeinteractionistheabilitytotouchaphysicalbody.However,theentireexperience,emotion,andviewisarealone,astheyarethroughdigitalspacethatisnowtangible.Canyouprovethataninteractionlikethatisunreal?Whenpeopleareexposeddigitallybyshowingthemselvesastheyarewithrealvisiableactions,theyareasrealasanyoneelsecomparedtodigitalinteractionfrombehindanavatarorcomputerscreen.
What’s next?
Technology,especiallyonesthatelicitresponsesfromhumansareasteadygrowingtrendinsociety.Byaddressingthistrendearlyon,architectscanstarttogainabetterunderstandingofwhatallthismeanstotheprofession.TheKinectwillendupplayingamajorroleinmanyindustries,havingalreadybranchedouttothegaming,automobileandmuseumindustries.
ThefutureoftheKinectinarchitectureisincrediblebecauseitcanliterallycaptureapersonoranyspacein3Dtohaverecreatedina3Dsoftware.Thedevicecanliterallyturnthephysicalworldintoadigitalone,removingtheideaofdistancebetweenpeople,objectsandspaces.However,notonlyisdistancenolongerafactor,butbecausethedigitalisaccessibletherestrictionoftimeisnolongerandissue.
Inasense,formisnolongeranissueeitherinthedigitaltechage.Theincreaseinuseofmoveableandmaleablespacestofittheusersneedsandwantscanstarttohappen.Theabilitytochangeaspacewiththeclickofabuttonorthetouchofascreenwillrevolutionizethewaywehavetopercievewhatspatialdesignwillbecome.
![Page 30: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/30.jpg)
max / mspUnderstanding Max/MSP
Thispieceofcodewasdesignedtooutputalivecamerafeedaswellasthe3Dcapturefeed.YouareabletocontrolthenumberofKinects,thedegreeoftilt,thenumberofdegreesofdepthandthetypeoffileoutput.
correct code design:
![Page 31: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/31.jpg)
incorrect code design:
ThispieceofcodingwasanadditiontoPelletier’soriginalcodeIrecreatedontheleftside.However,Itriedtocreateaconnectiontoaddasecondconnecttothestream.
TheProblem:
ThelaptopwouldconfusedtheKinectswithbeing#1and#2.BecauseIwasusingaportsplitter,therewasnowaytodetermineifthisfileworkedwithoutgettingacomputerwithmoreUSBhubs.Theprogramwouldonlycaptureandstreamfromonecameraatatime,andneverfromthesameone.
![Page 32: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/32.jpg)
![Page 33: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/33.jpg)
![Page 34: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/34.jpg)
![Page 35: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/35.jpg)
![Page 36: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/36.jpg)
code design for: adding a 3D model
Scale
![Page 37: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/37.jpg)
position rotate
properties
connection your 3d model
![Page 38: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/38.jpg)
3D model integratedonly worked with a duck preset model
![Page 39: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/39.jpg)
![Page 40: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/40.jpg)
project 3d imaging Tostartoffsimple,Myleshadrecommendedastyleof3Dprojectionimagingthatiscommon,simple,fastandcheap.Theuseoftwoperforatedmeshscreenslayeredinadarkroomwithaprojectiondirectedtowardsthesheets.
Duringthisexperimentation,therewereafewthingsthatInoticed,first,theprojectorneedstobeabletooutputhighlumensorelsetheprojectionwon’twork.Withouthighlumens,thecontrastbetweenthelighteranddarkerareasarenotaswelldefinedmakingitlookflat.
![Page 41: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/41.jpg)
![Page 42: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/42.jpg)
stereoscopic imaging ThefirstideaofStereoscopicImagingcametomewhiletalkingtoPerryHoberman:
Thisisthecheapoptiontobuya3DTV.Thesetupconsistsoftwoprojectors,asilverscreen,2circularpolarizingscreensoftheprojectors,apairofcircularpolarizingglassesandaMatroDualHead2Go-Analogsplitter.
![Page 43: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/43.jpg)
TheresultingexperimentlettomemakingasilverscreenoutofChromeSprayPaintfromKrylon,buyingasetofcircularpolarizingfiltersandasetofglasses.
Unfortuantelythecomputerwasunabletosplittheimageproperlysowhenitcametoputtingitonthescreen,itwasn’tlineduporworkingproperly.ThisideastillonlyworksintheoryformeuntilIcangetthetwoimagesbeingsenttotheprojectorstocommunicatewitheachother.
![Page 44: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/44.jpg)
![Page 45: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/45.jpg)
technologyhow - toinstruction
#Kinect #attempted #future #new_design_spaces #repurposing #incorporation
![Page 46: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/46.jpg)
basic hackinghttp://www.freenect.com/how-to-get-the-kinect-working-on-mac-os-x
OverthenextcoupleofdaysI’llpostspecificdetailsonthehacksoanyonefollowingthathasn’tdonemuchcomputerworkbeforelikemecandothiseasily.Ihopeitwillbeaseasyasfollowingtheinstructions,butit’snotabouttheinstructionsbutwhathappenswhenyoudofollowthem.
Step 1: Download XCode, CMake and GIT for Mac OS X
> XCodeshouldcomewithyourMacasthedevelopertoolsthatcomestandardnow.Ifyoudon’thaveit,youmayhavetobuyittogetit.
> NextCMakeisaneasydownload
> CMakeisanopen-sourcesystemthatallowsforbuildautomationwhichbasicallyallowsforyoutobuild,textandpackagethesoftware.
> Finally:GIT.
> GITisactuallyasourcecontrolmanagementsystemthatisveryinterestingandveryuseful.Thesystemwasdesignedsothatmultipledeveloperscouldcodeorfixpiecesofalargercodeatthesametime.Theprogramwillthentrackandtracewhatpartsofthecodehavechangedandmaketheaccordingchangesinthemaincode.Ofcoursethiscouldeventuallyendupharmingtheothercoderifyouchangedsomethingdrasticthatwillaffecttheirpieceofcode.However,thegreatthingisthatyoucantrackwhodidwhat,soyouknowwhat’schanged,whochangeditandtheycanevenincludewhytheychangedit.
![Page 47: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/47.jpg)
Sotostarttheinstallationandhackingprocess,althoughIwon’tbeactuallywritingthehack,I’llbedoingallthisinTerminal.
Part I is the download of all the pre-made files onto the computer.
> git clone git://git.libusb.org/libusb.git
> git clone git://github.com/OpenKinect/libfreenect.git
Part II is the start of running all the pieces of the puzzle which is where I started to run into problems.
> cb libusb
Whichisthecreationofthelibusbfolderthatwillnowbeinyourhomeuserdirectory.Ifyou’rehavingtroublewithusingandfollowingwhat’sgoingoninterminal,whatIfoundthathelpsisifyouopenyouruserdirectorysothatyoucanseeallthefoldersinit.Itwillbeusefullaterifyougetlostandhaven’tgottenusedtothesyntaxyet.
> patch -p1<../libfreenect/platform/osx/libusb-osx-kinect.diff
> ./autogen.sh
> make
> sudo make install
![Page 48: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/48.jpg)
Whichisthecreationofthelibusbfolderthatwillnowbeinyourhomeuserdirectory.
Nextyouwilladdinginthebuildfolderintotheoriginallibfreenectfolder.Soyoumovebackoutofthesequenceandthenstartmakingthebuild.
> cd ../libfreenect/c
> mkdir build
> cmake ..
> make && sudo make install
Thenthelastcommanwillhelpyouinstallallthefolderinsidethebuildfolder.Afterallofthis,yourfilesandfolderstructureshouldlooklkethefollowingimages:
**Itisincrediblyimportanttomakesurethatallthefilesliveinthecorrectfoldersbeforetryingtoruntheglvieworglpclviewcommands.Withoutproperplacementtherewillbenumerouserrorsthatwilloccur.
![Page 49: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/49.jpg)
downloaded master files
![Page 50: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/50.jpg)
libfreenect files
![Page 51: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/51.jpg)
libusb files
![Page 52: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/52.jpg)
operationTheoperationprocedureisasfollowsusingTERMINALontheMac.
cd libfreenect
cd build
![Page 53: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/53.jpg)
cd bin
Withinthebin folder,thereareseveralusefulopperationsrelatedtoconnectingandusingtheKinectfor.
glpclview: Thisviewgivesyouthelivecameracapturemappedontothe3DmodelgeneratedfromtheKinect’sdepthsensor.
glview: Thisviewprovidesyouwithtwowindows,oneofthelivecameracaptureandthesecondofthedepthmapincolor.
record: ThiscommandwillstarttocaptureandrecordthefeedfromtheKinect.
regview: Thiscommandgivesyouthetestofthecameraview.
registration_test_depth_...: ThisseriesofdepthtestscancheckyourKinectandshowyouthe3Ddepthmapthatisgeneratedwiththedepthsensor.
tiltdemo: ThiscommandwilltestthetiltontheKinectandshowyoutherangeofmotion.
![Page 54: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/54.jpg)
./ glview
Inordertoexitthevideofeedbackloop,youneedtopushctrl+‘C’
*PleasetakenotethatdependingonyourRAMandyourharddrivespace,thismayseverelyslowdownyourcomputerandinsomeinstancesyouwillhavetoterminatetheprograminordertostopthefoodback.Especiallywhenusingthe‘glpclview’.
![Page 55: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/55.jpg)
Capturefromdepthsensorfromglview.
Capturefrommainvideofeedfromglview.
![Page 56: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/56.jpg)
processingProcessing for the Kinect involves a great
amount of coding in C++ format.
Analyzing the understanding the information and coding written proved to
be very difficult because of the high level of programming language used.
Self manipulation of the code did not seem possible because of the extensive
coding and extensive number of attached files (aka objects) used to make the code
streamlined.
http://processing.org/
![Page 57: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/57.jpg)
max / mspUsing Max/MSP by Cycling74 was the easiest and better program of the two.
The code had previously been assembled so there was a good base to work off of and to figure out the best way to
manipulate the previous design in order to achieve a specific function.
The Max/MSP design that was used provided most of the necessary objects and
sliders. What I added to the design was a extra package to the design that would allow me to import models to manipulate and place into the 3D space that the 3D
caputres would exsist in.
http://cycling74.com/
![Page 58: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/58.jpg)
max / mspUnderstanding Max/MSP
MytrainingforMax/MSPcomesfromPerryHobermanandMylesSciotto.
ThedesignedmaterialusedtoconnectMax/MSPtotheKinectwasdesignedbyJean-MarcPelletier:
ThewaytocreateonMax/MSPissimple.Thedraganddropmenuonthesideoftheprogramletsyousetupallthebuttons,controls,jitterpackages,etc.
![Page 59: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/59.jpg)
BypushingtheCMD+Eyoucantoggletheinterfacebetweeneditableandpresentationmode.
Someoftheshortcutsforcreatingtheelementsare:
b - bang(sendsasignal)
c - comment(addscommentsthatdon’taffectthedesign)
t -toggle(switch)
n-newobject
p-openobjectpalette
f-floatnumberbox
i-integernumberbox
m -message
l -live(interactivepiece)
j -jitterobject(addadditionalinformationonthejitterpackage)
x -commandmenu
Jitterpackagesarepre-writtencodepackagesspecificallycreatedtoexecuteaparticularfunction.Eachjitterpackagehasadifferentsetofattributesthatcanbeappliedtoit.Theseattributescanbeseeninthejitterpackagesmenuwindow.
![Page 60: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/60.jpg)
![Page 61: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/61.jpg)
projectconclusionfindings
#Kinect #Processing #attempted #future #new_design_spaces #repurposing #incorporation
![Page 62: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/62.jpg)
wrap up MyresearchforthepastsemestermainlyfocusedaroundlearningandunderstandingcomputerprogramsthatwereabletocontroltheKinect.AlongwiththatIresearchedthecreationof3Dprojectionscreensandholograms.AlotoftheworkfocusedonmyexplorationonunderstandingthetechnologyandtheprogrammingpossibilitieswitheachprogramandtheKinect.Throughalotoftrialanderror,theexplorationhasleadmetoagreaterunderstandingofthebestwaystoutilizethetechnologyandincorporateitintothedesignprocesswiththespecificdetailsthatcomewithsettinguplargescaledigitalprojectstobebuiltinthephysical.
ThemajorprogramsthatIworkedwithweremainlyProcessingandMax/MSP,bothextensiveanddifficultprogramswiththeirowntypeof‘language’and‘style’.Processingwasthehardertounderstandofthetwo,usingalanguagesimilartoC++andJavaScript,whichrequiredalotmoreskilltotapintotheKinect.Max/MSP,however,wasdesignedasgraphicinterfaceutilizingpre-madepackagesforeasierandfastercodeassemblyandunderstanding.
WorkingwiththeKinecthasbeenabitofachallengebecauseoftheheavyamountofcomputingthatrequiredinordertoprocessthecameraand3Dspatialsensorcapturesandthenmappingthecameracaptureontothe3Dmap.Theprocessingpowerofthelaptopwasunabletohandlethecapacityneededtocreatethecompilation.Thismajorproblemrestrictedfurtherexplorationontheprojectbecauseofthelimitedresources,butcanbefurtherexploredatalaterdatewiththecorrectframeworkinMax/MSPalreadysetup.
Thissemester’sworthofresearchhasledtoabetterunderstandingofhowtoutilizethefunctionsoftheKinectinordertointegratethetechnologyintoaphysicalspace.TheexplorationoftheparametersandcapabilitiescanleadtofurtherdevelopmentsandintegrationoftheuseoftheKinectforfuturespaces.
![Page 63: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/63.jpg)
http://142days.wordpress.com
![Page 64: Space by Space](https://reader030.fdocuments.us/reader030/viewer/2022020200/568bf0631a28ab89338f7d08/html5/thumbnails/64.jpg)