Virtual Set Design Workshop

!
Virtual(Set(design(workshop((17719(december(2014((LABA,(
Brescia(
!
!
!
!
!
!
Session:(Mastering(live(multimedia(show(control.(
!
!
!
!
Topics:!!QLab,!Kinect!v2,!body!mapping!
!
!
!
!
KeyWords:!mapping,!skeleton!tracking,!kinect,!depth!mask,!joints,!calibration,!OpenCV,!QLab.!
!
!
!
Workshop(ViSet((Virtual(Set(Design(5(Libera(Accademia(di(Belle(Arti((Brescia((Italy)((17519(December(2014(((((((((
!
Part!1:!Qlab!
!
!
!
QLab!D!Live!show!control!for!Mac!OS!X!
QLab!makes!it!simple!to!create!rich!multimedia!designs!for!live!performances!and!installations.!From!
Broadway!to!the!West!End,!in!churches,!museums,!store!fronts,!concert!halls,!and!theaters!around!the!
world,!people!use!QLab!to!bring!their!audio!and!video!to!life.!
!
!
QLab!allows!you!to!design!and!operate!amazing!multimedia!performances!from!your!Mac!OS!X!computer.!A!single!QLab!
workspace!can!control!audio,!video,!MIDI,!OSC,!and!more.!
!
Using!building!blocks!called!"cues",!you!can!create!sophisticated!designs!in!seconds.!
!
Getting!started!is!as!simple!as!dragging!in!a!file!and!pressing!"GO".!From!there,!add!commands!to!fade!volume,!animate!
videos,!or!add!audio!and!video!effects.!
!
Once!you!master!the!basics,!become!a!power!user!with!advanced!features!like!scripting,!video!corner!pinning,!multiD
projector!edge!blending,!audio!localization,!or!even!building!multiDcomputer!designs!by!sending!commands!to!other!QLab!
machines!on!your!local!network.!
!
!
!
!
1.1 Cue(basics(
!
Main!parameters!influencing!a!generic!cue!type:!
!
!
!
1.2(Examples(
!
D Audio!Cues!
!
Audio!cues!can!play!sounds!in!most!formats,!including:!*!AIFF!*!WAV!*!CAF!*!AAC!*!MP4!*!MP3!(this!is!QLab's!least!favorite!
format.!Not!only!does!it!sound!less!than!ideal,!but!it!also!has!inherent!timing!problems!that!can!interfere!with!critical!timing!
in!unpredictable!ways.)!
!
There!are!several!ways!to!create!a!new!Audio!cue:!*!Click!the!Audio!cue!icon!in!the!toolbar!or!toolbox!*!Select!"Audio!cue"!
from!the!"Cues"!menu!*!Drag!an!audio!file!into!the!cue!list!from!the!Finder!*!Type!the!Audio!cue!shortcut,!which!is!
CommandD1!by!default!
!
When!a!new!Audio!cue!is!created,!five!tabs!will!appear!in!the!Inspector:!*!Basics!*!Time!&!Loops!*!Device!&!Levels!*!Trim!*!!
!
!
!
!
D!Video!Cues!
!
!
Resources:(
(
(
(
(
" Figure53!QLab!documentation:!http://figure53.com/qlab/docs/!
!
!
!
!
!
!
!
Part!2:!Kinect!
!
!
!
Kinect!(codenamed!in!development!as!Project(Natal)!is!a!line!of!motion!sensing!input!devices!by!Microsoft!for!Xbox!360!and!
Xbox!One!video!game!consoles!and!Windows!PCs.!Based!around!a!webcamDstyle!addDon!peripheral,!it!enables!users!to!
control!and!interact!with!their!console/computer!without!the!need!for!a!game!controller,!through!a!natural!user!interface!
using!gestures!and!spoken!commands.[9]!The!firstDgeneration!Kinect!was!first!introduced!in!November!2010!in!an!attempt!to!
broaden!Xbox!360's!audience!beyond!its!typical!gamer!base.[10]!A!version!for!Windows!was!released!on!February!1,!2012.[6]!
Kinect!competes!with!several!motion!controllers!on!other!home!consoles,!such!as!Wii!Remote!Plus!for!Wii!and!Wii!U,!
PlayStation!Move/PlayStation!Eye!for!PlayStation!3,!and!PlayStation!Camera!for!PlayStation!4.!
!
!
!
Depth(Mask((
(
(
(
(
!
!
!
!
!
!
Comparison(between(two(different(sensor(representation(
(
(
(
(
(
(
!
!
!
!
Live(green(screen7like(example(
(
(
(
(
(
(
!
Skeleton(tracking(
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
Resources:!!http://www.microsoft.com/enDus/kinectforwindows/!
!
!
!
!
!
Part!3:!Body!Mapping!
!
Several!artistic!ideas!are!based!on!reprojecting!visuals!generated!by!kinect!tracking!onto!a!moving!body:!
!
!
!
!
!
!
!
!
!
to!achieve!that!,!you!should!consider!several!transformation!between!kinect!coordinates!system!!and!ptojectors!one.!Due!
not!ony!to!differest!lens!position!in!space,!but!also!to!different!distortion!!(check:!
http://en.wikipedia.org/wiki/Distortion_(optics)!!)!
!
!
!
!
!
We!introduce!an!opensource!tool!to!perform!calibration,!and!try!a!practical!example:!!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
Resources:!
D https://github.com/Kj1/ofxKinect2ProjectorCalibration!
D https://vimeo.com/75415111!
D https://vimeo.com/100504580!
!
!
!
!

Virtual Set Design Workshop

Încărcat de

Informații document

Drepturi de autor

Formate disponibile

Partajați acest document

Partajați sau inserați document

Opțiuni de partajare

Vi se pare util acest document?

Este necorespunzător acest conținut?

Drepturi de autor:

Formate disponibile

Virtual Set Design Workshop

Încărcat de

Drepturi de autor:

Formate disponibile

!

S-ar putea să vă placă și