Monday, February 4, 2013

Personal Essay


Twenty six of my thirty one years have, in some way, involved performance: from community musicals where I performed along side my mother, to gravity-defying circus performance for the Christopher Reeves foundation. I have also worked purposefully to provide educational access for populations that have not traditionally been able to engage with the arts. In this respect it was my work for an educational outreach program in rural New Hampshire and Vermont that had a deeply resonant impact on my view of the power of arts in education. Over the course of a five year period working for Keene State College’s Upward Bound Program I was a residential director, teacher, advisor, counselor, college-coach, and facilitator. As I transitioned to another position at Keene State my role changed from supporting potential students to supporting college faculty and staff. In my role as Rich Media Specialist for Keene State’s Center for Engagement, Learning, and Teaching I worked as an instructional designer, blackboard administrator, media maker, researcher, and faculty collaborator. While working full time in higher education, I also continued to develop as a performer through an ongoing circus training regimen. In thinking about graduate school I saw that I had been shaped by those three distinct forces: performance based art, technology, and a passion for teaching. I came to ASU to create a life where those three forces might co-exist in a meaningful and transformative program of study. In fact, that’s what I’ve found at ASU. In my first year I will have participated in, or contributed to (as performer, media creator, or system designer) eleven Phoenix-area productions while also having served as instructor or TA to over 350 students. My introduction to ASU has been, to say it mildly, a whirlwind of exposure to new ideas, methods, and opportunities to collaborate or participate. Especially interesting to me has been the opportunity to engage other artists in a critical dialogue about the impact, consequences, and outcomes of including digital media in live performance. 

I sometimes find it difficult to know what I will be doing in the next ten days, let alone ten years. That said, my vision for a professional life after graduating from ASU does include some specific goals. Without a doubt, my work will include some element of physical computing to address the issues of how to integrate real-time data from performers into the experience of seeing a theatrical production. Specifically, I plan to start a circus company with a heavy emphasis on the incorporation of traditional and generative media as elements of the performance. This involves the development of both physical apparatuses capable of capturing and transmitting meaningful data, as well as the development of applications to parse and interpret the data for playback-system integration. Further, I think this kind of work is potentially the most meaningful when partnered with an educational institution where performers, media makers, and technicians can collaborate on this process. Finally, my hope is that ten years after graduation I will be in a position to spearhead the implementation a of an integrated technology and circus program for the development of artists looking to transcend the traditional ideas of physical and mediated performance.

Saturday, February 2, 2013

Sound Trigger | MaxMSP


Programming is often about solving problems, sometimes problems that you didn't know that you actually had to deal with. This past week the Media Installations course that I'm taking spent some time discussion issues of synchronicity between computers for installations, especially in a situation where the latency of wired or wireless connections creates a problem. When 88 computers all need to be "listening" in order to know when to start playback, how can you solve that problem?

Part of the discussion in the class centered around using the built-in microphones on modern laptops as a possible solution. Here the idea was that if every computer had it's microphone turned on, the detection of a sound (say a clap) would act as a trigger for all the machines. Unless you are dealing with distances where the speed of sound becomes a hurdle for accuracy, this seemed like a great solution. So I built a patch to do just that.

This max patch uses the internal microphone to listen to the environment and send out a trigger messages (a "bang" in max-speak) when a set sonic threshold is crossed. As an added bonus, this patch also turns off the systems involved with detection once it's set in motion. Generally, it's seemed to me that a fine way to keep things from going wrong is to streamline your program so that it's running as efficiently as possible.



Here's a link to the simple trigger patch
Here's a link to the Max Project that includes the triggered video

Tools Used
Programming - MaxMSP
Countdown Video - Adobe After Effects
Screen Cast - ScreenFlow
Video Editing - Adobe Premiere

Thursday, January 31, 2013

Sparrow Song | Drawing with Light


In January I was a contributing digital artist to a production called Sparrow Song. The production focused on the creation of an interactive art-installation / theatrical environment. The production begins with a short performance where audience members are introduced to various interactive elements in the playing space. After the short "play" the audience is invited to explore and play in the art-installation themselves. 

Mad-Mapper is a very powerful tool for quickly mapping spaces, but it's not always the best tool for theatrical play-back. For theatrical productions artists start by creating a series of masks as tools to isolate or highlight scenic elements with projector light. These masks are in many ways analogous to mattes used in photography or video editing. In order to isolate media in the space, each element that had a unique mediated element required its own mask. Further, each projector out-put also needed to be masked in order to avoid spill or bleed between projectors.

One of the effects that I've used in two productions now is where lines appear to draw-in over time in a video. This effect is fairly easy to generate in After Effects, and I wanted to take a quick moment to detail how it actually works. This process can start many ways. For Sparrow song it started by connecting a laptop directly to the projectors being used, and using photoshop to map light directly onto the set. You can see in the photo to the right that each surface that's intended to be a building has some kind of drawn on look. In photoshop each of these buildings exists as an independent layer. This makes it easy to isolate effects or changes to individual buildings in the animation process.



Here's a quick tutorial about how I animated the layers to create the desired effect:



Now that I've done this several times it finally feels like a fairly straightforward process - even if it can be a rather time consuming one.

Here's an example of what the rendered video looks like to the playback system.



Making the asset itself is only a part of the process. After you have a video rendered, the next step is to integrate that into your playback system so that it can be controlled during a performance. For Sparrow Song, the playback engine was Isadora, made by Troikatronix. Here's a quick video that covers movie playback in this system.



Here's an album of documentation photos from the closing show.


Tools Used
Digital Drawing Input - Wacom intuos4
Mapping and Artwork - Adobe Photoshop
Animation and Color - Adobe After Effects
Photos - Cannon EOS 7D
Photo Processing - Adobe LightRoom 4
Show Control - Troikatronix's Isadora

Wednesday, January 30, 2013

Delicious Max 6 Tutorial 23: Live for the Swarm

One of the on-going semester projects that I've committed to is regular (read weekly) online MAX tutorials. I'm currently enrolled in a course that's focused on Media Installations, and while I have taken a semester of programming learning Processing I'm not proficient enough to rely on Processing for creating interactive programs. The Media Installations course has a heavy MAX component to it, but we don't have much direct instruction in class about how to actually using Cycling 74's software. Given this reality, I've leaning on the web to help me learn MAX. 


So far I've bounced between a few different sources for online instruction. I started with Peter Batchelor's set of MaxMSP tutorials which were wonderful. I'm currently about third of the way through his materials, and know enough to feel an itch for more complicated instruction. Thanks to YouTube's recommendation bar I stumbled onto dude837's (Sam Tarakajian) YouTube channel and tutorials. dude837 has great material, it's interesting, fast paced, and funny. While Batchelor's tutorials are great, they do sometimes feel a little slow - don't get me wrong, there are plenty of times when I need a slow tutorial. Using both of these channels as resources has left me with a mixture of general and creative instruction - which has been a nice mix.



This week I'm going to tackle Sam's Delicious Max 6 Tutorial 23: Live for the Swarm. 




Handy things to keep in mind

  • http://www.maxobjects.com/ - a database of max objects
  • Option Click brings up the Help File
  • fsaa - Full Screen Anti-Aliasing
  • Freezing Attributes keeps them from changing when you load a patch

Thursday, January 24, 2013

Mapping and Melting

This semester I have two courses with conceptual frameworks that overlap. I'm taking a Media Installations course, and a course called New Systems Sculpture. Media Installations is an exploration of a number of different mediated environments, specially art installations in nature. This course deals with the issues of building playback systems that may be interactive, or may be self-contained. New Systems is taught through the art department, and is focused on sculpture and how video plays as an element in the creation of sculptured environments

This week in the Media Installations course each person was charged with mapping some environment or object with video. While the wikipedia entry on the subject is woefully lacking, the concept is becoming increasingly mainstream. The idea is to use a projector and to paint surfaces with light in a very precise way. In the case of this course, the challenge was to cover several objects with simultaneous video. 

I spent some time thinking about what I wanted to map, and what I wanted to project, and was especially interested in using a zoetrope kind of effect in the process. I kept thinking back to late nights playing with Yooouuutuuube, and I wanted to create something that was loosely based on the kind of idea. To get started I found a video that I thought might be especially visually interesting for this process. My friend and colleague Mike Caulfield has a tremendously inspiring band called The Russian Apartments. The music he writes is both haunting and inspiring, an electronica ballad and call to action. It's beautiful, and whenever I listen to a track it stays with me throughout the day. Their videos are equally interesting, and Gods, a video from 2011, kept coming back to me. 


To start I took the video and created a composition in AfterEffects with 16 versions of the video playing simultaneously. I then offset each video by 10 frames from the previous. The Effect is a kind of video lag that elongates time for the observer, creating strange transitions in both space and color. I then took this source video and mapped it to individual surfaces, creating a mapped set of objects all playing the same video with the delay. You can see the effect in the video below:


Meanwhile in my sculpture course we were asked to create a video of process art: continuous, no cuts, no edits. I spent a lot of time thinking about what to record, and could not escape some primal urge to record the destruction of some object. In that vein I thought it would be interesting do use a slow drip of acetone on styrofoam. Further, I wanted to light this with a projector. I decided to approach this by using the mapping project that I had already created, and instead to frame the observation of this action from a closer vantage point. Interestingly, Gods has several scenes where textures crumble and melt in a similar way to the acetone effect on the styrofoam. It wasn't until after I was done shooting that I saw this similarity. You can see the process video below:




Tools Used:

Mapping - MadMapper
Media Generation - Adobe After Effects
Projector - InFocus IN2116 DLP Projector

Monday, January 21, 2013

Gelatin Projection


In working with projection mapping I've been interested in experimenting with food and projection. This first experiment is with a milk mixed into gelatin. This resulting surface has a ghostly like quality, and while not ideal, it certainly created an interesting result. 




Thursday, January 17, 2013

Media Installations | Simple Sync

Assignment Description

Simple Synch Youtube Rips

Look at the synchronization utility I made in max, and see if you can get at least two computers to synch up some kind of video playback. More computers could be even more interesting.

My Patch

Initially I had a lot of ideas about where to go with this assignment. Unfortunately  I'm brand new to MAX 6, and the learning curve is a little steep. That said, initially I was thinking about a four computer arrangement. These four laptops would be arranged in a "x" formation, with a laptop at each point of the "x." Computers that were across from one another would stream of the video from the built-in cameras to the opposite screen. The resulting experience for the observer would be looking at a screen that was always displaying the viewer's back. This configuration required that the video stream be passed over TCP/IP to the other computer. While this was a great start, ultimately I had to move a different direction - I ended up experiencing a fair amount of difficulty passing a video signal over TCP/IP. I'm sure that this can be done, but I wasn't having any luck and needed to move on. 






In moving forward, however, I stumbled upon Dude873's video reverb patch. After following along with his tutorial I was able to successfully replicate his patch and the effect that it created. Moving forward I loaded the patch onto two computers and made a few small changes. Specifically, I created a patch that had a udpsend object and a patch that had a udpreceive object. These objects watch the network for an incoming signal to initialize the webcam and to start the effect. The control computer starts and stops the effect on both machines. Hit the video below to see how this works, and download the max patches if you'd like to experiment yourself.

Video




My Video Reverb Patches

     Video Reverb Send Maxpat
     Video Reverb Receive Maxpat