The FuturePerfect Podcast features interviews with compelling people breaking new ground in art, media, and entertainment. This podcast is produced by FuturePerfect Studio, an extended reality studio creating immersive experiences for global audiences. Episodes are released every two weeks, visit futureperfect.studio for more details. <br/><br/><a href="https://futureperfect.substack.com?utm_medium=podcast">futureperfect.substack.com</a>

FuturePerfect Podcast
Claim This Podcastby FuturePerfect Studio
Podcast Overview
The FuturePerfect Podcast features interviews with compelling people breaking new ground in art, media, and entertainment. This podcast is produced by FuturePerfect Studio, an extended reality studio creating immersive experiences for global audiences. Episodes are released every two weeks, visit futureperfect.studio for more details. <br/><br/><a href="https://futureperfect.substack.com?utm_medium=podcast">futureperfect.substack.com</a>
Language
🇺🇲
Publishing Since
4/19/2022
1 verified contact email on file for FuturePerfect Podcast
Pitch yourself as a guest, propose sponsorships, or reach out directly to the host.
Recent Episodes

February 28, 2023
#006 - Andrew Keller: Columbia Records, David Bowie NFTs, and Web3 Experiments
<p>Welcome to the FuturePerfect Podcast where we talk with compelling people breaking new ground in art, media, and entertainment. This podcast is produced by FuturePerfect Studio, an extended reality studio creating immersive experiences for global audiences. Visit our website <a target="_blank" href="http://futureperfect.studio/">futureperfect.studio</a> for more details.</p><p>The text version of this interview has been edited for length and clarity. Find the full audio version above or in your favorite podcast app.</p><p>For episode 006, Wayne Ashley interviews <a target="_blank" href="https://twitter.com/andrewdkeller">Andrew Keller</a>, founder of <a target="_blank" href="https://www.wefewgroup.com/">We Few Group</a>, a post-media company that manages singers and songwriters, and develops brand partnerships and ventures with internationally known visual and musical artists. Making innovative use of blockchain technologies and NFTs, Andrew has been building compelling projects with such noted organizations as the David Bowie Estate and singer-songwriter Stefan Storm.</p><p>Early career at Columbia Records</p><p><strong>Let me start right off by saying how excited I am to be speaking to someone who’s been part of the music industry for over 20 years. As much as I love music, I’ve had very little access to the inside workings of the business. You’ve had these long relationships with labels like Columbia and Capitol Records. What are some of the most important insights you’ve gained over the last two decades?</strong></p><p><strong>Andrew Keller:</strong> One of the biggest insights I’ve gained is that change is necessary and hard. When you’re dealing with global major labels it’s really hard to make noticeable changes. There’s a lot of people working at major labels who are innovative and want to do good. It’s just really hard to turn a gigantic ship around. You’re dealing with all sorts of policies and god knows how many different types of contracts that were written over the years.</p><p><strong>How did you get started at Columbia Records and what were your major focuses were when you were there?</strong></p><p><strong>AK:</strong> I started at Columbia as a 17 year old and was a total music-head. I grew up in New York City so I had access to absolutely everything, and thankfully, I had parents who were simultaneously really supportive and also slightly oblivious. From the time I was 13 or 14 I was going out to places I probably shouldn’t have been and exploring all sorts of different scenes from nightclubs to hardcore and punk shows to mainstream pop shows. I was really giving myself a crazy education in different subcultures and figuring out little scenes and pockets that had their own worlds, archetypes, and systems in place. And they’re probably all relatively similar, it’s just people wearing different clothes and different hair. But the whole concept of having these scenes and worlds always excited me. It kind of all played into ideas of identity—sonic identity and visual identity.</p><p>I was going to lots of shows around 2002 when there was this giant emergence of bands in the tri-state area who were coming out of the punk scene. And it became kind of this pop-punk, emo, screamo post-hardcore thing. I refer to it lovingly as the <a target="_blank" href="https://www.billboard.com/music/rock/warped-tour-2005-oral-history-interview-8461060/">Warped Tour</a>-scene, which was this festival that traveled around the US for years. There was a ton of attention on bands that I was friends with and bands that I had built relationships with as a fan.</p><p>One thing kind of led to another and I ended up getting hired as a junior A&R scout / assistant at Columbia and got to work for some amazing people. One of whom is kind of this incredibly legendary small bald man named Matt Pinfield, who was a DJ and then VJ on MTV. A lot of the time we kind of ended up having a deal where he would get booked to DJ and then I would basically cover his set and he’d split the money with me if he had to leave.</p><p>So I started DJing and it was just this awesome moment in time where I was really young and exposed to so many people. It became clear to me at that point that I just loved being around creative people. I was never in a band. I don’t sing. I don’t consider myself an artist in any way, shape or form. I do consider myself a creative person and a professional fan. I realized early on that for me it was gonna be about being the conduit and the kind of middle man between the artist and the rest of the world.</p><p>That period of time was really incredible. I got to work on <a target="_blank" href="https://www.youtube.com/watch?v=B9dSYgd5Elk">MGMT</a>’s first two albums as a coordinator then started to sign bands on my own like <a target="_blank" href="https://www.youtube.com/watch?v=eAM9diyVRiM">Cults</a> and <a target="_blank" href="https://www.youtube.com/watch?v=lDKJ29357FU">St. Lucia</a> and doing stuff in the dance space with <a target="_blank" href="https://www.youtube.com/watch?v=J-gYJBsln-w">Krewella</a> and <a target="_blank" href="https://www.youtube.com/watch?v=12CeaxLiMgE">Dillon Francis</a>. And then one of the last things I got to do at Columbia was<a target="_blank" href="https://www.youtube.com/watch?v=QJJYpsA5tv8"> Bring Me the Horizon</a>, which as a metal kid was unreal. And that was all under a guy named Ashley Newton, who is still one of my closest friends and mentors. He was responsible for signing Spice Girls, Massive Attack, Daft Punk, and Pharrell. Ultimately I went with him and <a target="_blank" href="https://www.musicbusinessworldwide.com/steve-barnett-on-running-capitol-your-faith-has-to-be-greater-than-your-fear/">Steve Barnett</a>, who had been the chairman of Columbia, over to Capitol Records when Steve was relaunching Capitol.</p><p>Streaming music, shifts in the industry, and joining Capitol Records</p><p><strong>I’m very interested in the sort of crises that upend one’s assumptions about the world and motivate people to do something radically different than what they’ve been doing. You mentioned inertia in the music industry when we talked earlier. What happened that caused you to leave Columbia, join Capitol and eventually start your own company?</strong></p><p><strong>AK:</strong> There were a few things. I was 30 and had started at Columbia when I was 17 and I really wanted a change. I loved my artists and everyone I worked with. It really was a family, but I was too comfortable. If you do A&R at a label your real challenge at the end of the day is to sell records. Your goal is to find artists, help them make the best record possible and have as much success as you can. There’s a million ways to do it, and I’m not even saying I was great at it, but it’s a very linear goal. You go from point A to point B, and that’s fine, but it had just done so much and I needed a change.</p><p>So Steve Barnett called me and said what would you want to do if you were going to stay at a label? And my answer was that streaming was starting to become really dominant. And the thing that streaming changed was access to global music. Before streaming if you were a British band you would sign to a label in the UK for the world. But unless something really took off, you might not even get a US release. When Spotify started putting out music, for the most part, nothing was geo-locked. Everything was coming out day and date, but labels were still working territorially.</p><p>So I said to Steve, I think there’s gonna be a really big shift in the way music is consumed from an international standpoint and I wanted to create “international A&R 2.0” for streaming. So off I went to Capitol Records where I started figuring out this whole system. And also taking systems that were already in place and trying to break them because there were things that didn’t make sense to me and that I thought needed to be changed. Part of that was really just being the ambassador and being the person who could go and have some difficult conversations. But also go and represent Capitol around the world. It was a lot of time on airplanes.</p><p>I had a ton of fun at Capitol. I got to partner with <a target="_blank" href="https://www.youtube.com/watch?v=zABLecsR5UE">Lewis Capaldi</a> who is on his arena tour right now and is a fantastic artist. I introduced Capitol to <a target="_blank" href="https://www.smentertainment.com/">SM Entertainment</a>, one of the biggest K-pop labels in the world, and they have an amazing and fruitful partnership. When I reached the end of my deal at Capitol I was in my thirties and my brand had always been owned by a major corporation. There were things I wanted to do that I’d never be able to do in those situations. For example I wouldn’t be able to music supervise a movie, I wouldn’t be able to launch my own projects or do certain things.</p><p>An open-ended post-media company</p><p><strong>From here you started your own company </strong><a target="_blank" href="https://www.wefewgroup.com/"><strong>We Few Group</strong></a><strong>. I like to call it an “open-ended post-media company”. You take on so many roles—an artist manager, a mixing engineer, an NFT project producer, an entertainment strategy consultant, you’re also working closely with visual artists to produce a graphic novel and even knitwear. This kind of post-media practice that you engage in is so exciting to me and it’s exactly what FuturePerfect is doing. How are these different worlds and practices connected for you?</strong></p><p><strong>AK:</strong> When I went off to start <a target="_blank" href="https://www.wefewgroup.com/">We Few Group</a> everyone was like what is it, what are you going to do? And I just said I’m going to do things that excite me with people I like. And that was it, that’s the entire thing.</p><p>For example, you mentioned the knitwear. A couple of years ago, there was a painter that I was obsessed with and I wanted to buy his paintings. I ended up getting on a Zoom call with him for over two hours talking about what he was doing. At the end of the call he asked—if I manage artists could I also manage a painter? He’s in the kind of traditional art world, but makes these 30-second horror films around each of his pieces on TikTok. It’s all kind of neo-gothic stuff.</p><p>He has all of these kids as fans, everyone from artists and influencers and just regular teenagers and 20-somethings, the typical TikTok audience. And they all wanted merch. They weren’t necessarily buying fine art, but they wanted merch. And he and I started having conversations about it. He wasn’t really interested in making merch because he is an artist, but he was like, I’ll start a clothing company. Next thing you know, I’m learning about knitwear.</p><p>This connects back to your earlier question of why I was leaving. The answer is I wasn’t learning stuff. There was no time in my life at a label that I would ever be learning about making knitwear, or consulting for Arizona Iced Tea and helping them with their entertainment strategy for two years. I now know more about consumer packaged goods and beverage production and can wrapping. Is that the world’s most useful thing to know [laughs]? No but I love learning that kind of stuff and being around it.</p><p>Crypto and transforming artistic engagement</p><p><strong>This brings me now to your fascination with the crypto space. That’s another expansive world. What about crypto most excites you and your efforts to transform both artistic and business practices? How did you get into it?</strong></p><p><strong>AK:</strong> I got into crypto early. I’ll preface this with saying it’s not because I bought millions of Bitcoin at $2 and am now sitting here just pounding money. I wish that were the case, but it’s not. I started buying little fragments of Bitcoin in like 2010. Growing up things like business and banking and the stock market were like the devil to me. For better or worse, I kind of vilified it in my mind. But with crypto it felt almost like punk rock banking. I was completely intrigued by it as a kind of rebellion. For years friends heard me talking about crypto, and when the pandemic started and touring was shut down there was suddenly a bull market mentality in the crypto space. And NFTs, which had been around for a few years prior, started to be something that artists, managers and agents were paying attention to. People started calling me saying you probably know about this stuff, right?</p><p>I gave pretty much everyone the exact same conversation. I said please don’t do this, it is really early. This is a real world and kind of culture. You do not care about them. They do not really care about you. Your fans do not care. You know, this is bad for everyone. I guess not a lot of people were voicing that at the time. A lot of people were saying we should do this and people made a bunch of money, but I think a lot of them also looked a little dumb. A lot of the projects were pretty empty. Most of them don’t get talked about anymore.</p><p>But as this world kept growing I started getting calls again. I realized that I could help be a middle man and tour guide. I could help bring the right people with the right intentions in and help shape what adoption to Web3 looked like and help introduce people to the real crypto-native world and to the people who really care about this. A lot of what I do now with Web3 is try to find interesting projects and people who I think will love and enjoy this space and help them either dip their toe in the water or jump in the right way surrounded by the right people.</p><p>Working with the David Bowie Estate</p><p><strong>Talk about the David Bowie project, because clearly this is something that you have a lot of passion for, and through it we can better understand what you mean by NFT, crypto space or blockchain.</strong></p><p><strong>AK:</strong> It was without a doubt, one of the most incredible and surreal things I have and probably will ever get to be a part of. Let’s put it this way, when my son came home from the hospital in his nursery at home over the changing table is a caricature of David Bowie. My dog’s name is Bowie. I’m not a casual Bowie Fan. I revere Daivd Bowie.</p><p>I couldn’t write it better. I’m sitting on the computer one night buying something on the NFT marketplace <a target="_blank" href="https://opensea.io/">OpenSea</a> with my dog Bowie sitting next to me and I get a text that says “I can’t really say much, but can I introduce you to the Bowie estate, they want to talk about NFTs.” We end up starting this dialogue with the executor of the Bowie estate, who is just an incredible man. He had heard a lot about crypto and what was going on in this space and was very cautious, but had a kind of bullishness. As someone who knew Bowie well, he knew Bowie would’ve been really excited by this. For me, there had to be a very specific why. That question of why are we doing this? What is our north star for this?</p><p><strong>What was the vision that emerged for the project?</strong></p><p><strong>AK:</strong> I basically spent the weekend thinking about Bowie and everything I knew about him and digging into his art collection because he was a huge art collector. I happened to have the catalog of the Sotheby’s auction when they auctioned off his collection. So I started going into it and asking what did his collection look like? What kind of art did he collect? Then you start thinking about him as a technologist and a lover of new technology. And you’re like okay you had <a target="_blank" href="https://www.dailydot.com/debug/david-bowie-world-virtual-3d/">BowieWorld</a> before Metaverse was even a thing we talked about. You had <a target="_blank" href="https://slate.com/technology/2016/01/bowienet-david-bowie-s-early-internet-service-provider.html">BowieNet</a>, which was his own ISP and kind of fan club site. You had BowieArt, which ultimately became a showcase of art that he liked and art made by his community. And then you start thinking about <a target="_blank" href="https://www.billboard.com/music/music-news/david-bowies-bowie-bonds-55-million-wall-street-prudential-6843009/">Bowie Bonds</a> and the idea of him having commodified his work and well, that sounds a lot like a bunch of NFT projects. And I just went, okay, this is a guy who kind of had the ethos of the crypto artist before that was a thing. If the blockchain is the permanent immutable ledger, then let’s go put this on the blockchain. Let’s go put his legacy there.</p><p><strong>So what does that mean to put his collections on the blockchain?</strong></p><p><strong>AK:</strong> Well, it wasn’t his collections, it was, let’s do a project that puts on-chain—something that is on the ledger and can never be deleted—that he was here. And let’s create something to honor his legacy. I kept going back to the fact that he was a huge supporter of new artists. He was a digital artist himself. I got access to the Bowie archives through my partner Joaquin and I would literally get screenshots on my phone of anything from the archive whether it was an outfit he wore or a ticket to one of his shows or art he had done or a photograph. Everything is meticulously databased. And so Joaquin and I basically started narrowing down this idea.</p><p>The project became, let’s get a handful of the best artists in the crypto art space, from super established to new and up-and-coming and give them free rein to create anything they want to contribute to Bowie. They also had the added bonus of incorporating anything from the archives, which no one has ever been able to do. From there I started to ask who do we want, who makes sense here?</p><p>I did things like going through Bowie’s personal art collection and basically tagging a bunch of stuff like “landscape”, “British artist”, “contemporary African artist”, “sculptor”. And then I did the same with crypto-native artists and tried to find what the connections were. It wasn’t about finding a one to one match with everyone, but there were certainly people where I could say okay, this guy’s work kind of reminds me of this guy’s work. Or I think what this guy does with his art is kind of interesting in relation to this part of Bowie’s archive. And also people who were fans of Bowie and people whose art represents certain things that I thought were key to Bowie’s legacy. So we came up with a dream list and started approaching them. Almost everyone said yes.</p><p><strong>What makes this specifically </strong><strong>crypto</strong><strong> art? How do you differentiate the art that emerges within the blockchain? What is unique about it?</strong></p><p><strong>AK:</strong> What makes this special? Well it is a new medium for art, a new way to distribute art. Artists are able to do things they couldn’t do with prior art forms. For example, there are some works that are coded to literally change the time of day; there are pieces that morph over time; some of the artists built mechanisms into the work that would change the work automatically at a future time…at the end of the day it’s just art. There’s a community aspect to this art. All of the artists in the project interact directly with their community, their fans, and collectors. There is no middleman. There are no traditional rules. There needs to be collaboration, direct connection, dynamic movement, and that’s what makes it special to me. </p><p>Being on the blockchain is a means for it to exist. And then there is the “smart contract.” That’s a huge part of what an NFT is, the actual code you are gaining access to in this token. This contract protects not only Bowie, but artists and the NFT community from being exploited. Everything was a 50/50 partnership between the artists and the estate, and 100% of the profits went to charity. </p><p>Launching a new transmedia art project</p><p><strong>Tell me about </strong><a target="_blank" href="https://www.kidsoftheapocalypse.com/landing.html"><strong>Kids of the Apocalypse</strong></a><strong>, </strong><strong>another far reaching transmedia project that spans across music, NFTs, music videos, a comic book, and film. Here is a quote from the Kids of the Apocalypse Discord channel that sums up the project really well: </strong></p><p>In the aftermath of a cataclysmic bio-explosion, a social movement of revolutionaries is born to break the chains of the tyrannical rule of Horizon Corp in the wake of the apocalypse. A multimedia art project born from the music, Kids of the Apocalypse (KOTA) aspires to highlight the themes represented on the journey of our - awakening, unity, and deposition of unjust power. Positioned as a multimedia IP with strong experience and connections in the music industry alongside a world-class design team, KOTA is a love letter to those who dare to speak out and be themselves - delivered in the form of a suspenseful, emotional, and immersive sci-fi adventure.</p><p><strong>AK:</strong> Kids of the Apocalypse was a concept and story that was conceived about 10 years ago. There was a Swedish production group called <a target="_blank" href="https://www.youtube.com/watch?v=wxmQPzVqk94">The Sound of Arrows</a>, and Stefan Storm from the group had started this kind of side project idea Kids of the Apocalypse. Imagine a dark comedy version of—I’m gonna say X-Men because it involves mutants—that is alt and internet leaning and kind of self-referential which also has a music component. There’s this whole story and a really immaculately created lore and universe. And now imagine 10 years ago saying let’s make this happen. Where the do you begin? So this idea sat there for a long time.</p><p>So cut to 10 years later and I’m reconnecting with my friend Derek Davies, who was the founder of <a target="_blank" href="http://neon.gold/">Neon Gold</a>, which was a label that I had actually done a label deal with when I was at Columbia and who had signed Sound of Arrows and put out their first EP. He was still in touch with Stefan, and Derek is also doing a lot of stuff in the Web3 space. He has an incredible company called <a target="_blank" href="https://www.medallion.fm/">Medallion</a>. I think we have put together a pretty incredible team—we’ve got Derek and the Medallion crew, we have Stefan and his crew, we’ve got an incredible creative agency who have been working on all of this alongside Stefan. And we’ve got the guys at Bench Mob who are some of the best digital architects out there from a social media strategy perspective. We’ve got an incredible community manager, we’ve got a advisory board of people who really are some of the best and brightest in the space from Cooper Turley on the music NFT side to John Roger, who’s one of the advisors and was marketing for Star Wars for Lucasfilm and then became the first head of franchise development at Disney.</p><p>We have released a few songs and one video, which I think might be the number one (I hate data points because they get outdated quickly so I might be wrong here) most traded piece on <a target="_blank" href="https://glass.xyz/">Glass</a> which is a music video NFT protocol. We’ve also created something that I think has never been done before, which was creating a mechanism that integrates traditional streaming with NFT minting. Where in order to gain access to the allow list you actually had to interact with and log yourself into your Spotify or Apple account. This is a very blockchain-native project, but I also want everyone to be able to hear the music, even if you don’t know what an NFT is, because the music is fantastic. </p><p>The first <a target="_blank" href="https://opensea.io/collection/kota-kids-of-the-apocalypse">drop</a> is a PFP (profile picture) project. It’s season one and includes the eight main characters, which you’re randomly assigned to and each of them has its own unique theme music and properties, and it’s all happening on the Blockchain. We’re doing all this on <a target="_blank" href="https://solana.com/">Solana</a>, which is a chain that I think allows for very quick movement. And part of what we want to do is really involve our community in the storytelling and really let them into all of the bits and pieces of the lore. And to me, a lot of that will come from surprise and delight and from airdrops and from opening up your wallet one day and seeing things you didn’t know were going to be in there.</p><p><strong>For those of us who are still new to this space, what is a wallet? </strong></p><p><strong>AK:</strong> The wallet is the digital space through which everything is integrated and enters into your possession. Your wallet is where you hold your cryptocurrency, where you hold your NFTs. So you may log into your wallet one day and if you’re a holder of Kids of the Apocalypse NFT, you may find something new that has been added to your wallet. We’ve also created an amazing community in Discord, and the fan art alone is pretty incredible. </p><p>I encourage people to check it out because we really are trying to build something unique. I think the <a target="_blank" href="https://www.kidsoftheapocalypse.com/landing.html">website</a> is one of the coolest websites I have seen, it is fully immersive, and we’re going to play with it.</p><p><strong>So how will the comic book and full film emerge? How is that all going to be integrated?</strong></p><p><strong>AK:</strong> The full-length film is a dream. It could be a short film too, we don’t know. The plan is for this to be a story told in a moving visual media. We’re still having discussions about how and what that will look like.</p><p><strong>Before we stop, were there any other current projects that we should be aware of?</strong></p><p><strong>AK:</strong> Yeah there are two things. After the Bowie project I felt that it was important for me to put myself out there more. I felt that there was an opportunity to experience what artists and creators in this space go through, their step-by-step process. My father was a photo journalist, and I’ve always loved photography. I had this idea going back to the idea of the blockchain as a permanent immutable ledger; and thinking of photographs, particularly snapshots, as as memory objects; and what if you minted those memories to the blockchain, and then they’re there forever. Now what happens if you then renounce your ownership of them? If you’re using the snapshot as a representation of a memory, what if I minted it, and sent it to you and now it’s yours? What does it mean for someone else to have my memory? </p><p>It was an idea that I kept coming back to and I finally felt the need to bite the bullet and just put this out there. It’s called Memory Loss. I spoke to a few artists in the crypto space to see if the idea offended anyone. I got their support and encouragement. I minted some of the snapshots and made them available on the <a target="_blank" href="https://tezos.com/">Tezos</a> blockchain, which is a space that is more experimental, low key, less pressure. It’s on the marketplace <a target="_blank" href="https://objkt.com/">Objkt</a>. I do have ideas for future ways for this to evolve.</p><p>The other project, equally experimental, gives support to visual artists who want to start playing in the music NFT space. There are some artists making really amazing music and building a fan base and building patrons and building their own worlds with their own rules in this space. I wanted to create a way for visual artists, who are curious, to safely and with integrity and respect, integrate themselves into that world. The short of it is I am launching an NFT-based singles label. The name is, W3 F3W like my company, except that the ees are 3s. It’s going to be a place for great new music and great visual art to collide and hopefully again, just bring people into a world that I’m pretty excited about.</p> <br/><br/>This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit <a href="https://futureperfect.substack.com?utm_medium=podcast&utm_campaign=CTA_1">futureperfect.substack.com</a>

July 7, 2022
#005 - Nick Fortugno: Storytelling, Design Strategies, and Interactive Theater
<p>Welcome to the FuturePerfect Podcast where we talk with compelling people breaking new ground in art, media, and entertainment. This podcast is produced by FuturePerfect Studio, an extended reality studio creating immersive experiences for global audiences. Episodes are released every two weeks, visit our website <a target="_blank" href="http://futureperfect.studio/">futureperfect.studio</a> for more details.</p><p>The text version of this interview has been edited for length and clarity. Find the full audio version above or in your favorite podcast app.</p><p>For episode 005, Wayne Ashley interviews Nick Fortugno, co-founder of the New York-based game studio <a target="_blank" href="https://playmatics.com/">Playmatics</a> and designer of numerous digital and non-digital projects, including board games, collectible card games, large-scale social games, and theater.</p><p>INTRODUCTION AND ROLEPLAYING</p><p><strong>Hey Nick, thanks for joining us. I’m really excited to dig into some of your background, ideas, projects, and particularly your alternative vision for a future of theater. I see you as a catalyst, a kind of cultural interlocutor making links across different forms of knowledge and practice, and the work you've done really attests to this. You've designed video and board games as well as outdoor public games. You're the co-founder of Playmatics, a New York game studio and the lead designer on many theater works, including </strong><a target="_blank" href="https://frankenstein.ai/"><strong>Frankenstein AI</strong></a><strong> and </strong><a target="_blank" href="https://inculture.microsoft.com/people-who-inspire/raven-immersive-iot-theater/"><strong>The Raven</strong></a><strong>. And of course, one of the lead creators of the blockbuster mobile game </strong><strong>Diner Dash</strong><strong>. </strong></p><p><strong>But first I want to go back a bit. Your cousin introduced you to roleplaying when you were quite young and you ran your first game of </strong><strong>Dungeons and Dragons</strong><strong> at six years old. Is it too much to assume that roleplaying is one of the most critical activities for you, if not a central organizing practice leaking into everything you do? Give us a sense of how roleplaying has activated much of your thinking and practice.</strong></p><p><strong>Nick Fortugno:</strong> I think a central organizing principle is like a good way of thinking about it. It doesn't inform all of my work in a literal sense, but it's the heart of how I think about aesthetics. In Dungeons and Dragons, essentially what you do is you tell stories with other people and you use a rule system to adjudicate disagreement. You have a lot of “I hit you”—“no you didn’t” stuff in roleplaying so you need rules to deal with that. </p><p>When you’re storytelling in that system and you're the person responsible for making the story, you don't story-tell the way you do in other forms where you have an idea of the story in your head and you're figuring out how to implement it in a way that will affect the audience. Instead, the players or the protagonists are interacting with you and they're changing it constantly. And so you don't know where the story is going. You have ideas of where you could go, you have ideas of what you might want to happen, but you're really in this collaborative process. </p><p>And so this idea of improvising and using systems to generate things and being responsive to the interactions of other people is very much at the heart of my work. It's how I teach, how I think about storytelling centrally, and it informs a lot of my aesthetics. So yeah I would not be the person I was today if my cousin Joey didn't teach me D&D (Dungeons and Dragons) in Glen Ellyn, Illinois.</p><p>DESIGN THINKING</p><p><strong>You're also a prolific researcher, not only of games, but of literature, theme parks, new technologies, and performance. I'm thinking about a previous discussion we had where in one breath you mentioned cultural forms that most people would never bring together in the same conversation. The list is long, but indulge me here: the British theater company </strong><a target="_blank" href="https://www.gobsquad.com/"><strong>Gob Squad</strong></a><strong>, </strong><a target="_blank" href="https://disneyland.disney.go.com/destinations/disneyland/star-wars-galaxys-edge/"><strong>Galaxy’s Edge</strong></a><strong> at Disneyland, Harry Potter hotel, the theater collective </strong><a target="_blank" href="https://thewoostergroup.org/blog/"><strong>The Wooster Group</strong></a><strong>, the blockbuster event </strong><a target="_blank" href="https://mckittrickhotel.com/sleep-no-more/#/"><strong>Sleep No More</strong></a><strong>, the novels of Joyce and Pynchon, </strong><a target="_blank" href="https://www.evermore.com/"><strong>Evermore Park</strong></a><strong> in Utah, and the epic video game </strong><a target="_blank" href="https://www.youtube.com/watch?v=AKXiKBnzpBQ"><strong>Elden Ring</strong></a><strong>.</strong> </p><p><strong>This cluster excites me because it’s how we think as well, across these kinds of groupings. You also use this concept of </strong><strong>affordances </strong><strong>to enable you to think systematically across all these activities. Can you say more about that?</strong></p><p><strong>NF:</strong> Affordance is a concept from design thinking, <a target="_blank" href="https://www.youtube.com/watch?v=CkPQj7Y6-gc">Donald Norman</a> really popularized it. It's the idea that a form has features about it that lead to certain kinds of use. There are things that are intuitive in a way, or natural in a way, that come from a form. If I put a handle in a certain place, you hold the handle and that changes your use of the device. </p><p>That idea that the forms start speaking to certain kinds of use cases is very central to thinking about interactive design. Because when you're a designer in those spaces you make the affordances. You don't tell users what to do. You give them something and you have them do it. That's why it's interactive. It’s not like a roller coaster where I strap myself in and I just ride the rails that were put out in front of me. It's more like a theme park where there's just a bunch of stuff. But I don’t go wandering off into the most boring part of the theme park. I go towards the lights, I go towards the sound, I go towards the interactive things. The design of those things that attract me, the things that challenge me, the obstacles and the rewards, all of that stuff moves me around in those spaces. This is central to the way I think about my practice.</p><p>LITERATURE, PLAY AND AMBIGUITY</p><p><strong>You have a BA in graduate study and literature. In our previous conversation, you noted an overlapping relationship between post-war American literature and the kinds of interactive narratives found in gaming. Do I have that right?</strong></p><p><strong>In our other podcasts I've been really interested in what brings disparate people to these emerging hybrid media spaces. They come from film, dance, theater, visual art, and gaming. I think you're the first person in our podcast series making connections between Pynchon and James Joyce with interactive gaming structures. I'm curious about how you came to make these connections.</strong></p><p><strong>NF:</strong> When I got interested in literature I was drawn to postwar postmodernist approaches to writing, like I’m thinking fifties, sixties, and seventies. But really you could stretch it from a Borgesian and Joycean and Steinean space up through the modern day. There's still authors like Ali Smith doing stuff like this. But when you look at like things like Pynchon and Nabokov in particular, their works start becoming a little bit obsessed with interpretation. Interpretation becomes the center of the novel. The novels become games about interpretations. </p><p>There are other authors in that space who are really breaking down the sense of what you're supposed to consume from the story because they are, in a meta way, thinking about the fact that you're interpreting them. Whether it's Crying of Lot 49 asking you to think about what communication systems are and then challenging you on how we interpret conspiracies. And that's also all over Foucault's Pendulum. Or a book like Lolita, which is basically laughing in your face about your attempts to understand it. Or Pale Fire for that matter, which I think is an even deeper experiment. </p><p>What you see over and over again is this idea that the novel is a game that the reader is playing with the novelist. It's not a puzzle. You're not going to get the answer out of it. That's not the point. And certainly postmodern poetry and people like Asbury would argue that if you got one meaning out of a poem, you didn't really read the poem anyway. The work becomes something that you as the audience have some ownership of because it is open to you and because it’s an ambiguous object that you have to work with. That’s what got me. I was already, just from roleplaying, very used to the idea that I participate in stories and that they come from this relationship with me and the text.</p><p>So I don't like talking about interactive narrative. I think that's a bad phrase because I I'm always interacting with story. That's not new, what's new is the types of affordances of interaction that I get from stories, and what the possibilities for changing those stories are, and how much the story is a fixed thing that I encounter, and how much the story is flexible to my input. To me, the literature study was partly just giving me an outlet for stories and a place where stories can actually be quite experimental because when you just write it's cheap to make crazy worlds. It's the same amount of ink to write a crazy world as it is to write a realistic one. You can go very far with literature in a way that would be harder to do in film because you have to shoot all that stuff. The drive of novels from the modernist period on has been a drive towards more and more stylistic experimentation and that has been really engaging to me because you start seeing it as almost a formal thing. You can look at it like a structure and then you can see that the structure is doing something. </p><p>Joyce’s Ulysses is an excellent example of that. Each chapter is written stylistically and formally different. There are chapters that are dialogues, there are chapters where the stream of consciousness changes radically, there are chapters that drift, and that's part of the narrative. If you go back to the Oulipo experimentation that Calvino and other French and Italian authors were doing, they were literally creating that whole idea of branching trees. You start to see that there are patterns of structures of story that we can start to establish.</p><p>That's the approach I take to this question of rhetoric. Exploration is a set of tropes, and branching is a set of tropes. It's similar, whether you're branching in a YouTube video or branching in a choose your own adventure, or branching in a game like <a target="_blank" href="https://www.youtube.com/watch?v=3NcF7EOnjow">Until Dawn</a>. The branching is similar, it has similar tropes. So we can look at it structurally and say, well, what does the structure do? How do the choices in the design of the structure change things independent of content. And then what is the intersection between the content and the structure?</p><p>DYNAMIC STRUCTURES AND GAMES</p><p><strong>It's interesting to note how the strategies found in avant-garde and experimental literature have leaked into, or have become one of the dominant ways of constructing narrative within popular culture, video games, and even marketing. What was on the periphery has, in a sense, moved to the center and become part of the entertainment industry.</strong></p><p><strong>NF:</strong> I think so because as you start moving into more dynamic and particularly digitally dynamic work it starts to have to be structural. Although that spills back into the analog, especially as internet of things (IOT) becomes very reduced in size and cost and technology starts coming back into the real world. You start seeing this there too.</p><p>I'm riffing a lot on arguments in a book called <a target="_blank" href="https://mitpress.mit.edu/books/expressive-processing">Expressive Processing</a> by Noah Wardrip-Fruin. If I make a piece of work that changes with every user and produces a different outcome, then the output of that work is not really an analysis of that work. If the work has a hundred thousand possibilities, one possibility is such a small segment of what it could be. That it gives me information as a user, but I can't really critique the work from that perspective. I have to look at the structure because it's procedural, it's not predetermined. And I think as we start moving into works that are like that, and since computers enable us to do that, that's what computers are good at is that kind of dynamic procedural, then we start to see that structural analysis and system design become more and more important. As it does, and we see the affordances that has, we can start pulling those affordances into other forms where we see similar audience relationships. </p><p>So I don't think: does theater need this? Does film need this? Does installation need this? No, It doesn't need it. You can make good art without it, and obviously we have made thousands of years of good art without it, but the possibilities of the art change when you start seeing those things. That's why I think it’s starting to permeate. Digital games are a very big industry and there's been a lot of really interesting storytelling in them. I don't think all people who study this stuff know that because it's locked a bit behind barriers of picking up a PlayStation 4 controller and trying to get through it. <a target="_blank" href="https://www.youtube.com/watch?v=pdZQ98mWeto">Shadow of Colossus</a>, for example, is one of the most important digital works ever made. But not many people experience it because it's a really hard digital game. And it has to be hard. That's part of its aesthetic. </p><p>But I think that the people who have bridged this are starting to see that you can inherit things from those forms into these other spaces. That's just changing the way we think and then you start to see work in the world that is just more procedural. Work that does just become more dynamic in its nature. Then you end up with stuff like LARP (<a target="_blank" href="http://Live action role-playing game">Live action role-playing</a>) where, you can't make LARP the way you make theater because I don't know what the players are gonna do. So my scripts in LARP can't be like a theater script, it doesn't make sense. I need a structure that will support 40 people running around doing random things.</p><p>PARTICIPATORY EXPERIENCES DRIVEN BY TECHNOLOGY</p><p><strong>This brings me to theater, particularly two participatory theatrical installations that you co-created. First, </strong><a target="_blank" href="http://frankenstein.ai/"><strong>Frankenstein AI: a monster made by many</strong></a><strong> which was an AI powered immersive experience that premiered at the 2018 Sundance Film Festival. And </strong><a target="_blank" href="https://www.filmlinc.org/nyff2019/films/the-raven/"><strong>The Raven</strong></a><strong>, which was performed as part of the Lincoln Center’s New York Film Festival in 2019. Tell us what audiences might have experienced when they participated in </strong><strong>Frankenstein AI</strong><strong> and what was the genesis of that work?</strong></p><p><strong>NF:</strong> Frankenstein AI has had a couple of different forms. Its original form was a small audience immersive experience where you came into a room and you interacted with another audience member at a surface computer that was like built into a table. It was formulated as an artificial intelligence asking you questions about what it was like to be human and you're sort of marking values on the table using a physical computing device that looked like an ouija board. That information was sent to an actual AI that was in a cloud which was used as the seed to determine a mood that the AI had. And then when you finished that exercise, you were brought into a room that was mapped with projections and IOT procedurally played drums and you would have a chance to talk to the artificial intelligence. </p><p>The artificial intelligence would generate a question and then it would be delivered in text to speech to the audience in the room. And then the audience in the room would direct the docent to type a question into a typewriter and that would be sent back to the AI. This was all formulated where there’s this AI that's been created, it has escaped into the internet and it is trying to understand what it is and what humanity is. And it’s using the narrative of Frankenstein as this thing that was created that doesn't understand its role as a seed to understand where it's going. </p><p>The whole thing was essentially a meditation on two things. One is this question of what is AI and what should we be worried about AI? These were the conversations that I had with Lance Weiler and Rachel Eve Ginsburg who were the co-creators of that project. My big argument was that everyone worries about Terminator, but what we should really be worried about is Kafka. AI is not a monster that takes us over. AI is a thing that doesn't understand us and then just acts procedurally in ways we don't understand.</p><p>This is around the time that Microsoft had released an <a target="_blank" href="https://spectrum.ieee.org/in-2016-microsofts-racist-chatbot-revealed-the-dangers-of-online-conversation#toggle-gdpr">AI that became wildly racist</a> and we were thinking about what it meant that we're teaching AI and how could we make a piece that gets people to reflect on the idea that we're engaged with artificial intelligence in the world? We are training it and we are going to teach the AI what it does. So if that's the case, what is our responsibility? The whole piece was kind of a meditation on that process. I did the creative technology design on that and some of the interactive narrative design of the sequencing of it. I'm very proud of that piece personally, because it was the first piece of creative technology that I ever actually showed in an exhibit. </p><p>I worked on the technology that connected all of devices. So it meant that when the AI changed mood, the projections changed, and the drums changed and it pulled the AI's response and then fed that into the speech to text and delivered it into the room. So I basically did the technology that connected the surface tables to the AI, to the projectors, and to the drums. This was a topic of research I've had for a long time about how technology could be used to create these like kind of seamless connections between things. You didn't see anything happen, you just asked a question and suddenly the projections and drums changed. I call that seamless technology—technology that doesn't have clear lines where it connects. I think that could be a kind of magic and that was important to me. </p><p><strong>What did you learn from producing </strong><strong>Frankenstein AI</strong><strong> that changed your approaches when you then began to develop </strong><strong>The Raven</strong><strong>? How does </strong><strong>The Raven</strong><strong> work as an experience that grew from or built upon your previous work?</strong></p><p><strong>NF:</strong> The Raven was an immersive performance where we allowed an audience into The American Irish Historical Society where they experienced a magically real story of Edgar Allan Poe’s The Raven. The center of the technology of the piece was that every user had a lantern that they carried around with them. The lantern was an IOT device that was reading beacons in the space and connected to a central system. The audience also had a set of headphones that were playing audio for them. So most of the audio that was present in the piece came from the headset that was being played based on where they were and based on a character they picked at the beginning of the piece. Everyone was sort of playing a performer in the piece. The performer Ava Lee Scott, who was playing Poe and co-wrote the piece, was moving through the space as Poe meditating with these characters. But you, as the audience, were one of the people that Poe knew from his life or his creations. </p><p>What Lance Weiler and I carried from Frankenstein AI was this idea that we could create a central technology system that was guiding all these users without having to have actors on top of those users moving them around. And that the storytelling could really be based on their decisions, because it was in part based on where you went and what you encountered. </p><p>The other thing that Frankenstein AI taught me, in a real sense, was that these technologies could be stable. The work had a server system, that's how it ran, it was a server that was running on a small piece of technology called the <a target="_blank" href="https://www.raspberrypi.org/">Raspberry Pi</a>. We turned it on and on the first day when we were running it we just didn't turn it off. We wanted to see if it would stay up overnight. And then we didn't turn it off for two full weeks. It just ran nonstop for two weeks and it never broke. We never had to restart it. So that taught me these things can be made battle ready. </p><p>We brought a similar kind of technology to The Raven. There were obviously different technical constraints to The Raven and there were different bugs we were facing, but we went through a similar process of creating a central system that guided the narrative. If we do that right and we have the right affordances to connect to the audience that can take the place of a bunch of docents, a bunch of rules, a bunch of structures, and people can just explore. Then through that exploration they can find story. </p><p>I should say that we worked with pretty robust technologies on that project. We were in partnership with Microsoft and we were using pretty heavy Azure servers and things like that, but it was not for heavy lifting stuff. It was for reliability of the delivery of the material. And then we built this gigantic XML file that was the branching script of the entire piece so that we knew where people were. We could time lights and sound cues and things like that.</p><p>THE LIMITS OF THEATER</p><p><strong>What I find compelling about both of these projects is their capacity to posit alternative models for theater's future. They either directly or implicitly suggest that theater needs to be remediated or fixed. For the purposes of this discussion, can I make that assertion?</strong></p><p><strong>NF:</strong> Yeah, I will also defend traditional theater, but… [laughs]</p><p><strong>That’s good [laughs], but what is it about certain kinds of theater that need to be remediated and how are your explorations accomplishing this? I’m very careful to say </strong><strong>alternative models</strong><strong> and I’m not asking you to generalize. I think from our audience's perspective, people are going to ask: what’s wrong with the kind of theater that I do? And why do I need these other systems? Why do I need to even consider these technologies? All these kinds of questions are implied, for better or worse, in the kind of work that you're proposing and the kind of exciting research that you're carrying out.</strong></p><p><strong>NF:</strong> First of all, there's just aesthetic possibilities that are very hard to create in a linear format like theater. Guilt is hard to create in an audience. Triumph is hard to create in an audience because they don't do anything. You can get to shame, but there's types of shame you can't get to. So there's aesthetics that become possible just when someone is culpable and when someone has the ability to achieve. That becomes kind of interesting. </p><p>Games have lots of emotions attached to victory and failure that can be leveraged in all sorts of interesting and weird ways. There are pieces like <a target="_blank" href="https://www.risapuno.com/the-privilege-of-escape#:~:text=The%20Privilege%20of%20Escape%20was,room%20before%20time%20runs%20out.">The Privilege of Escape</a>, which was an escape room that was a meditation on systemic bias. That's an interesting example of a piece where the designer was trying to use the affordances of games to demonstrate a problem in the world. And games typically do that. There's just pure emotions that are inaccessible to linear media. I think because there aren't affordances for the audience to access them, despite the diversity of emotions that these forms can create. </p><p>The second possibility is, it’s a question of how you want to engage with your audience. As an artist, I don't really like telling people stories, that doesn't really engage me.</p><p><strong>You're the second person we've interviewed who has </strong><a target="_blank" href="https://futureperfect.substack.com/p/001-krzysztof-garbaczewski-digital#details"><strong>talked disparagingly about stories and storytelling</strong></a><strong>. Say more about that.</strong></p><p><strong>NF:</strong> I don't mind being blunt about this. I'm not that interested in my biology. I'm not that interested in my history. I don't find those things that interesting. I don't think I have a vision of storytelling that's so powerful that some muse came to me uniquely and now the word of heaven is coming through my body or something. And this isn’t to knock people who do that, there are geniuses who make that work, but that's not how I create and that's not what I do. </p><p>What I want is to play with you. I want to be able to engage with you and you know, catch the ball you throw and throw it back. And this isn't altruistic just to be really clear, I mean I like doing that with people, but it's also really fun to catch a bunch of balls coming at you in crazy directions and keep the whole thing on track. There's an artistry to that. That's what running an RPG is, it's like throwing track in front of a moving train. So I think that's really powerful and you get things that you would never get otherwise. </p><p>Similarly, if you jam you get something that you would never get when you compose. The improvisation and the participation of other people leads you to create something new and you can do that with audiences. And you can do that with audiences in ways that don't make crappy, thin, gray, over-democratized work. Because I'm not saying that's not a problem, if you just let everybody come in and cook in the kitchen then you get no food or you get bland food or inedible stuff. </p><p>Structures make it possible for people to participate in ways that are meaningful, but controlled, that fit within the aesthetic. So people understand what kinds of creations are possible in this space. And that is a whole set of techniques that then allows audiences to come in completely ignorant of what you're doing and then tell a story that they helped make that is still in the aesthetic you wanted. There's a magic to that that I think is really powerful. It opens up whole new kinds of forms and it's a different way of engaging with the world for the audience and I think that's powerful because we haven't really seen it before. </p><p>There are some experiences like that, but they tend to be very high demand on the creativity or they tend to be gate-kept or they’re high skill-based. And what immersive theater can do that I think is unique and independent of digital games and LARPs, is that they can be approachable. I can show up and not really know much and still participate. And I think that's a space that's really powerful. </p><p>And then the third beat that I just have to mention all the time is that tickets are very expensive to these things. They charge a lot of money to get people into those things. I think that there's opportunity, from a business perspective, if you can figure out the scaling. You're seeing pieces like <a target="_blank" href="https://www.particleink.com/about">Particle Ink</a> in Las Vegas which is a piece with projection mapping and dance where they're starting to figure out how to grow the audiences in ways that don't hurt the piece. You start looking at genuine business models for keeping those things up. What are other business models that can keep dancers, actors, and set designers involved? Because none of those people are going away in immersive theater, we need all of those people. We need them the same way we need them in other forms. It’s a parallel skill if not an identical skill right. So we're not telling actors they're out of work. We had actors in The Raven, the actor was the center of The Raven in a lot of ways, but the actor was supplemented by all of these other things to create a new form where people can explore and make choices and feel directly engaged.</p><p>NEW FORMS OF PEDAGOGY</p><p><strong>Given this technologically seamless environment within which performance might take place, do you see the training of actors taking a different path? Or different ways for how writers produce scripts? Do we need new kinds of training for scenographers, sound and lighting designers that will accommodate and respond to these ideas and new approaches to performance? </strong></p><p><strong>NF:</strong> Well acting, for example, in these kinds of cases, has a lot more improvisation in it. It's much more deeply based in that kind of improvisation, but it's also a lot about vulnerability. This is something that I'm just going to riff off of a writer and actor that I know Char Simpson would talk about. Char was part of the <a target="_blank" href="http://www.theblackoutexperience.com/">Blackout Haunted House </a>for many years and talks very much about how they created vulnerability and that the creation of vulnerability was really important. That becomes a different way of thinking about acting. But also the idea that an audience member might ask you your favorite color and you need an answer that seems natural. That's a more roleplaying kind of acting than I think some actors are trained in, of course some actors are good at that. You don't know what's going to happen so you can't write a script the way you would normally write a script. It has to have some variation in it. You have to think about it more like story, like world building. </p><p>I think directing changes because I don't know when we're gonna hit a specific moment or I don't know what perspective I'm gonna be coming from in a specific moment. So I have to think differently about that too. And you see that in digital games which will sometimes have cut scenes that are very film-like, but they'll also have scenes where users can walk around and watch what's happening. Which is why when we talk about VR we talk more about immersive theater because the viewpoint is not singular, it is a multiple viewpoint environment. So I'm thinking about it more from that perspective. Theater in the round is also relevant here. Again, that's not a new form, but it solved this problem. So maybe VR should look at theater in the round and then learn some lessons for how you keep an audience's attention in a broad space. </p><p>And in fact, we're getting that big, we could think about station-based theater where people are really just drifting over a whole plaza and engaged in an experience. Are these forms going to change acting, writing, directing and set design? Sure, of course they are because the affordances of the audience are going be different and that's going to lead to different outputs. But it's not like we made up all this stuff just because the technology came along. We had happenings, we had station-based theater, we had rituals.</p><p><strong>I'm thinking about the Ramlila which I participated in India many decades ago in Varanasi. This is a month-long event that is played out over the entire city in which the inhabitants take on all the various roles. The city performs and becomes an immersive ritual and religious space. So there are absolutely precedences that are centuries old that we can draw upon. I’m thinking about how the pedagogical needs of theater will continue to change in response to these new forms that are becoming more and more central to our lives.</strong></p><p><strong>NF:</strong> Yeah I teach immersive and dynamic narrative and I teach it in the way that we’ve been talking about. I teach it in this very broad, cut-across-media way. Media does not matter for the purpose of the class, that's not what it's about. It's about the tropes that the media use and how those things relate. And then you see this in disciplines like narratology where people are really coming at narrative from lots of different directions and trying to figure out how stories get told.</p><p>Another point that's just very important to me is in the intersection of these forms. Because you're not going to get immersive theater from theater alone. There's a bunch of pieces that theater doesn't really know about like interaction design and a sort of multiple viewpoint about the pacing for that kind of stuff. Games understand that, but games don't understand what theater's good at. Games don’t understand how you create scenes or understand how you create dramatic power, and games don't understand the value of liveness, frankly. Some of that we can get from LARPs, but LARPs aren't theater either. So it really is in the intersection of all of these fields.</p><p>I think more of this is happening. You're seeing escape rooms get more theatrical. I think it's too slow, like way too slow. We could have gotten to where we are five years ago and we could be five years ahead of where we are right now. But you're starting to see some of that thinking happen. You're starting to see immersive pieces that are bringing some game elements into them. You can have conversations with people about VR where you talk about digital games and they don't scoff. </p><p>This focuses again on the ideas of interaction and affordance and how those relate to storytelling that changes the orbit of everything. And then the skills that people have been learning, like the acting, writing, directing, set design, costuming, they all have a place. They're all going to be there, they're just going to circle around a different sun. And that sun is this audience member who can change what you do. That's different.</p><p><strong>Nick, thanks for all of the conversations we've had. I look forward to working with you. I think you're a really important thinker and maker, and your experiments and research bring a lot of insight into the future of performance.</strong></p><p><strong>NF:</strong> Thank you, I appreciate that there are people like you that are thinking about these problems and working in these problems. Like with your own wonderful work and that podcasts like this exist to have these conversations. I look forward to a really bright future because there's other people like you in it.</p><p></p> <br/><br/>This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit <a href="https://futureperfect.substack.com?utm_medium=podcast&utm_campaign=CTA_1">futureperfect.substack.com</a>

June 2, 2022
#004 - Auriea Harvey: Early Web Art, Video Games, and XR
<p>This is the FuturePerfect Podcast where we talk with compelling people breaking new ground in art, media, and entertainment. This podcast is produced by FuturePerfect Studio, an extended reality studio creating immersive experiences for global audiences. Episodes are released every two weeks, visit our website <a target="_blank" href="http://futureperfect.studio/">futureperfect.studio</a> for more details.</p><p>The text version of this interview has been edited for length and clarity. Find the full audio version above or in your favorite podcast app.</p><p>For episode 004, Wayne Ashley interviews <a target="_blank" href="https://auriea.art/">Auriea Harvey</a>, a prolific artist producing simulations and sculptures that bridge both physical and digital space. Over the past decades she has produced net.art, online performances, video games, and sculptures that blend digital and handmade production. Harvey's work can be found in the collections of the Walker Art Center, San Francisco Museum of Modern Art, Contemporary Art Museum of Luxembourg, and Rhizome's Net Art Anthology. Her <a target="_blank" href="https://taleoftales.itch.io/">video games</a> and VR projects have been exhibited in venues all over the world.</p><p><strong>You and I have such a long overlapping history going back to the mid nineties with the emergence of net art. I was extremely inspired by your work, which was so personal and tactile, specifically your online journals composed of these sumptuous collages, poetry, photography, drawing, painting, and 3D sculptural elements. Already, one can see how passionate you were about creating dialogues between analog and digital production, which I completely connect to. There was no hierarchy between these two. </strong></p><p><strong>When I look at the extraordinary depth of work that you've created over the past two and a half decades, I can easily tease out a history of the internet and digital culture with all its promises of emancipation and boundless creativity, as well as its many discontents, which we'll get into shortly. But first I, I want to go back to the beginnings of your practice. You studied sculpture at Parson School of Design before learning web design, and then founded the game studio </strong><a target="_blank" href="https://tale-of-tales.com/"><strong>Tale of Tales</strong></a><strong>. How did you make that leap from sculpture to net art?</strong></p><p><strong>Auriea Harvey:</strong> I would say that I not only studied sculpture, but I also studied design to a certain extent. Although I was a bit of an autodidact for a long time, meaning that my main skill was computers in addition to sculpture. So the fact that I was so passionate about computers really led me directly into this confrontation. Well, okay love of computers and lack of space, being a young person in New York City in the early nineties. </p><p>And when I found the internet, it immediately struck me that everything I could do online was a sculpture. You know, it was a time of broadening these definitions of what a sculpture could be. There were people who were asking is video sculpture? Is installation sculpture? It seems obvious now, but at the time it was very much a question. And so I looked at the internet and said, is the internet sculpture? I began seeking the ways in which the internet was sculpture. And in some ways that sculpture was social. In some ways that sculpture was this multimedia and interactive landscape that was totally unexplored. And that was really interesting for me.</p><p><strong>Out of this you started doing online performance. Back in 1999, we brought you to Brooklyn Academy of Music to perform </strong><a target="_blank" href="http://www.entropy8zuper.org/wirefire/i.html"><strong>Wirefire</strong></a><strong>. 23 years ago you were already thinking about the internet as a place to do performance. Can you talk about this?</strong></p><p><strong>AH:</strong> Wirefire was very much a realtime performance. Michaël [Samyn] and I met every week, we had started it before we even lived together when I was still in New York City and he was in Belgium, and we created it as a way to communicate with one another. If you rewind and think back, the only way you could really talk to someone back then through the internet was via text. There was no video and there was no audio really. We thought text was completely inadequate and both of us, being very adept at internet languages, decided to create this system where we could communicate with each other through anything. </p><p>We could upload sounds, animations, and could have real time chat. We could also invite the audience and offer them a way to interact with the performance and everyone could see it at the same time. And this was something that was kind of unheard of in 1999 or very rare. We did this from 1999 until around 2003. The site is still there and it sort of has a documentation of all the places where we also took it live. After he and I started living together, we started doing these things live also because it creates a big spectacle. It’s something that we did that I'm really proud of.</p><p><strong>So with the emergence of Web 2.0, you stopped making this work. What happened?</strong></p><p><strong>AH:</strong> Well, the beauty of the early web or Web 1.0 as people will say, was that it was this very big time of innocence. I would say it started with blogging, that was the beginning of the end. That was like the end of it all for me. It felt like it was taking away the power of computing from people. It did open up the web to a different subset of people, but I felt that those people should learn how to program HTML, I felt like this was very empowering. I could see that this was slowly eating away at people's ability to see the computer for what it was, which was an open a box of tricks. And you could pull out any of those tricks and use them in any number of ways.</p><p>Slowly over the years, indeed, you've seen this closing down, you know, to the point where now websites have a hamburger menu on the side and there’s expected to be good navigation (I’m making air quotes). Whereas we were all about crashing the browser and making people think. Of course there were bad actors who took advantage of the freedom that the web had to offer, but it seems to me like there were better solutions than what Web 2.0 turned out to be.</p><p><strong>It became much more templatized as well.</strong></p><p><strong>AH:</strong> Yeah it became more templatized, people are basically ignorant about what they can do with their computers now. It's not about computers, it's about phones. It's not about computers, it's about using services. It's about subscriptions. It's not about building anything, you know? Only a few people still build, and it’s made more and more complicated through the way corporations have controlled the computing environment and the internet and our interactions on it. Back then I could see that coming, let's say, and I was like, nope we're outta here, let’s do something else.</p><p><strong>I want to read something from a </strong><a target="_blank" href="https://tale-of-tales.com/tales/RAM.html"><strong>manifesto</strong></a><strong> you wrote with your partner Michäel Samyn in 2006. I think this will form a kind of way for you discuss your whole new transformation into working with gaming.</strong></p><p><strong>Realtime 3D is the most remarkable new creative technology since oil on canvas. It is much too important to be wasted on computer games alone. This manifesto is a call-to-arms for creative people (including, but not limited to, video game designers and fine artists) to embrace this new medium and start realizing its enormous potential. As well as a set of guidelines that express our own ideas and ideals about using the technology.</strong></p><p><strong>It is much too important to remain in the hands of toy makers and propaganda machines. We need to rip the technology out of their greedy claws and put them to shame by producing the most stunning art to grace this planet so far. (And claim the name “game” for what we do even if it is inappropriate.)</strong></p><p><strong>I love hearing that. What did you want to accomplish with this manifesto? And why did gaming suddenly become a compelling arena for you to explore and experiment?</strong></p><p><strong>AH:</strong> Well, we really saw video games as an interactive art form. But this was 2002 or 2003, and so video games didn't know that yet. But we just looked at it and we’re like, this is interactive. People spend hours 20 hours playing a video game, and you can't get that with a painting [laughs].</p><p>We had been playing a lot of video games and we didn't understand them at first. We played them and questioned why they were doing this with the technology? It's as if we were visiting an alien planet and we could not compute why this was the only thing that was happening—RPGs with random battles, fighting games, driving games, adventure games. There were several genres that you had to fit into in order to sell a video game at that time. There were, of course, exceptions. But this was pretty much the world we were walking into. </p><p>So when we gave that manifesto, which is called the <a target="_blank" href="https://tale-of-tales.com/tales/RAM.html">Realtime Art Manifesto</a>, we really thought that the most remarkable thing here was that you were making something that, like the internet, allowed for realtime communication. People could be inside a world when you played a video game, you were completely lost in it. Now you would look at certain video games and you wouldn't understand what was so special about that world, but at the time when you played, and even now when you play video games, of course it's like being inside a book, but more real, it feels real. That was what was important to us. It was something I had experienced with early VR, for example, but more so in a certain way, because it was these works of imagination. Now our problem was the imagination that we saw within video games seemed extremely limited and we wanted to be able to use it for ourselves, but also encourage others to look at video games as something that was wide open. </p><p>That was, again, that box of tricks that you could just do whatever you wanted with. Literally it's like, come on creators, you can do anything with this, you can make any world! And we were some of the first to really make a point of this. There was an undercurrent in game studies at that time in 2006 trying to point this out, but there were very few examples. </p><p>So we really devoted ourselves to creating that example and encouraging other people to change their thinking around video games. And we threw in that last part “even if the word game is inappropriate,” because people were eager for us to name this change. There was a big discourse at the time around: what is a game? We thought that was the most boring question ever. We were like, we're not doing that, we're not talking semantics, this is real stuff here. So we said it's a video game and that’s it. So we started our little journey there, with the manifesto, and it was quite a controversy, at the time, to say these things.</p><p><strong>What was controversial about it?</strong></p><p><strong>AH:</strong> Well, the thing we had to learn about gamers was that they quickly feel like you're coming for their stuff. There was a lot of discussion back then, and maybe there still is, about “do games cause violence?” Everyone was kind of down on gaming, saying it’s for kids, or it’s dangerous. And you had the US Army with their recruitment game. People were testing the limits, both psychologically and aesthetically, of what a game could be. And so gamers could be very touchy about this subject of “what is a game?” We never tried to take anything away, we were just trying to add something to that, but gamers often were feeling sensitive about [laughs] their Mario. They couldn’t stand it if you dared to disdain these types of games. And we disdained a lot.</p><p><strong>But out of that you produced several games and one of them, </strong><a target="_blank" href="https://tale-of-tales.com/TheEndlessForest/"><strong>The Endless Forest</strong></a><strong>, was, according to your words, one of the most successful games that you've created. It continues to circulate and you're currently developing a new version with Unreal Engine. Tell us a little bit about what it’s like to play or experience.</strong></p><p><strong>AH: </strong>We released The Endless Forest back in 2006. It was a multiplayer game where everyone plays a deer in a forest. It was ultimately meant to be this very peaceful gesture at a time when everyone was playing <a target="_blank" href="https://www.youtube.com/watch?v=YEvW64bTeBk">World of Warcraft</a>. We made this game as sort of the antidote to that. It was something we felt people who played World of Warcraft could dip into for five minutes. The thought of playing a game for a short amount of time in 2005 was rare. The fact that people would play games for hours and hours was what drew me to games. But at the same time, once I got there, it felt like people need experiences that they only play for 5 or 10 minutes. They can come to a world that’s always there for them, but they go there and it's not about killing. It's not about points. It's not about gaining anything. It's just about being there and feeling it. </p><p>And so when you're in The Endless Forest, you're there and you feel like an animal, you feel like a deer running through a forest and it's very joyful and funny. You run into other animals in the forest and those are all people playing the game and you sort of have to make up a language because there's no chat in the game. That was the big innovation, that you couldn't talk to each other, you could only make noises or sort of dance, but you find things in the forest, you play together in the forest, and do whatever you want. </p><p>That was the other thing, there were no rules. So people made up their own rules about the world. They made up their own stories. There were songs written about The Endless Forest, tons of stories, and artworks created about it. People made friends in the forest, people died and had memorials in the forest, like any other multiplayer game. Except for this one was a very specific fantasy about nature and utopia, I suppose. It was our hope that people would take all this beauty and feeling of joy and take that out into the real world and in their interactions with other people and understand that you don't really have to understand each other exactly. I think it was very successful because people are still playing it and it's always been free. We've kept it that way all through the ideas of monetization. We wanted to let people enjoy it. Which again, was kind of anti Web 2.0 thinking, you know?</p><p><strong>And you're going to relaunch this as a new updated version. When is that coming out?</strong></p><p><strong>AH:</strong> The <a target="_blank" href="https://tale-of-tales.com/TheEndlessForest/">beta</a> is out already. We don't know when it'll be fixed because it's one of those done when it's done kind of projects since we're doing this as a side thing. We decided to remake it, and it wasn't exactly necessary. We were just just worried about the technology failing on us, so we wanted to make sure we had found a way to make The Endless Forest truly endless.</p><p><strong>With all this excitement, then, about video games and their artistic and social possibilities, you stopped making video games. Why?</strong></p><p><strong>AH:</strong> I stopped making video games because I felt that we had said all that we had to say through the format of the commercial video game that is sold through an online store that people download and play on a PC. The part of the manifesto that I never let go of, that I felt was the key to that whole manifesto, is the realtime part. Even with the internet, when I was making websites, that was the important thing. It was realtime. People were there all connected to the same page. We made several works that were just visualizing this fact. Now we take it for granted that when you're on Twitter, everybody's sitting there on Twitter together, but back then it was very special to say, look, there's someone else here on this page. That real time aspect was something we took from games, this notion that things are being executed 60 frames a second. Even if someone else isn't there with you, you are there with the virtual creature and that virtual creature is reacting to you in realtime. </p><p>So I stopped making video games because in some ways it felt like the world of gaming was getting in my head a little too much. In a very negative way, because it was a business we were running and I didn't feel like being a business person on the one hand, and on the other hand dealing with the audience part became a much bigger task. It was sometimes really unpleasant. Not so much for the players of our games, but just in general, the whole way in which games were created, sold and marketed became something that I couldn't agree with. </p><p>We made our last video game in 2015, a game called <a target="_blank" href="https://tale-of-tales.com/presskit/sheet.php?p=sunset">Sunset</a>, which had a very strong political message that was in some ways over people's heads. We knew it was going to be, but at the same time it was kind of like our final say, the last thing we could say about video games. We were going to try to make a game that's kind of normal, being that it was just a first person game played like other first person games, but at the same time use it to get across this political message about the time we live in by talking about the past.</p><p>It’s a very complex game. And I think it ended up being so complex because we knew what we were doing at last, we knew exactly how to make a game in a year, how to stay under budget, how to put together a team, how to market it. But then everything we wanted to say came out in a rush. It was like trying to put together a very intricate puzzle and make it something that people could explore. And it just felt like maybe this doesn't need to be a game. For the first time, after all the years of people telling us, did that really need to be a game? We suddenly asked ourselves does this really have to be a game? It felt like it was time to do something else.</p><p><strong>In our previous conversations you talked about the work of Polish director Tadeusz Kantor and this residency you had in 2017. It sounded like a kind of really interesting re-engagement with the potential of computation and VR. What was it about Kantor’s work that moved you and re-inspired you?</strong></p><p><strong>AH:</strong> So we had stopped, we had left what we felt was a toxic environment, but that toxic environment was still in our heads. We still didn't understand how to just be artists again and not be these people involved in this business and the games industry. We accepted a very strange offer that we got from the Polish Ministry of Culture to come to Poland and take part in this residency through the <a target="_blank" href="http://kantorfoundation.pl/en/">Tadeusz Kantor Foundation</a> where they were opening up his summer home to artists to come and live there and create work. </p><p>They sent us videos of his performances and we watched them and I was completely shocked. I was open mouth, flabbergasted, because I was just like, what is this? It was a whole other world and it took a while for me to really parse it. And I loved that. I loved the fact that it did something to my brain, that my brain was not ready for. Even though these were performances that happened in the nineties or eighties, it was beautiful. The more we watched his work and the way that he was interacting with his performers on stage it became an inspirational moment. We felt, this is the same as what we’re interested in, he’s directing this realtime performance, very much moving his actors around the stage and emotionally involved in every single line, and we felt this could translate into VR.</p><p>The thing that really did it for us was that for him, there was no difference between a doll and a human actor. And that reminded us, okay, what is that in 3D? When you make a world, what makes one thing alive and another thing not alive. And in a way it's just all programming. Out of this we made <a target="_blank" href="https://taleoftales.itch.io/cricoterie">Cricoterie</a>, which we started at his summer home in the in the middle of the woods outside Kraków, Poland in this really creepy house. I mean it wasn’t just creepy, It was beautiful, but he's got this giant chair outside, one of his artworks.</p><p>It was just really an interesting difference between what we were doing before and what we were hoping to do now. VR was something we knew we wanted to experiment with as a way of getting out of our normal computing mode. Also, we liked the fact that when you put on the VR headset, you are really there. It's not so much about imagination, but about tangible facts, for lack of better ways of saying it. We wanted to make performances. We saw VR as something that few people were ever going to have the equipment at home, so it's perfect for actually staging things. We wanted to create installations around our VR. We staged Cricoterie at the Palace of Science and Culture in Warsaw and also had a showing at a gallery in Kraków, which was really wonderful. And had a few other showings of it also in Basel at the Museum Tinguely.</p><p><strong>And now you're going to have two shows that are upcoming, one at </strong><a target="_blank" href="https://themomentary.org/artist-in-residence-program/"><strong>The Momentary</strong></a><strong> in Bentonville, Arkansas, which is an old cheese factory turned to a contemporary art space for visual and performing arts. And then a second show inside the online space called </strong><a target="_blank" href="https://feralfile.com/"><strong>Feral File</strong></a><strong>.</strong></p><p><strong>AH:</strong> Yeah, during the pandemic I leaned into the fact that I wanted to make sculpture. I had my first <a target="_blank" href="https://bitforms.art/">solo show at bitforms gallery</a> in New York City during lockdown. It was around that time where I realized that the digital work that I had been creating all along was suddenly also valued. Because outside of games, digital work was under-appreciated by the art world and really by everyone. I had been making all these digital objects all along and 3D modeling has been my life for the past 20 years.</p><p>I wanted to create sculptures that were not only physical sculptures, but also digital, people could see these works as AR sculptures. And of course it was during this time when people started selling NFTs and so suddenly it became a moment where people wanted to collect these virtual sculptures as if they were real. The thing about sculpture is, and it touches on a conclusion that I came to when I had the burnout experience in 2011, was that sometimes things don't have to move, sometimes things can be simply what they are. This beauty that can transcend space time and that realtime that I always comes back to</p><p>For <a target="_blank" href="https://feralfile.com/profiles/Auriea%20Harvey">Feral File</a> it’s going to be completely virtual pieces being that it’s an NFT show. It’s a well respected space run by Casey Reas, one of those old school digital artists and someone I respect greatly. He's managed to create a space that isn’t just about being marketplace, but it's about online exhibition, something we all kind of became used to during the pandemic. But now that it’s not that anymore, how can you even understand what an online show is? How can you create a venue for that for artists who take digital work seriously? It’s not just about, how do I put it, the ugly JPEGs, but about the actual work that a lot of us have been doing all along.</p><p><strong>Thank you Auriea, this is great. There’s of course a lot more to talk about. This conversation gives us a good overview, not only into your career, but also a history of the internet. I can completely relate to that and have gone through similar phases.</strong></p><p><strong>AH:</strong> Thank you so much. It's been great to know you all these years and to think back on what we have seen, right? So thank you for having me on the podcast.</p> <br/><br/>This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit <a href="https://futureperfect.substack.com?utm_medium=podcast&utm_campaign=CTA_1">futureperfect.substack.com</a>
6 total episodes available
Deep-dive analytics for FuturePerfect Podcast
Frequently asked questions
Have a different question and can't find the answer you're looking for? Reach out to our support team by sending us an email and we'll get back to you as soon as we can.
- What is FuturePerfect Podcast?
- How often does this podcast release new episodes?
This podcast updates daily.
- Where can I listen to this podcast?
This podcast is available on 4 platforms including Apple Podcasts, Spotify, and more. You can also use the RSS feed directly.
- Does this podcast accept guests?
Yes, this podcast regularly features guests.
Legal Disclaimer
Pod Engine is not affiliated with, endorsed by, or officially connected with any of the podcasts displayed on this platform. We operate independently as a podcast discovery and analytics service.
All podcast artwork, thumbnails, and content displayed on this page are the property of their respective owners and are protected by applicable copyright laws. This includes, but is not limited to, podcast cover art, episode artwork, show descriptions, episode titles, transcripts, audio snippets, and any other content originating from the podcast creators or their licensors.
We display this content under fair use principles and/or implied license for the purpose of podcast discovery, information, and commentary. We make no claim of ownership over any podcast content, artwork, or related materials shown on this platform. All trademarks, service marks, and trade names are the property of their respective owners.
While we strive to ensure all content usage is properly authorized, if you are a rights holder and believe your content is being used inappropriately or without proper authorization, please contact us immediately at hey@podengine.ai for prompt review and appropriate action, which may include content removal or proper attribution.
By accessing and using this platform, you acknowledge and agree to respect all applicable copyright laws and intellectual property rights of content owners. Any unauthorized reproduction, distribution, or commercial use of the content displayed on this platform is strictly prohibited.
