The Burghers' Quiet Truth
This essay is unusual for this website: longer and more thoroughly sourced. The reason for that is that it has grown and changed over the months, as the world and my thinking have grown and changed. It has become a kind of living document for me to nurture. It was last updated in March 2023.
Once upon a time, when I was a young computer science student at Stanford, I got myself into trouble. Never mind how, exactlyâ that is not the point of this essay. What matters today is how I got out: walking home on campus that night, I passed a sculpture that changed my life.
If youâve ever visited Stanford, youâll know the sculpture I mean. It depicts a scene from the Hundred Yearsâ War: six noblemen in the beseiged port city of Calais sacrifice themselves to save their fellow citizens. You would expect these heroes to be towering, glorified figures, but walk up to them and youâll see them as the sculptor Rodin saw themâfear in their bowed eyes, despair in their knotted handsâposture so unconventional that Rodinâs patrons simply refused to display the sculpture at first. A century later, I stood among those âBurghersâ and sobbed as I, too, saw the gritty everyday horror of doing the right thing.
This is what artists do: they see anew, they show anew. In ways small and large, they tap into our shared humanity to change our minds and our lives.
So why are we so eager to replace artists with AIâ which has no humanity to share, no life to change?
The allure is clear, of course: todayâs AI products output content instantly and for free. Language models like OpenAIâs GPT-3 output strikingly coherent text, even fooling some into thinking they are sentient. Diffusion models like DALL-E 2 or âStable Diffusionâ output visually attractive images that are already winning blue ribbons in art competitions. Google and Meta are exploring video and Stability is working on music. Itâs no surprise that people are excited.
But as an AI researcher myself, now a PhD student studying AI and computer graphics at MIT, I do not feel excited. As much as I want to love these beautiful algorithmsâas much as they are manifestations of my childhood dreams, dreams that guided me into my very careerâI can only find myself heartbroken when I think about todayâs AI products.
Heartbreak? But what is there to mourn? âGenerative AIâ products are marketed as âcreative toolsâââmagicalâ and the stuff of âdreamsââso you might wonder how they could possibly harm anyone. Know, first, that they are built by ransacking and misappropriating artistsâ work: that is, by training on enormous corpora of human-created texts and images bulk-harvested without their consent. These corpora were collected for research purposes, but are now used in commercialized technology (some call this a kind of âdata launderingâ). The corpora may include contributions from you, maybe even from your private medical records.
Because this data is all that AI products have seen, it is all they can output: hence, language models are easily coaxed into regurgitating entire copyrighted paragraphs and sensitive information verbatim from the Internet. Diffusion models are known to perform best when deliberately âsteal[ing] the lookâ of specific artists and their characteristic styles, occasionally outputting stock image watermarks and artistsâ signatures, and researchers have shown that they âblatantly copyâ images from their training sets and often output copies of images âmemorizedâ from the training dataset.
This behavior would be unacceptable from any human writer or artist, but is inevitable from AI optimized to reproduce its training data. The products are pastiche machines, clichĂ© factories. Even the human âpromptâ given to the AI product is often largely an instruction for whose work to exploit. Prompts often end with the brazen phrase âin the style of so-and-so,â which leaves the exploited artist feeling violated, dehumanized, anxious, and harassed. It is not because a machine can so easily imitate their lifeâs workâeven a photocopier could do that. Rather, it is because that machineâs users so easily treat pieces of the artistâs selfhood as cheap fuel for their own profits.
I do not think those users are malicious, for the most part. I think they are deceived. It is so easy to sit back and enjoy the illusion of originality these models give you, so easy to commend yourself for adapting to a new tool, so easy to fool yourself into thinking you are thinking. But, as Ted Chiang explains, âstarting with a blurry copy of unoriginal work isnât a good way to create original work.â To press that button is to stir an unfathomably deep cauldron of stolen labor, and I canât bring myself to do it.
Though todayâs AI content creation products are obscured by the mystique and impenetrability of neural networks, their business model is really nothing new. When I think about the products, Iâm reminded of the infamous âFirst Quartoâ: a bizarre bootleg Hamlet that was produced (scholars believe) by memorizing, reconstructing, and reselling Shakespeareâs script. âTo be, or not to be / ay, thereâs the point!â it parrots stupidlyâ it can capture the Bardâs cadence, perhaps, but never his piercing insight into human nature. Todayâs AI products are no better than that 17th-century pirate: they peddle cheap patchworks of memorial reconstructions. It is creation born of greed and impatience, for those who crave aesthetic payoff without facing what one filmmaker calls the âdevelopment of the soulâ and one songwriter calls âthe complex, internal human struggle of creation.â
But of course, soulless imitation is still imitation. Well then, can the original artists at least demand acknowledgement and compensation from AI companies? You would think we in the AI community would know the value of citations, on which our careers are madeâ but for now, we have thrown up our hands and decided that it is simply impossible at this colossal scale.
Instead, AI companies claim that their products are âfair use,â likening their algorithmsâ âtrainingâ procedures to a writer reading many books or a painter seeing many pictures in a lifetimeâa legally untested and questionable theory, which at its worst is nihilistic and dehumanizing. To be clear, your media consumption is a miniscule fraction of AIâs diet, and as researchers have repeatedly argued, you donât âlearnâ by memorizing patterns in data the way AI does (you didnât need an entire Internet full of giraffe pictures to learn what a giraffe isâ the first one or two were enough!). Your understanding of the world is grounded in lived experience in a physical and social world, and thus you have your own original, transformative ideas and experiences to add to your influences. We have always drawn such lines around questions of originality and engagement with source material: we distinguish morally between Thomas Kydâs The Spanish Tragedy, which inspired Shakespeare, and the bootleg âFirst Quarto,â which plagiarized him.
Similarly, we accept parodies, remixes, collages, and âappropriation art,â because they require artists to engage thoughtfully and empathetically with the source materials, recontextualizing them through their own lived experiences. It is one thing for Mostly Other People do the Killing to perform a note-by-note re-enactment of Kind of Blue, or for Andy Warhol to painstakingly reproduce Brillo Boxes by silkscreening, or for Pierre Menard to understand and embody Cervantes so well as to reproduce Don Quixote himself. It is entirely another to use an algorithm to conveniently stitch together words and images from a dataset without even looking at themâperhaps precisely to avoid looking at and learning from them.
I began writing this essay in August of 2022. Week after week it grew, and draft after draft spread around MIT. Patterns emerged in peopleâs responses. I learned that even as a practicing AI researcher, it is easy to find yourself dismissed as anti-progress or âLudditeâ for questioning how the current generation of AI content creation products are being deployed. When I ask my colleagues what they think, they are likely to shrug and explain to me how art has long benefited from technological innovationâhow the printing press, the camera, and the synthesizer all created ânew artistic possibilities.â
It frustrates me: a tempting analogy, easy and candy-coated, superficial and erasing of nuanceâ like âAI artâ itself. The analogy forgets that none of those innovations were powered solely by a monstrous injustice to artists past and present. In its monomaniacal preoccupation with ânew artistic possibilities,â it forgets too that we already turn away from some existing modes of expression for their harms: we regulate the trade of ivory though its carvings can be beautiful; we hold blackface minstrel shows to be in horrifyingly poor taste though in their time they were popular and well-attended. (I am not writing about the broader harms of generative AI products today, but I would be remiss not to mention that they already facilitate widespread harm through abuse and negligence: nonconsensual pornography, academic dishonesty and cheating, insecure code, bias and falsehoods in scientific papers, floods of disinformation, irresponsible use in medical settings, and more.)
Most disappointingly, the analogy forgets that at its best, AI does create genuinely new artistic possibilitiesâ as a medium for interrogating what it means to be human, but also as a technology that complements and even grows the artistic enterprise. Think of NVIDIAâs AI-accelerated rendering, which enables the beautiful realtime 3D graphics of todayâs video games, or my labmatesâ work with Adobe on AI-assisted cameras that enable ânight modeâ on smartphones. The complaint is not with all AI technologies current, past, or future: it is with the few truly problematic ones that dominate our attention and discourse.
In general, there is nothing intrinsically wrong with using AI technology to offset meaningless drudgery for humans, in art or otherwise. For example, automated programming assistants built on the same GPT-3 technology are broadly accepted and welcomed (as long as they are built fairly, without ignoring licensing terms of the training data or regurgitating proprietary code verbatim, behavior for which a class-action lawsuit has been filed against GitHubâs âCopilotâ product). But what the current wave of âgenerative AIâ products target isnât meaningless drudgeryâit is precisely that irreplaceable work of being human, of seeing-and-showing-anew that is ceded to databases of the past. Totalizing by design, and at unprecedented scale, AI companies propose that a few minutes of unskilled âprompt engineeringâ (âengineering,â not âartistryâ) is all anyone needs now that they have conquered and colonized creation. They speak of âdemocratizingâ artâas if freelance illustrators and novelists were somehow holding it hostage!âbut to me their language of âforce multipliers,â âkiller appsâ and âexplosions of creativityâ to which artists âadapt or dieâ rings only of violence and devastation. âArt is dead, dude,â says the enthusiast who won the blue ribbon with his AI output, âItâs over. AI won. Humans lost.â
It may be a little soon to say âlost.â But it is true that at stake here is not only artistsâ professional dignity, but also their livelihoods. In a world where passable, just-good-enough content can be summoned instantly for pennies, it is hard to imagine a sustainable market for all but the highest strata of artists (AI products acknowledge this themselves). As Roald Dahl writes in a prophetic 1954 short story, âThe Great Automatic Grammatizor,â
The quality may be inferior, but that doesnât matter. Itâs the cost of production that counts. And storiesâwellâtheyâre just another product, like carpets and chairs, and no one cares how you produce them so long as you deliver the goods. Weâll sell them wholesale, Mr Bohlen! Weâll undercut every writer in the country! Weâll corner the market!
Of course, some artists will have the economic security to keep pursuing their passions. Some will think deeply about AI and use it thoughtfully to create marvelous experiences. And some will mindlessly ride the wave to fame and fortune: âMake money from this sector if you want to make money,â suggests the founder of Stability AI, âitâll be far more fun.â
But how about the rest? How cruel and entitled would we be to displace the very artists who fed the machines replacing them? Not only the renowned poets and painters, but also the freelance anime artists, voice actors, and beloved childrenâs storybook authors, who each bring the little bit of love and creative oomph that in aggregate turns our cultural wheels: why are we so eager to deny them their already-grueling livelihoods?
Even if we decide that artists are the inevitable economic casualties of technical progress, I do not think we are ready for the impact of their loss. Are we sure we want a world of endless simulacra, churning and re-churning the past, pressing that button until we are given something we likeâwhat one former algorithm artist calls the slot machine-ification of art, the âcorporate capture of the imaginationââwhat the founder of Stability AI himself calls âpoop[ing] rainbows,â as if mixing all our paints produces anything brighter than a dull gray sludge? Do we really wish to be served up an infinite feed of sterile content to consume, as if we are livestock to be fattened and not live minds to be challengedâcomfortedâchanged?
I have to say, I have not prepared myself for the overwhelming loneliness of that world. I donât know how. In that world I am no longer primed to attribute expressive intentâthat fundamental affirmation of shared humanityâto texts and images. The bully on my left taps my shoulder on the right; day by day, I learn not to look. I become skeptical of honest expression and anxious that even my therapist is a mirage; even in moments of profound sorrow and loss I am given hollow AI-output text to chew on for solace. Where will I turn for the wisdom-intimacy-truth of one mind engaging another, for the moment of communion that an artist facilitates with their workâto be shown anew? Will my future children doodle me on their tablets, or will they ask a diffusion model for an aging Indian man? Will they write their own wedding vows? Will someone stop to write my obituary, or will a language model be prompted to synthesize my visible achievements from the statistical wash of countless others?
Call me dramatic if you willâ even that would acknowledge my human vulnerability. I am young and this is my field and my future. I worry. Day after day I walk past the graffiti on Massachusetts Avenue, and I find myself hoping that artists wonât let us get away with it.
I hope because I know it doesnât have to be this way. Tech enthusiasts speak in the language of inevitability: âcat out of bag,â âgenie out of bottle,â âfloodgates open,â âno going back now.â But while new technological discoveries may be inevitable, their place in our society is up to us all. We embrace most of them, but not everything makes the cutâ and when we exercise that agency, we are not stepping back, we are stepping forward. Just like our predecessors dared to imagine a future beyond leaded fuel, CFCs and DDT (often to great ridicule from oil and chemical companies), I challenge us now to imagine a future beyond the current generation of AI content creation products: a future that regards humanity not as an inefficiency gumming up the creative enterprise, but as the very enterprise itself.
Some days I wake up and find the world reacting already. AI output has been banned or limited by artistic communities like Newgrounds, marketplaces like Getty Images, writersâ platforms like Medium, and even programming communities like StackOverflow, AI conferences like ICML, journals like Science and Nature, and NYC schools. Artists have pushed platforms to enact protections for them on platforms like DeviantArt and Kickstarter, and they are organizing to protest platforms that refuse, such as ArtStation. Organizations like Bad Hand Books, 3dtotal, the Society of Illustrators, and even machine learning publication Towards Data Science have stated that they will proudly commission original, thoughtful work, as publishers have for centuries. Researchers are designing new techniques to protect artists. Meanwhile, artists continue to speak out against publications that economize with lazy AI illustration, as readers did at The Atlantic, publishing houses like Tor Publishing that try to pass off AI output for cover art, video game developers that use AI content creation to generate free assets, artistic tools like Adobeâs that threaten to scrape artistsâ works-in-progress, news sites like CNET that are publishing AI-written articles rife with plagiarism and apps like Lensa that profit from their usersâ images. AI output has for now been deemed ineligible for copyright protection. A class-action lawsuit has been filed against Stability AI, DeviantArt, and Midjourney; Getty Images has sued Stability AI as well.
Yes, on those days I feel some hopeâ but even that hope is swaddled in a dark sorrow. Ad-hoc bans are stop-gap solutions, thoughtful regulation takes time to forge. And what does that boarded-up future look like, anyway?
Between you and me, Iâm playing for higher stakes here. If there is anything I stand for, it is a profound unity between the arts and the sciencesâin Lisel Muellerâs words, a vision of islands as lost children of one great continent. Todayâs AI products threaten that oneness: technologists who are embarrassingly hostile to artists, artists who then take up arms against technology. But I love both my parents. I want us to do better. I want usâallâto create with intention and empathy. And I want us to listen: if not to each other, then at least to Rodinâs Burghers whispering their quiet truth into the heart of Silicon Valley.