Multimodal AI-Edited Supercuts
I’m so busy and life is just so short. There are so many movies, youtube clips, podcasts, books, and other kinds of media I wish I could consume, but just don’t have the time to - but that doesn’t mean I don’t want to experience them!
Lately, I’ve been excited about the idea of having really intelligent, artful supercuts automatically generated for me using Multimodal AI. Imagine having a “reading list” or “watch later” playlist of some sort and being able to choose whether you want to watch an immersive 1 minute, 5 minute, 10 minute, 30 minute version of some kind of media and being able to jump between them or into the “original version” at any time, if it really captivates you.
I’m not talking about simple video summaries or something bland like some select clips with a voiceover. I’m also not talking about some kind of brain-rot six second TikTok video summary. I’m talking about something immersive where multimodal AI is used to “fill in the gaps” and cleverly stitch together a much shorter version of something like a two hour blockbuster movie. In fact, imagine the AI model even regenerating or reimagining parts of a movie, true to its style, concept, story, audio design, and characters allowing you fully experience it, but just on a shorter time frame.
A good video edit takes skill and would require clever craft of storytelling, it would require understanding the implicit themes in the work, its rich cinematography, seamlessly transitioning between scenes, and being able to simplify it to its pure essence … imagine if all this could be done instantly with an AI model.
Experiencing art is a rich and important part of living life itself. Whether you’re a busy parent, stressed out business leader, or working two jobs just to pay your rent in New York City, it’s important we use technology to create new ways to radically include others. Everyone has different times available and commitments in front of them, but the more effort we can put in to accommodate people and offer flexibility when it comes to consuming our creations, the richer of a human experience we can create for each other.