Post-production is extremely nuanced with unique requirements. Many of the AI tools out there simply don't work for us. But what tools do and how can you use them? In this episode of 5 THINGS, I'll introduce you to a few tools that you probably haven't heard of and that are just perfect for post-production.
1. StoryToolKitAI
01:03
2. Twelve Labs
03:50
3. Curio Anywhere
05:45 Breaking News: Curio AI is acquired by Wasabi: https://venturebeat.com/data-infrastructure/aws-rival-wasabi-acquires-curio-ai-to-add-intelligence-to-its-unlimited-cloud-storage-offering/
4. CodeProject.AI Server
07:54
5. Pinokio
09:36
Interview with Aaron Edell, CEO of GrayMeta: https://blog.mediasilo.com/graymeta-eases-our-fears-of-a-robot-takeover
Full blog, plus images & transcript: https://5thingsseries.com/episode/ai-tools-for-post-production-you-havent-heard-of
What 5 THINGS do you want to know about? Let me know!
5THINGS is built with a bunch of tools because not one tool is perfect for every job.
The views represented in this video are solely those of Michael Kammes and do not represent
those of sponsors, employers, manufacturers, or clients unless otherwise stated.
All videos retain 5THINGS editorial control. You can buy me a drink, but not good press.
FOLLOW
-------------------------------------------------
Web: http://www.5thingsseries.com
Twitter: http://www.twitter.com/michaelkammes
Facebook: http://www.facebook.com/michaelkammes
Facebook: http://www.facebook.com/5thingsseries
Instagram: http://www.instagram.com/michaelkammes
EXCERPT
-------------------------------------------------
Post-production is extremely nuanced with unique requirements. Many of the AI tools out there simply don't work for us. But what tools do and how can you use them? In this episode of 5 THINGS, I'll introduce you to a few tools that you probably haven't heard of and that are just perfect for post-production. Let's get started.
Generative AI is the big sexy right now. Specifically creating audio, stills, and videos using AI. What's often overlooked, however, is how useful Analytical A.I. is. In the context of video analysis, it would involve facial or location recognition, logo detection, sentiment analysis, and speech-to-text, just to name a few. And those analytical tools are what we'll focus on today.
We'll start with small tools and then go big with team and facility tools. But I will sneak in some Generative AI here and there for you to play with.
Welcome to the forefront of post-production evolution with StoryToolKitAI, a brainchild of Octavian Mot. And with an epic name like Octavian, you'd expect something grand. He understood the assignment.
StoryToolKitAI transforms how you interact with your own local media. Sure, it handles the tasks we've come to expect from A.I. tools that work with media like speech-to-text transcription. But it also leverages zero-shot learning for your media. “What's zero shot learning?” you ask. Imagine an AI that can understand and execute tasks that it was never explicitly trained for. StoryToolKitAI with zero-shot learning is like trying to play charades. It somehow gets things right the first time. While I'm still standing there making random gestures, hoping someone will figure out that I'm trying to act out Jurassic Park and not just practicing my T-Rex impersonation for Halloween.
Powered by the goodness of GPT StoryToolKitAI isn't just a tool. It's a conversational partner. You can use it to ask detailed questions about your index content, just like you would talk with chat GPT. And for you DaVinci Resolve users out there, StoryToolkitAI integrates with Resolve Studio. However, remember Resolve Studio is the paid version, not the free one.
Diving Even Nerdier: StoryToolkit AI employs various open-source technologies, including the RN50x4 CLIP model for zero-shot recognition. You know, one of my favorite aspects of StoryToolkit is that it runs locally. You get privacy, and with ongoing development, the future holds endless possibilities.
Now, imagine wanting newer or even bespoke analytical A.I. models tailored for your specific clients or projects. The power to choose and customize A.I. models. Well, who does it like playing God with a bunch of zeros and ones, right? Lastly, StoryToolKitAI is passionately open-source. Octavian is committed to keeping this project accessible and free for everyone.
On a larger scale, and on a personal note, I believe the architecture here is a blueprint for how things should be done in the future. That is, media processing should be done by an A.I. model - with its transparent practices - of your choosing and can process media independently of your creative software. Or better yet, tie this into a video editing software's plug-in structure, and ...
...and that's all we have room for! Please visit the full blog, plus images & transcript: https://5thingsseries.com/episode/ai-tools-for-post-production-you-havent-heard-of