The firm introduced new generative AI capabilities for Shorts makers on Tuesday during its Made on YouTube live event. Along with a new remixing tool, a “Edit with AI” function, and other features, YouTube is introducing a customized version of Google’s Veo 3 text-to-video generative AI model to Shorts.
YouTube claims that Veo 3 Fast, a customized version of Veo 3, makes it simple to create video clips by producing outputs with reduced latency at 480p. For the first time, users can now do so with sound.
The United States, the United Kingdom, Canada, Australia, and New Zealand are all implementing this upgrade. In the future, YouTube intends to extend its operation to additional locations.
Additionally, YouTube is adding new Veo features to Shorts, such as the ability to add motion from a video to an image. A static image could be animated, for instance, by having the subject do a dance from a video. According to the corporation, this is made feasible by technology that records and transmits movement between subjects.
Now, creators may incorporate other styles, like origami or pop art, into their videos using Veo. Moreover, creators of content can now include textual descriptions for items like characters or props.
In the upcoming months, these new features will be made available.
The new remixing tool allows authors to create memorable soundtracks for other shorts by transforming the language from eligible videos.
“As the world’s largest creative playground, YouTube is where trends are born and where you can draw inspiration from. Imagine hearing a line of dialogue that sparks an idea — a funny phrase, a memorable quote, or a one-of-a-kind sound — and you want to remix it into a new sound,” YouTube’s Director of Product, Shorts and Generative AI Creation, Dina Berrada, wrote in a blog post. “With our new Speech to Song remixing tool, you’ll be able to do just that.”
According to YouTube, Google’s AI music model Lyria 2 is used to compose the feature’s soundtrack. The song’s vibe can be customized by the creators, such as “fun,” “danceable,” or “chill.”
According to the company, it will shortly test this tool and in the upcoming weeks, expand its availability to additional American authors.
Creators can create initial drafts from their raw video with the new Edit with AI capability. By selecting and organizing the greatest moments, adding music, and implementing transitions, it turns unprocessed camera roll footage into a first draft. In Hindi or English, it can even add a voice-over that responds to the action in the video. According to YouTube, the feature’s goal is to provide filmmakers with a beginning point for their shorts.
In the upcoming weeks, YouTube will roll out the Edit with AI tool in a few areas. The feature is already being tested on Shorts and in the YouTube Create app.