Main menu


Deepfake technology could help change inappropriate dialogue in posts

featured image

Move, dub. “Bab” is all the rage right now.

What if you need to reshoot a scene but don’t have the budget? The filmmakers behind the indie action thriller autumn Lionsgate ran into this problem when it picked up the film for theatrical release in the US and asked the filmmakers to reduce the number of F-bombs dropped during action scenes.

In an intense action sequence, two friends climb an abandoned radio tower to scatter the ashes of Becky’s (Grace Caroline Curry) late husband. The two friends are stranded when part of the rickety ladder from the dilapidated tower breaks.

In this scene, multiple curse words naturally slip out, perfectly capturing the critical situation. Unfortunately the response is American Film Institute.

With a production budget of $3 million, the producers couldn’t afford to reshoot every scene where the petrified tower climber yelled “shit!” Variety reports that the crew’s solution was to turn to deepfake technology.

Directed and co-written by Scott Mann autumn, Turning to his artificial intelligence dubbing technology system, perfectTo get the PG-13 rating the studio and crew wanted for the film, the Flawless team had to change over 30 F-bombs throughout the film to family-friendly words such as “freaking” during post-production. is ready.

Founded in 2021, Flawless initially designed a TrueSync AI-based system to provide better dubbing solutions for movies translated into other languages. TrueSync dubbing is done by adapting the same principles used to create “deepfakes” by altering an actor’s mouth movements to match different lines being spoken.

This process is called “bubbing”.

Mann realized that the Flawless engine could also be used to clean up dialogue from movies that were just under a PG-13 rating without breaking the production budget.

“You can’t reshoot a movie like this,” Mann said of testing the AI. autumn behind the scenes video feature. “We’re not a big big event…we don’t have the resources and most of all, we don’t have the time. It was the technology that really saved this film and got it to a wider audience.”

autumn Shot in IMAX format in the Shadow Mountains of California’s Mojave Desert. It cost millions of dollars and took weeks to reshoot the scene with the F-Bomb, and Mann and his Flawless team were in the final stages of post-production within his two weeks. “Neural reshoot” was performed.

“When we were shooting the movie, I didn’t know if we were R or PG-13, so I said the F word a lot. It’s a PG-13 rating,” said actor Virginia Gardener. says.

it was important to autumncrew and Lionsgate confirmed that the film was rated PG-13. This rating opens the doors of theater to anyone wanting a family-friendly action scene.

Autumn and deepfake technology
‘autumn’credit: lions gate

Upon rewatching the film, the actors had no idea when the dubbing was happening. Actor Grace Caroline Curry said, “As far as I know, every move my mouth makes in that movie is made by my mouth.

While this new technology is huge for movies being dubbed into foreign languages, it can also lead to interesting ethical concerns. We’ve seen Disney return to its vaults and re-edit movies for years to meet the content expectations of Disney’s friends of the family. But imagine what would change if Vubbing became a major post-production tool.

For now, Mann’s invention is a great tool for filmmakers with limited post-production budgets.

Let us know your thoughts in the comments below!