Don't believe for a second that Sora will allow you to make racist content with Disney characters.
That said, there are a lot of other models out there that care about neither licensing nor alignment. So those will allow you to make racist content. Then you can do whatever you like with that generated content.
A lot of IP owners will learn that there is more than one way to skin a cat. It's easier than people think to turn children's characters, like say, Hermoine, into a raging racist. And there's very little technically speaking that they can do to stop it.
But yes, on OpenAI specific properties, they can definitely stop it dead in its tracks. They can even get better at stopping it over time. In fact, the more users try to generate it, the better the system will get at stopping it.
I'm sure that's what Disney's lawyers specified in the contracts and what their execs expect. However, judging by how LLM controls have gone in the past, I'm fully expecting to see a slew of awful content featuring Disney's characters in the days after this launches. OpenAI also probably won't ever be able to actually stop people from generating harmful content with the characters, but the volume of awful stuff will probably eventually slow down as people get bored and move onto the next controversial thing.
> Don't believe for a second that Sora will allow you to make racist content with Disney characters.
Yes, because AI's so far have been oh so resilient to jailbreaks and oh so great at picking out the potentially "not aligned with corporate values" content...
> Don't believe for a second that Sora will allow you to make racist content with Disney characters.
Don’t believe for a minute that whatever filters it uses will be sensitive enough to the way racist content is constructed to stop people from doing just that.
Given the creativity of the jailbreaking community I will be very impressed if OpenAI manage to reliably prevent Sora from creating disagreeable content with Disney characters.
I don't think that you will ever be able to generate Disney characters with the Sora app. Sora is both a model and an app. Instead I think that there will be a heavily guardrailed specialized app where you can do some highly restricted things for the opportunity for the content to show up on Disney+. Think of it as "Disney art! Powered by Sora".
> Don't believe for a second that Sora will allow you to make racist content with Disney characters.
It's not racist, it's an historically accurate depiction of 1930s Germany under the authority of a significant leader who may or may not be controversial today
Once you make the content it's just content, no? How the hell are you going to ban racism? A lot of racism is "dog whistle" stuff anyway -- it's designed to convey a message to people who already know what is being suggested while seeming innocuous to any enforceable standards of decency... The racists will surely have no trouble bending the models to produce Disney content that is in practice used to promote and celebrate racism.
Don't believe for a second that Sora will allow you to make racist content with Disney characters.
That said, there are a lot of other models out there that care about neither licensing nor alignment. So those will allow you to make racist content. Then you can do whatever you like with that generated content.
A lot of IP owners will learn that there is more than one way to skin a cat. It's easier than people think to turn children's characters, like say, Hermoine, into a raging racist. And there's very little technically speaking that they can do to stop it.
But yes, on OpenAI specific properties, they can definitely stop it dead in its tracks. They can even get better at stopping it over time. In fact, the more users try to generate it, the better the system will get at stopping it.