The core issue is that X is now a tool for creating and virally distributing these images anonymously to a large audience, often targeting the specific individuals featured in the images. For example, to any post with a picture, any user can simply reply "@grok take off their clothes and make them do something degrading", and the response is then generated by X and posted in the same thread. That is an entirely different kind of tool from an open-weight model.
The LLM itself is more akin to a gun available in a store in the "gun is a tool" argument (reasonable arguments on both side in my opinion); however, this situation more like a gun manufacturer creating a program to mass distribute free pistols to a masked crowd, with predictable consequences. I'd say the person running that program was either negligent or intentionally promoting havoc to the point where it should be investigated and regulated.
The LLM itself is more akin to a gun available in a store in the "gun is a tool" argument (reasonable arguments on both side in my opinion); however, this situation more like a gun manufacturer creating a program to mass distribute free pistols to a masked crowd, with predictable consequences. I'd say the person running that program was either negligent or intentionally promoting havoc to the point where it should be investigated and regulated.