South korea: South Korea's media watchdog has formally requested that the U.S.-based social media platform X establish protective measures to shield minor users from sexually explicit content generated by its AI model, Grok. The Korea Media and Communications Commission (KMCC) expressed its concerns regarding the potential for AI platforms to produce deepfake sexual content.
According to Yonhap News Agency, the KMCC has communicated this request to the operator of X, emphasizing the need to prevent illegal activities associated with Grok. The Commission has urged the implementation of strategies to safeguard teenagers from harmful content, which includes controlling or restricting their access to such material.
The KMCC highlighted that, under South Korean law, social network platform operators, including X, are obliged to appoint an official responsible for the protection of minors and to submit an annual report on their efforts. The request aligns with these regulatory requirements, with the commission noting the legal ramifications of creating, distributing, or possessing non-consensual sexual deepfake content.
KMCC Chairperson Kim Jong-cheol stated in a release that the commission aims to support the healthy advancement of new technologies. Kim added that the KMCC plans to introduce appropriate regulations to mitigate negative impacts, prevent the dissemination of illegal information, including sexual abuse content, and ensure that AI service providers take measures to protect minors.