News

We welcome the step taken by xAI to restrict the creation and spread of sexualised, non-consensual imagery - particularly where children are at risk. xAI has said it has implemented technical measures and geo-blocking to prevent Grok from editing images of real people into ‘revealing clothing’ in jurisdictions where that activity is illegal. 

This is a targeted, jurisdiction-based change. It relates to a specific image-editing use case and applies only where the law clearly prohibits it, so it does not, on its own, confirm that wider risks linked to AI-generated or AI-altered sexual imagery have been eliminated. 

Geo-blocking and access restrictions are not the same as risk being removed. Children’s safety depends on whether safeguards work in practice, whether they can be bypassed, and whether the platform can prevent re-uploads and rapid sharing once harmful content is created. 

Any tool that enables the creation of sexualised imagery involving children represents a serious safeguarding risk. The harm is real - regardless of whether the imagery is AI-altered. At some point, some generative AI tools have been trained on large datasets that can include CSAM, and AI-generated abuse content can still fuel offending and risk. 

We welcome Ofcom’s continued scrutiny. Its investigation needs clear answers on what went wrong, what UK users may have been exposed to, and what technical and governance changes are being made to prevent repeat harm - not just short-term adjustments.  We also welcome the Technology Secretary’s focus on swift, robust action and the Department for Science, Innovation and Technology (DSIT’s) engagement with Ofcom as this progresses. 

This also reinforces the need for safety-by-design in AI-enabled products and effective enforcement - so protective measures don’t depend on geography or on after-the-fact fixes.  

Worried about a child? 
If something online has harmed your child - including AI-generated or AI-altered sexual imagery - your child’s safety and wellbeing come first. For support, guidance and next steps, contact MCF on 01765 688827 or help@mariecollinsfoundation.org.uk.  

For under-18s, Report Remove can help request removal of a nude/sexual image or video: https://www.childline.org.uk/info-advice/bullying-abuse-safety/online-mobile-safety/report-remove/  

If you believe a child is at risk, contact the police (999 in an emergency / 101 otherwise) and consider reporting to CEOP: https://www.ceop.police.uk/safety-centre/