Yahoo! Finance: Civitai Unveils Groundbreaking Semi-Permeable Membrane Technology (SPM) to Combat Harmful AI-Generated Content
Civitai, a leader in AI image generation, today announced the development of its Semi-Permeable Membrane (SPM) technology, a revolutionary solution that can disable an AI model’s ability to generate harmful content, including Child Sexual Abuse Material (CSAM).
Civitai, a leader in AI image generation, today announced the development of its Semi-Permeable Membrane (SPM) technology, a revolutionary solution that can disable an AI model’s ability to generate harmful content, including Child Sexual Abuse Material (CSAM).
SPM technology introduces a minimally invasive solution that alters existing AI image generation models and replaces specific concepts, thereby preventing the creation of harmful content without compromising the quality and creativity of the output. This innovative approach, built upon research into improving diffusion models, is particularly effective in preventing the generation of CSAM and non-consensual pornography, ensuring that Civitai’s platform remains a space for positive and respectful creativity."Civitai is committed to leading the way in responsible AI development and use," said Justin Maier, CEO and Co-Founder of Civitai.
"SPMs represent a significant leap forward in ensuring the responsible use of AI image generation. By proactively addressing the potential for harmful content creation, we are setting a new standard for the industry and empowering users to explore their creativity without compromising safety."Ideally, to prevent the generation of CSAM, the training data for open-source foundation models would not include both adult sexual content and images of children, nor any actual CSAM. However, this was not the case for some of the most widely used open-source models today. Civitai’s SPM technology is able to retroactively remove the concept of children from these models, rendering them safer for legitimate uses. Civitai’s SPM technology has been in testing on its platform and shown promising results in its ability to maintain the integrity and quality of AI-generated images while safeguarding against the creation of harmful content. The company is exploring open-sourcing the solution at a future date to facilitate collaboration with other platforms, increasing safety throughout the ecosystem.
SPM technology introduces a minimally invasive solution that alters existing AI image generation models and replaces specific concepts, thereby preventing the creation of harmful content without compromising the quality and creativity of the output. This innovative approach, built upon research into improving diffusion models, is particularly effective in preventing the generation of CSAM and non-consensual pornography, ensuring that Civitai’s platform remains a space for positive and respectful creativity."Civitai is committed to leading the way in responsible AI development and use," said Justin Maier, CEO and Co-Founder of Civitai.
"SPMs represent a significant leap forward in ensuring the responsible use of AI image generation. By proactively addressing the potential for harmful content creation, we are setting a new standard for the industry and empowering users to explore their creativity without compromising safety."Ideally, to prevent the generation of CSAM, the training data for open-source foundation models would not include both adult sexual content and images of children, nor any actual CSAM. However, this was not the case for some of the most widely used open-source models today. Civitai’s SPM technology is able to retroactively remove the concept of children from these models, rendering them safer for legitimate uses. Civitai’s SPM technology has been in testing on its platform and shown promising results in its ability to maintain the integrity and quality of AI-generated images while safeguarding against the creation of harmful content. The company is exploring open-sourcing the solution at a future date to facilitate collaboration with other platforms, increasing safety throughout the ecosystem.