Dave Willner, co-founder of Zentropi, and Vaishnavi J., founder and principal of Vys, join Kevin Frazier, director of the AI Innovation and Law Program at the University of Texas School of Law and a senior fellow at the Abundance Institute, to examine how AI is affecting younger users and why existing child-safety responses often default to age gates, parental consent, and outright bans.
The conversation then turns to their open-source teen self-harm and suicidal ideation policies, which use age-banded rules and a four-zone framework: remove, suppress with a warning, suppress from recommendations, and allow. Dave and Vaishnavi explain how the policies were developed using more than 1,200 hand-labeled examples, how Zentropi’s CoPE classifier translates written policy into enforcement, and how platforms should evaluate false positives, false negatives, over-refusal, under-refusal, human review, and appeals.
Dave's Tech Policy Press piece.
More on their classifer and research.
Explainer blog - Overall: https://quire.substack.com/p/what-it-takes-for-llms-to-make-age
Explainer blog - Part 1: https://quire.substack.com/p/f4b99ab0-0127-4992-a31d-67b989f2cf58
Explainer blog - Part 2: https://quire.substack.com/p/ae6a5436-21e5-4fec-81fe-8025004f3b16
Full set of policies: https://zentropi.ai/u/vys
Hosted on Acast. See acast.com/privacy for more information.