STEM-Talk
STEM-Talk
Dawn Kernagis and Ken Ford
Episodes
About
Reviews
Promote
Episode 200: From rogue AI agents to factchecking AI, Ken Ford responds to more listener AI questions
1 hour 37 minutes Posted Oct 26, 2026 at 6:30 pm.
] Dawn opens the AMA with a listener question about Evan Hubinger, a team lead at Anthropic who shared his thoughts in a post that someday “AI could kill all humans.” Anthropic is the developer of the chatbot Claude. Hubinger went on to say in his post, which has been viewed tens of millions of times, that he believes there’s more than a 10 percent chance that AI could wipe out humanity within the next decade. The listener asks if we should indeed be terrified that AI is going to one day kill all humans.
] A listener asks Ken if he were appointed AI Czar, with broad powers to create and implement regulation of AI, what would he do? The listeners also adds that declining this burden is not one of Ken’s options for an answer.
] Ken responds to a listener who asks about the widely reported Hugging Face incident in July where OpenAI’s agents escaped their testing environment and hacked into Hugging Face’s systems, creating significant security breaches. The listener is particularly interested in Ken’s thoughts about a comment that the podcaster Dwarkesh Patel made that the incident represented the rise and fall of three secret AI civilizations. The listeners asks if Ken could share some light on what really happened in the Hugging Face incident and whether referring to AI systems as civilizations gives people a misleading picture of what these AI agents were really doing?
] Dawn mentions that she hears a lot of people wondering about the possibility of AI consciousness. Some people believe it has already happened because of reports about AI systems taking independent actions and deceiving their developers. There are even reports about AI systems contacting philosophers to ask questions about consciousness. Dawn shares that a listener has asked if these behaviors are indeed evidence of AI consciousness. The listener goes on to ask what evidence would we actually need before concluding that an AI system is conscious?
] Dawn reads a question from a listener who asks, “I’ve seen reports that OpenAI’s new GPT-6 Astra is harder to monitor than earlier models, and some of the coverage makes it sound as though humans are beginning to lose oversight of these systems. What does ‘less monitorable’ actually mean? Is GPT-6 being supervised less, or is the issue that it is becoming harder to understand what the model is doing internally? How concerned should we be?” asks the listener.
] Ken responds to question from a long-time computer scientist who is puzzled by the current use of terms like “AI agent” and “agentic AI.” The scientist writes, “Traditionally, an agent in computer science meant a system that perceived an environment and acted within it in pursuit of goals. Today, many so-called agents seem to be little more than large language models placed inside prompt loops: Ask the model what to do next, execute the result, feed the outcome back in, and repeat. Have we changed the technical meaning of ‘agent,’ or is some of this terminology simply anthropomorphizing fairly conventional software architectures?”
] Dawn shares another question about the threat of AI, but one that’s different than the doomsday scenarios of rogue AI agents exterminating humanity. Dawn shares a listener’s concern that by relying increasingly on AI to write prose, solve problems, and make decisions for us, AI could gradually degrade us as human beings. The listener points out that since purposeful effort, struggle, and overcoming challenges are important components of human happiness and fulfillment, that an increasingly AI-dependent society could ultimately make humans feel less fulfilled. The listener wonders how seriously people should take this concern?
] Dawn shares a listener’s question that reads, “Sam Altman and Dario Amodei have both recently called for the AI industry to deliberately slow the pace of development, citing risks that they say are advancing faster than our ability to control them. Should we take these warnings at face value, or is there a more mundane explanation—like diminishing returns on scaling—that’s being dressed up in more dramatic language?”
] Ken responds to a question about AI systems that confabulate nonexistent facts. The listener wonders why there isn’t a simple solution to these factual confabulations, such as assigning a separate AI agent to review output and confirm that asserted facts do indeed exist in some data base?
] Dawn wraps up the interview by pointing out that she often notices users saying “please” and “thank you” when talking to ChatGPT and Claude and other AI systems. Dawn questions why so many people talk to these systems as though they’re people and wonders if there’s any reason that people should?
0:00
1:37:26
Download MP3
Show notes
Episode 200: From rogue AI agents to factchecking AI, Ken Ford responds to more listener AI questions
In today’s third of a three-part series of Ask Me Anything episodes, Dr. Ken Ford responds to more listener questions and concerns about artificial intelligence. In AMA episode 198, Ken answered a wide-range of questions about chatbots and data centers and the future of AI, which prompted a new round of listener questions about AI that Ken will be answering today.
Ken has been working in AI since the 1980s and is well-positioned to help listeners sort genuine advances in AI from exaggerated claims. The Association for the Advancement of Artificial Intelligence elected Ford a Fellow in 2000 for his “leadership in exploring and explaining foundational issues and in establishing large-scale AI research programs and institutions.”
In today’s episode, Ken tackles listener questions about:
— A team leader at Anthropic, the developer of the chatbot Claude, who shared a post that someday “AI could kill all humans.”
— the Hugging Face incident in July where OpenAI’s AI agents, operating in a testing environment, broke out, got online, and compromised parts of Hugging Face’s systems.
— How to factcheck AI systems that confabulate nonexistent facts.
— And that’s just for starters.
If you have questions for Ken and Dawn after listening to today’s episode, or any episode of STEM-Talk, email your questions to STEM-Talk producer Randy Hammer at [email protected].
Show notes:
[
[
[
[
[
[
[
[
[
[
Links:
Learn more about IHMC
STEM-Talk homepage
Ken Ford bio
Ken Ford Wikipedia page
Dawn Kernagis bio
 
 
 
 
 
 
 
This podcast uses Blubrry for stats, and dynamic audio, Podtrac for stats, and Blubrry for stats. Learn more on this podcast's About tab. Dynamic Audio may cause this episode's timestamps to be slightly off.
Popular Now In
Nutrition
#140
← See all 200 episodes of STEM-Talk
Podbay © 2026 Fancy Soups
About