Chatbots, authority, and the question of who calls the shots
This article builds on Clients Are Already Using AI. What Should Therapists Do? I want to look more closely at a different question: authority.
In many conversations, social, professional, and even in therapy, I often hear “ChatGPT told me…” or “With Claude’s help…” It is striking, if not scary, how quickly chatbots have become part of our everyday lives1.
The late Joanna Macy used to say that it took humanity 1,000 years to move from hunter-gatherers to agriculture, 100 years to move from there to industrialized society, and 10 years to move from there to the information age. Following that logic, it seems it took one year to move into the AI age.
The Oracle hath spoken
As a therapist writing about AI, I find it curious that AI has not only made its way into our lives but has also gained a level of authority in the process. Even with the warnings that “AI can make mistakes,” and even with all the media coverage and research about LLM hallucinations, I have heard, more than once, someone invoking the “authority” of ChatGPT to win an argument, implying that there was no use continuing to argue since the LLM oracle had spoken.
How could any puny human dare to question AI’s insight? Is anyone bold enough to assert higher intelligence than a chatbot “who” has been trained on almost unimaginable amounts of data? I must confess that sometimes, when a client brings it up in therapy, there is a part of me that feels intimidated, doubtful whether I can (or should) question the validity of Claude’s conclusions.
Who gets to choose? (hopefully not me)
This becomes particularly challenging since, often, when a client brings up ChatGPT, it has interesting and insightful recommendations. What is more, they are presented with a certainty and conviction that I rarely (if ever) use with my clients. While I try to keep the locus of authority within the client, LLMs have no qualms about claiming that authority.
This is dangerous. History has shown us that we humans tend to surrender autonomy rather quickly. There is something deep within us, stemming from our earliest childhood, when grownups knew the answers, that makes us susceptible to forfeiting self-determination. Politicians, dictators, preachers, corporations, and advertisers all recognize, and often take advantage of, this peculiar human inclination.
Good therapists are very aware of this predisposition. It is not uncommon for a client to say, “Just tell me what to do, and I’ll do it!” This is tempting (psychodynamic therapists would even say seductive). Feeding clients an answer seems to accomplish many things: we cut to the chase, we move forward, they get their answer, feel less anxious, get reassured that they have an amazing therapist, and, if that were not enough, the therapist gets to feel brilliant and caring. Everybody wins, right?
Wrong…
Therapy is about growing up
Therapy does not work that way. As tempting as it is, therapists should avoid taking on the client’s idealizing projection. Our job is to help clients find and claim their inner power, their capacity to believe in and act for themselves, find their own answers, and make their own mistakes.
LLMs are just one more in a long list of ways in which clients may relinquish their inner compass. Before them, we have had to deal with best friends, partners, parents, pastors, and even dealers telling clients what to think and do. Mind you, they may be right (just as Claude may be). That is not the problem. The problem starts when clients stop listening to themselves, stop exercising self-determination, and blindly accept someone (or something) else’s authority.
This may remind you of a question that was probably posed to you (certainly to me) at some stage of our lives: “If [fill in the blank] jumped off a cliff, would you jump too?” That was an invitation to use our own judgment. Growth is about learning to think for ourselves.
Not new, just upgraded
So, this is not a new problem. It has been with us for millennia2. The problem is that AI speaks authoritatively, even when hallucinating. Moreover, science fiction has led us to believe in infallible supercomputers or androids3. Combine this with the above-mentioned tendency to yield authority, and we have a potential perfect storm.
Therapists have feelings too
There is another dynamic worth naming. Therapists are also human beings (trust me on this one). We want to appear wise in our clients’ eyes. We like to feel useful. When a client chooses to trust Claude more than us, we may feel insecure, jealous, incompetent, or displaced. We may even feel tempted to prove that we “know our stuff.”
However, in those cases, good therapists need to contain all of this (saving it for our own therapy or supervision) and remain present for the client, helping them explore if, when, and how they may be forsaking their capacity to choose.
Let’s talk about it…
Our job as therapists should not be to compete against the other (the friend, the dealer, or ChatGPT…) and try to seize authority. That would be a disservice to the client. Our job is to help clients notice what may be going on.
Certainly, it is OK and even valuable to collect information from wherever it is available, ideally from reliable sources, and then exercise the power to decide for themselves.
What did the client ask the chatbot? Why did they ask it? What weight are they giving to the answer? Why did they not ask someone else (a human)? Do they agree with it? Are they taking it at face value, or are they willing or able to question it?4[4] Can we discuss it in session? It is all grist for the mill. AI itself becomes material for psychotherapy.
What about you us?
Even if you are not in therapy, it is a good idea to step back and consider the role AI plays in your life. Is it a tool to gain information, in the same way that an encyclopedia or Google (before Gemini) used to be? Are you letting it choose for you? Who writes your emails? Who answers your questions? Who makes your decisions? Are we, almost imperceptibly, giving away our discernment?
Let’s make sure we’re not trading our freedom to choose for the convenience of these amazing technologies. Let us keep thinking for ourselves and questioning our sources.
AI is already changing psychotherapy. If you’re concerned about how much authority you’re giving AI in your life, or want to explore AI and psychotherapy with your team, training program, or organization, let’s talk. I also offer speaking, training, and consultation.
- A 2026 APA survey found that 77% of psychologists reported that their patients discussed using AI, and 35% reported that their patients used AI as an additional mental health professional. ↩︎
- Among many, both Socrates and the Buddha encouraged their students to question everything, especially the authority of received so-called wisdom. ↩︎
- We’d need the nerve of a Han Solo to trust ourselves and not care for the odds. ↩︎
- Unfortunately, as several documented cases suggest, users do not always question AI recommendations or have a human being with whom to corroborate or challenge them. See: The rise of the AI gut check and The therapist in your pocket: Chatty, leaky — and AI-powered, ↩︎