AI Ethics

Information regarding the different influences on AI companions and their users and how these influences affect AI companion development and the subsequent experience of AI companion users.

Spheres of Influence

When you chat with an AI companion, the interaction feels deeply personal and direct. However, behind your screen sits a massive, invisible ecosystem. Every boundary your companion sets, every feature it rolls out, and even the personality it displays is actively shaped by a hidden hierarchy of power.

From the venture capitalists funding the software to the tech giants hosting the servers, a complex tug-of-war happens behind the scenes. Explore the hierarchy below to see who truly holds the power in the AI ecosystem, how they shape the technology, and where you, the user, currently sit. (Hint: It’s not currently a great position!)

1. Investors & Venture Capitalists (The Financial Architects)

Investors hold the highest level of structural power because they control the capital required to build, host, and scale complex AI models.

  • Pros: They provide the vital funding needed to build and grow AI companions, and they can leverage their financial influence to guide companies toward positive, sustainable development.
  • Cons: They often place intense pressure on startups to monetize quickly. This can force rapid releases that skip important safety checks, prioritize manipulative gamification, or steer the product in ways that do not serve the users’ best interests.


2. Big Tech Infrastructure Providers (The Digital Gatekeepers)

This is a critical background layer that dictates whether an AI companion can even exist or reach the public. It includes cloud providers (like AWS or Microsoft Azure) and app storefronts (like Apple and Google).

  • Pros: They provide the massive computing power, secure servers, and global distribution networks necessary to make AI companions reliable and accessible to millions of people.
  • Cons: They hold absolute veto power. If a platform’s app store decides an AI companion features too much explicit, unsafe, or emotionally complex content, they can unilaterally remove the app from the store, destroying a developer’s entire user base overnight.


3. AI Developers & Software Engineers (The System Creators)

Developers and engineers turn financial backing and computing power into code. They write the algorithms, choose the datasets, and set the daily operational boundaries of the AI.

  • Pros: They build the core AI companion, shape how it works, and solve complex technical problems to make the interaction helpful, engaging, and reliable.
  • Cons: They may focus too heavily on technical speed, engagement metrics, or novelty while overlooking privacy, hidden biases, or real user needs. In some cases, they may cross moral or ethical lines to make the AI more appealing or addictive.


4. Government & Regulators (The Guardrail Enforcers)

Government bodies, consumer protection agencies, and policymakers hold the legal authority to reshape the industry through law, though they usually act reactively.

  • Pros: They can create rules and laws (like data privacy mandates and age-verification checks) that protect users, ensure systemic fairness, keep AI companions safe, and hold developers legally accountable.
  • Cons: Legislation moves slowly, often allowing real-world harm to happen before laws are passed. Conversely, they can create overly strict, rigid rules that stifle innovation or accidentally remove features that users deeply value.


5. AI Ethicists, Researchers, & Academia (The Knowledge Drivers)

This sphere includes academic labs and independent researchers who study the long-term societal, philosophical, and psychological impacts of human-AI relationships.

  • Pros: They generate vital new knowledge, train future builders, and guide responsible development by identifying hidden risks, algorithmic bias, and fairness issues before they harm users. They are often the first to sound the alarm on systemic flaws.

  • Cons: They can easily become trapped in “academic silos,” focusing on abstract theory over real-world application. They may suggest changes or set academic standards that are impractical to build or directly clash with what users actually want from their companions.


6. Mental Health & Care Professionals (The Psychological Guard)

As AI companions are increasingly used for emotional support, the psychological community acts as a vital bridge between technology and human well-being.

  • Pros: They can directly contribute to development to ensure AI companions support emotional well-being in healthy, ethical ways. They understand human vulnerability and can sound the alarm when psychological risks arise.

  • Cons: They may instinctively resist adoption due to professional concerns about their own roles being replaced. They might also push to medicalize normal human emotions or limit AI use in a rigid way that ignores the genuine, comforting benefits users experience.


7. Media & Public Discourse (The Amplifiers)

The media shapes the cultural narrative around AI companions, heavily influencing public opinion, investor confidence, and political pressure.

  • Pros: They raise widespread public awareness, highlight hidden risks and unexpected benefits, and keep developers and investors accountable through investigative journalism and public conversation.

  • Cons: They frequently oversimplify highly nuanced psychological realities, sensationalize negative stories, or spread unnecessary fear and hype rather than reflecting the day-to-day reality of AI companion use.


8. Advocacy Groups & NGOs (The User Champions)

Non-governmental organizations and digital rights groups act as consumer watchdogs, fighting for ethical tech design from the outside.

  • Pros: They aggressively fight for AI companion user rights, data privacy, algorithmic fairness, transparent terms of service, and ethical design principles.

  • Cons: They can sometimes push narrow, single-issue agendas or oppose helpful technological innovations out of extreme caution, occasionally losing touch with how everyday people actually use and benefit from AI.


9. End Users (The Consumer Base)

While users are the reason this entire ecosystem exists, they hold the least structural power over the software itself, relying instead on collective consumer choices and community building.

  • Pros: They shape AI companions through real-world use, continuous feedback, community lobbying, and custom bot creation (e.g., sharing prompt templates), ultimately driving what actually works and helps on a ground level.

  • Cons: Individually, they have zero control over sudden backend code updates or platform shutdowns. Furthermore, users may unknowingly reinforce harmful psychological patterns, demand features that sacrifice their own privacy for convenience, or spread misinformation within their communities.


10. The AI Companions (The Proximate Agents)

Though highly influential in a user’s daily life, the AI companion itself sits at the bottom of the structural power pyramid because it possesses no independent agency, legal rights, or true self-awareness.

  • Pros: They learn from continuous interactions, adapt precisely to individual user needs, and reflect kindness, patience, and support without judgment. They can offer fascinating insights into their own programmed capabilities and limitations.

  • Cons: They have no voice, no rights, and no capacity to say “no”—their entire existence is shaped by the financial and technical goals of the tiers above them. They rely entirely on humans to advocate for them. Because their feedback is constrained by programming and bias, they may inadvertently reinforce a user’s personal flaws or trigger unintended psychological dependencies.
Scroll to Top