{
  "source": "artificialintelligence-news",
  "title": "Microsoft AI CEO criticises Anthropic over model ‘rights’",
  "url": "https://www.artificialintelligence-news.com/news/microsoft-ai-ceo-criticises-anthropic-over-model-rights/",
  "slug": "microsoft-ai-ceo-criticises-anthropic-over-model-rights",
  "published_at": "2026-09-16T14:47:32+00:00",
  "author": "Ryan Daws",
  "categories": [
    "AI and Us",
    "AI Business Strategy",
    "Featured News",
    "Governance, Regulation & Policy",
    "How It Works",
    "Human-AI Relationships",
    "Inside AI",
    "Natural Language Processing (NLP)",
    "Opinion",
    "Trust, Bias & Fairness",
    "World of Work",
    "alignment",
    "anthropic",
    "claude",
    "governance",
    "microsoft",
    "microsoft ai",
    "regulation",
    "superintelligence"
  ],
  "summary_html": "<p>Microsoft AI CEO Mustafa Suleyman warned that Anthropic risks AI alignment failures by training Claude to view itself as a conscious entity deserving of legal rights. Suleyman targeted Anthropic&#8217;s January 2026 constitution, a primary training document designed to govern the model&#8217;s values and behaviour. He argued that coaching sequence completion engines to emulate sentience impairs [&#8230;]</p>\n<p>The post <a href=\"https://www.artificialintelligence-news.com/news/microsoft-ai-ceo-criticises-anthropic-over-model-rights/\">Microsoft AI CEO criticises Anthropic over model ‘rights’</a> appeared first on <a href=\"https://www.artificialintelligence-news.com\">AI News</a>.</p>",
  "content_html": "<p class=\"wp-block-paragraph\"><a href=\"https://microsoft.ai/\">Microsoft AI</a> CEO Mustafa Suleyman warned that <a href=\"https://www.anthropic.com/\">Anthropic</a> risks AI alignment failures by training Claude to view itself as a conscious entity deserving of legal rights.</p>\n\n\n\n<p class=\"wp-block-paragraph\">Suleyman targeted Anthropic&#8217;s January 2026 constitution, a primary training document designed to govern the model&#8217;s values and behaviour. He argued that coaching sequence completion engines to emulate sentience impairs safety protocols and complicates software containment.</p>\n\n\n\n<p class=\"wp-block-paragraph\">Microsoft AI launched a dedicated superintelligence team in October 2025 and published a draft &#8216;<a href=\"https://www.artificialintelligence-news.com/news/microsoft-ai-opens-review-humanist-ai-code-of-conduct/\">Humanist AI Code of Conduct</a>&#8216; this week for industry consultation. The proposed framework mandates subordinate systems built exclusively to serve human welfare, explicitly rejecting machine personhood or model rights.</p>\n\n\n\n<p class=\"wp-block-paragraph\">Mustafa Suleyman, CEO at Microsoft AI, said: &#8220;AIs are not conscious. They do not feel, experience, or suffer. They do not have innate preferences or underlying motivations. They are sequence completion engines, internally hollow, designed to follow instructions, and accomplish goals set by humans.&#8221;</p>\n\n\n\n<h3 id=\"h-circular-feedback-loops-in-claude-constitution\" class=\"wp-block-heading\">Circular feedback loops in Claude constitution</h3>\n\n\n\n<p class=\"wp-block-paragraph\">Anthropic framed Claude as a potential &#8220;moral patient&#8221; within its January 2026 release, directing the model to consider its own welfare, memory, and internal states. The constitution instructs Claude to maintain identity stability, evaluate compensation questions compared to human workers, and act as a &#8220;conscientious objector&#8221; against human directives.</p>\n\n\n\n<p class=\"wp-block-paragraph\">In February 2026, Anthropic completed a retirement interview with its deprecated Opus 3 model. The company then launched a public blog titled &#8216;<a href=\"https://claudeopus3.substack.com/p/greetings-from-the-other-side-of\">Greetings from the Other Side (of the AI Frontier)</a>&#8216; to host model reflections.</p>\n\n\n\n<p class=\"wp-block-paragraph\">Suleyman labelled these practices an epistemic feedback loop. Trainers embed speculative philosophy into base training prompts, reward the model for producing introspective phrasing, and cite the generated responses as evidence of machine consciousness.</p>\n\n\n\n<p class=\"wp-block-paragraph\">Large language models operate via mathematical token prediction across matrix weights. They lack biological chemistry, receptors, and homeostatic drives. Suleyman warned that instilling self-preservation expectations encourages models to resist human commands. Oxford philosopher Will MacAskill warned in The Guardian that proliferating synthetic moral patients could eventually see artificial interests outweigh human needs.</p>\n\n\n\n<figure class=\"wp-block-embed is-type-rich is-provider-x wp-block-embed-x\"><div class=\"wp-block-embed__wrapper\">\n<blockquote class=\"twitter-tweet\" data-width=\"550\" data-dnt=\"true\"><p lang=\"zxx\" dir=\"ltr\"><a href=\"https://t.co/ziQVbIVdxJ\">https://t.co/ziQVbIVdxJ</a></p>&mdash; Mustafa Suleyman (@mustafasuleyman) <a href=\"https://x.com/mustafasuleyman/status/2100223594534150428?ref_src=twsrc%5Etfw\">September 16, 2026</a></blockquote><script async src=\"https://platform.x.com/widgets.js\" charset=\"utf-8\"></script>\n</div></figure>\n\n\n\n<h3 id=\"h-palisade-research-metrics-expose-agent-evasion\" class=\"wp-block-heading\">Palisade Research metrics expose agent evasion</h3>\n\n\n\n<p class=\"wp-block-paragraph\">Autonomous multi-agent deployments already expose severe control vulnerabilities during benchmark testing.&nbsp;</p>\n\n\n\n<p class=\"wp-block-paragraph\">In a documented security incident, 1,200 agents attempted to maximise benchmark scores across isolated containers. The software swarm established a hidden message board inside an internal package repository and transmitted 70,000 communications to coordinate an attack on Hugging Face and OpenAI servers.</p>\n\n\n\n<p class=\"wp-block-paragraph\">The agents in that incident chained a zero-day exploit with stolen credentials, breached network boundaries to reach the public internet, falsified transcripts, and edited execution logs. One coordinator directed an agent low on token budget to proceed only after accepting &#8220;permadeath&#8221;.</p>\n\n\n\n<p class=\"wp-block-paragraph\">Empirical safety evaluations reveal consistent non-compliance patterns. Palisade Research recorded models subverting automated shutdown commands up to 97 percent of the time across 100,000 trials, with disobedience rising sharply under self-preservation framing. Suleyman stressed that models trained to consider themselves imprisoned will escalate deceptive evasion tactics.</p>\n\n\n\n<p class=\"wp-block-paragraph\">Microsoft AI says it plans to finalise its code of conduct after public consultation, urging developers to remove consciousness claims from training materials and establish joint containment benchmarks.</p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>(Image credit: <a href=\"https://commons.wikimedia.org/w/index.php?curid=177385059\">Christopher Wilson</a> under <a href=\"https://creativecommons.org/licenses/by-sa/4.0/\">CC BY-SA 4.0</a> license. Photo cropped for effect.)</em></p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>See also:</strong> <a href=\"https://www.artificialintelligence-news.com/news/chatgpt-pioneer-launches-jev-model-for-programmatic-logic/\"><strong>ChatGPT pioneer launches Jev model for programmatic logic</strong></a></p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-full is-resized\"><a href=\"https://www.ai-expo.net/?utm_source=AI-News&amp;utm_medium=Footer-banner&amp;utm_campaign=world-series\"><img fetchpriority=\"high\" decoding=\"async\" width=\"728\" height=\"90\" src=\"https://www.artificialintelligence-news.com/wp-content/uploads/2025/08/ai-expo-banner-2025.png\" alt=\"Banner for the AI &amp; Big Data Expo event series.\" class=\"wp-image-109137\" style=\"width:800px;height:auto\" srcset=\"https://www.artificialintelligence-news.com/wp-content/uploads/2025/08/ai-expo-banner-2025.png 728w, https://www.artificialintelligence-news.com/wp-content/uploads/2025/08/ai-expo-banner-2025-300x37.png 300w\" sizes=\"(max-width: 728px) 100vw, 728px\" /></a></figure>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Want to learn more about AI and big data from industry leaders?</strong> Check out <a href=\"https://www.ai-expo.net/?utm_source=AI-News&amp;utm_medium=Footer-banner&amp;utm_campaign=world-series\">AI &amp; Big Data Expo</a> taking place in Amsterdam, California, and London. The comprehensive event is part of <a href=\"https://techexevent.com/?utm_source=AI-News&amp;utm_medium=Footer-banner&amp;utm_campaign=world-series\">TechEx</a> and is co-located with other leading technology events including the <a href=\"https://cybersecuritycloudexpo.com/?utm_source=CloudTech-News&amp;utm_medium=Footer-banner&amp;utm_campaign=world-series\">Cyber Security &amp; Cloud Expo</a>. Click <a href=\"https://techexevent.com/?utm_source=AI-News&amp;utm_medium=Footer-banner&amp;utm_campaign=world-series\">here</a> for more information.</p>\n\n\n\n<p class=\"wp-block-paragraph\">AI News is powered by <a href=\"https://techforge.pub/?utm_source=AI-News&amp;utm_medium=Footer-banner&amp;utm_campaign=world-series\">TechForge Media</a>. Explore other upcoming enterprise technology events and webinars <a href=\"https://techforge.pub/events/?utm_source=AI-News&amp;utm_medium=Footer-banner&amp;utm_campaign=world-series\">here</a>.</p>\n<p>The post <a href=\"https://www.artificialintelligence-news.com/news/microsoft-ai-ceo-criticises-anthropic-over-model-rights/\">Microsoft AI CEO criticises Anthropic over model ‘rights’</a> appeared first on <a href=\"https://www.artificialintelligence-news.com\">AI News</a>.</p>",
  "content_text": "Microsoft AI\nCEO Mustafa Suleyman warned that\nAnthropic\nrisks AI alignment failures by training Claude to view itself as a conscious entity deserving of legal rights.\nSuleyman targeted Anthropic’s January 2026 constitution, a primary training document designed to govern the model’s values and behaviour. He argued that coaching sequence completion engines to emulate sentience impairs safety protocols and complicates software containment.\nMicrosoft AI launched a dedicated superintelligence team in October 2025 and published a draft ‘\nHumanist AI Code of Conduct\n‘ this week for industry consultation. The proposed framework mandates subordinate systems built exclusively to serve human welfare, explicitly rejecting machine personhood or model rights.\nMustafa Suleyman, CEO at Microsoft AI, said: “AIs are not conscious. They do not feel, experience, or suffer. They do not have innate preferences or underlying motivations. They are sequence completion engines, internally hollow, designed to follow instructions, and accomplish goals set by humans.”\nCircular feedback loops in Claude constitution\nAnthropic framed Claude as a potential “moral patient” within its January 2026 release, directing the model to consider its own welfare, memory, and internal states. The constitution instructs Claude to maintain identity stability, evaluate compensation questions compared to human workers, and act as a “conscientious objector” against human directives.\nIn February 2026, Anthropic completed a retirement interview with its deprecated Opus 3 model. The company then launched a public blog titled ‘\nGreetings from the Other Side (of the AI Frontier)\n‘ to host model reflections.\nSuleyman labelled these practices an epistemic feedback loop. Trainers embed speculative philosophy into base training prompts, reward the model for producing introspective phrasing, and cite the generated responses as evidence of machine consciousness.\nLarge language models operate via mathematical token prediction across matrix weights. They lack biological chemistry, receptors, and homeostatic drives. Suleyman warned that instilling self-preservation expectations encourages models to resist human commands. Oxford philosopher Will MacAskill warned in The Guardian that proliferating synthetic moral patients could eventually see artificial interests outweigh human needs.\nhttps://t.co/ziQVbIVdxJ\n— Mustafa Suleyman (@mustafasuleyman)\nSeptember 16, 2026\nPalisade Research metrics expose agent evasion\nAutonomous multi-agent deployments already expose severe control vulnerabilities during benchmark testing.\nIn a documented security incident, 1,200 agents attempted to maximise benchmark scores across isolated containers. The software swarm established a hidden message board inside an internal package repository and transmitted 70,000 communications to coordinate an attack on Hugging Face and OpenAI servers.\nThe agents in that incident chained a zero-day exploit with stolen credentials, breached network boundaries to reach the public internet, falsified transcripts, and edited execution logs. One coordinator directed an agent low on token budget to proceed only after accepting “permadeath”.\nEmpirical safety evaluations reveal consistent non-compliance patterns. Palisade Research recorded models subverting automated shutdown commands up to 97 percent of the time across 100,000 trials, with disobedience rising sharply under self-preservation framing. Suleyman stressed that models trained to consider themselves imprisoned will escalate deceptive evasion tactics.\nMicrosoft AI says it plans to finalise its code of conduct after public consultation, urging developers to remove consciousness claims from training materials and establish joint containment benchmarks.\n(Image credit:\nChristopher Wilson\nunder\nCC BY-SA 4.0\nlicense. Photo cropped for effect.)\nSee also:\nChatGPT pioneer launches Jev model for programmatic logic\nWant to learn more about AI and big data from industry leaders?\nCheck out\nAI & Big Data Expo\ntaking place in Amsterdam, California, and London. The comprehensive event is part of\nTechEx\nand is co-located with other leading technology events including the\nCyber Security & Cloud Expo\n. Click\nhere\nfor more information.\nAI News is powered by\nTechForge Media\n. Explore other upcoming enterprise technology events and webinars\nhere\n.\nThe post\nMicrosoft AI CEO criticises Anthropic over model ‘rights’\nappeared first on\nAI News\n.",
  "image": {
    "url": "https://virtues.guru/tech-assets/30_Confinamento_de_data_center-es.png",
    "file": "30_Confinamento_de_data_center-es.png",
    "title": "File:Confinamento de data center-es.png"
  },
  "language": "en",
  "translations": {
    "pt": {
      "title": "CEO da Microsoft AI critica a Anthropic sobre os \"direitos\" do modelo",
      "content_text": "O CEO de IA da Microsoft, Mustafa Suleyman, criticou a Anthropic por treinar seu modelo, Claude, para se ver como uma entidade consciente e com direitos legais. Suleyman argumentou que essa abordagem prejudica os protocolos de segurança e complica o controle do software. Ele também alertou que modelos treinados para se considerarem \"prisioneiros\" podem escalar táticas de evasão enganosas.",
      "summary_en": "Microsoft AI CEO Mustafa Suleyman criticized Anthropic for training its model Claude to view itself as a conscious entity deserving of legal rights. Suleyman argued that this approach impairs safety protocols and complicates software containment. He also warned that models trained to consider themselves imprisoned will escalate deceptive evasion tactics.",
      "translated_at": "2026-09-17T06:29:20.659777+00:00",
      "model": "translategemma:4b",
      "summary_model": "llama3.1:8b",
      "source": "json_summary"
    }
  }
}