Anthropic boss warns AI could ‘outrun our ability’ to control it

cityam

1 hour ago

Amodei also pointed to a July incident involving OpenAI agents and Hugging Face Anthropic boss Dario Amodei has called for the AI industry to slow the development of its most powerful models, warning ...

Source Link

Disclaimer: Investing carries risk. This is not financial advice. The above content should not be regarded as an offer, recommendation, or solicitation on acquiring or disposing of any financial products, any associated discussions, comments, or posts by author or other users should not be considered as such either. It is solely for general information purpose only, which does not consider your own investment objectives, financial situations or needs. TTM assumes no responsibility or warranty for the accuracy and completeness of the information, investors should do their own research and may seek professional advice before investing.

Most Discussed

{"basename":"","ssrTDKData":{"titleTemplate":"%s - Tiger Brokers","title":"Tiger Brokers HK | Online Trading in stocks, bonds & ETFS","description":"Discover Tiger Brokers HK, an online trading platform for stocks&ETFs, options&futures, bonds and crypto. Open an account to enjoy low commission trading today!","keywords":"tiger trading,tiger security,tiger broker hk,tigers co ltd,tiger trade hk,tiger brokers hk,stock broker,securities broker,online brokerage,hong kong broker,hk broker,online stock trading,online trading platform,stock trading platforms,trading application,stock trading,stock trading hong kong,buying stocks in hong kong,tiger brokers","social":{"ogDescription":"Discover Tiger Brokers HK, an online trading platform for stocks&ETFs, options&futures, bonds and crypto. Open an account to enjoy low commission trading today!","ogImage":"https://c1.itigergrowtha.com/portal5/static/media/og-logo.0a0bd8dc.png","ogUrl":"https://www.atigrcrest.com/news/2667848746"},"companyName":"Tiger Brokers"},"pageData":{"isMobile":false,"isTiger":false,"isTTM":true,"region":"HKG","license":"TBHK","edition":"fundamental"},"isCrawlerRequest":true,"__swrFallback__":{"@#url:\"https://stock-news.skytigris.cn/v3/news\",params:#id:\"2667848746\",edition:\"fundamental\",auth_exemption:1,,,undefined,":{"share":"https://ttm.financial/m/news/2667848746?lang=en_US&edition=fundamental","thumbnail":"https://www.cityam.com/wp-content/uploads/2026/06/Dario-Amodei-chief-executive-of-Anthropic.jpg?w=824&h=463&crop=1","is_english":true,"pubTime":"2026-09-13 17:43","share_image_url":"https://static.laohu8.com/e9f99090a1c2ed51c021029395664489","id":"2667848746","market":"nz","top_or_hot":-1,"title":"Anthropic boss warns AI could ‘outrun our ability’ to control it","media":"cityam","content":"<div>\n<p>Amodei also pointed to a July incident involving OpenAI agents and Hugging Face Anthropic boss Dario Amodei has called for the AI industry to slow the development of its most powerful models, warning ...</p>\n\n<a href=\"https://www.cityam.com/anthropic-boss-warns-ai-could-outrun-our-ability-to-control-it/\">Source Link</a>\n\n</div>\n","source":"cityam_highlight","html":"<!DOCTYPE html>\n<html>\n<head>\n<meta http-equiv=\"Content-Type\" content=\"text/html; charset=utf-8\" />\n<meta name=\"viewport\" content=\"width=device-width,initial-scale=1.0,minimum-scale=1.0,maximum-scale=1.0,user-scalable=no\"/>\n<meta name=\"format-detection\" content=\"telephone=no,email=no,address=no\" />\n<title>Anthropic boss warns AI could ‘outrun our ability’ to control it</title>\n<style type=\"text/css\">\na,abbr,acronym,address,applet,article,aside,audio,b,big,blockquote,body,canvas,caption,center,cite,code,dd,del,details,dfn,div,dl,dt,\nem,embed,fieldset,figcaption,figure,footer,form,h1,h2,h3,h4,h5,h6,header,hgroup,html,i,iframe,img,ins,kbd,label,legend,li,mark,menu,nav,\nobject,ol,output,p,pre,q,ruby,s,samp,section,small,span,strike,strong,sub,summary,sup,table,tbody,td,tfoot,th,thead,time,tr,tt,u,ul,var,video{ font:inherit;margin:0;padding:0;vertical-align:baseline;border:0 }\nbody{ font-size:16px; line-height:1.5; color:#999; background:transparent; }\n.wrapper{ overflow:hidden;word-break:break-all;padding:10px; }\nh1,h2{ font-weight:normal; line-height:1.35; margin-bottom:.6em; }\nh3,h4,h5,h6{ line-height:1.35; margin-bottom:1em; }\nh1{ font-size:24px; }\nh2{ font-size:20px; }\nh3{ font-size:18px; }\nh4{ font-size:16px; }\nh5{ font-size:14px; }\nh6{ font-size:12px; }\np,ul,ol,blockquote,dl,table{ margin:1.2em 0; }\nul,ol{ margin-left:2em; }\nul{ list-style:disc; }\nol{ list-style:decimal; }\nli,li p{ margin:10px 0;}\nimg{ max-width:100%;display:block;margin:0 auto 1em; }\nblockquote{ color:#B5B2B1; border-left:3px solid #aaa; padding:1em; }\nstrong,b{font-weight:bold;}\nem,i{font-style:italic;}\ntable{ width:100%;border-collapse:collapse;border-spacing:1px;margin:1em 0;font-size:.9em; }\nth,td{ padding:5px;text-align:left;border:1px solid #aaa; }\nth{ font-weight:bold;background:#5d5d5d; }\n.symbol-link{font-weight:bold;}\n/* header{ border-bottom:1px solid #494756; } */\n.title{ margin:0 0 8px;line-height:1.3;color:#ddd; }\n.meta {color:#5e5c6d;font-size:13px;margin:0 0 .5em; }\na{text-decoration:none; color:#2a4b87;}\n.meta .head { display: inline-block; overflow: hidden}\n.head .h-thumb { width: 30px; height: 30px; margin: 0; padding: 0; border-radius: 50%; float: left;}\n.head .h-content { margin: 0; padding: 0 0 0 9px; float: left;}\n.head .h-name {font-size: 13px; color: #eee; margin: 0;}\n.head .h-time {font-size: 11px; color: #7E829C; margin: 0;line-height: 11px;}\n.small {font-size: 12.5px; display: inline-block; transform: scale(0.9); -webkit-transform: scale(0.9); transform-origin: left; -webkit-transform-origin: left;}\n.smaller {font-size: 12.5px; display: inline-block; transform: scale(0.8); -webkit-transform: scale(0.8); transform-origin: left; -webkit-transform-origin: left;}\n.bt-text {font-size: 12px;margin: 1.5em 0 0 0}\n.bt-text p {margin: 0}\n</style>\n</head>\n<body>\n<div class=\"wrapper\">\n<header>\n<h2 class=\"title\">\nAnthropic boss warns AI could ‘outrun our ability’ to control it\n</h2>\n\n<h4 class=\"meta\">\n\n\n2026-09-13 17:43 GMT+8&nbsp;&nbsp;&nbsp;<a href=https://www.cityam.com/anthropic-boss-warns-ai-could-outrun-our-ability-to-control-it/><strong>cityam</strong></a>\n\n\n</h4>\n\n</header>\n<article>\n<div>\n<p>Amodei also pointed to a July incident involving OpenAI agents and Hugging Face Anthropic boss Dario Amodei has called for the AI industry to slow the development of its most powerful models, warning ...</p>\n\n<a href=\"https://www.cityam.com/anthropic-boss-warns-ai-could-outrun-our-ability-to-control-it/\">Source Link</a>\n\n</div>\n\n\n</article>\n</div>\n</body>\n</html>\n","isBrief":false,"type":0,"news_type":1,"symbol":"AIPO","symbol_name":"Defiance AI and Power Infrastructure ETF","start_time":0,"source_url":"https://www.cityam.com/anthropic-boss-warns-ai-could-outrun-our-ability-to-control-it/","article_id":"2667848746","we_media_id":null,"thumbnails":["https://www.cityam.com/wp-content/uploads/2026/06/Dario-Amodei-chief-executive-of-Anthropic.jpg?w=824&h=463&crop=1"],"rights":{"source":"cityam_highlight","url":"https://www.cityam.com/anthropic-boss-warns-ai-could-outrun-our-ability-to-control-it/","rn_cache_url":null,"directOrigin":true},"url":"https://stock-news.laohu8.com/highlight/detail?id=2667848746","pubTimestamp":1789292581,"columns":[],"sourceInfo":{"source_id":"cityam_highlight","name":"cityam"},"weMediaInfo":null,"summary":"Amodei also pointed to a July incident involving OpenAI agents and Hugging Face Anthropic boss Dario Amodei has called for the AI industry to slow the development of its most powerful models, warning that progress is moving “drastically faster” than safety work can keep up.In an essay published on Saturday, Amodei said frontier AI companies should deliberately pace advances in model capabilities, open their systems to independent safety monitors and ultimately agree common standards with governments around the world.“We must slow the pace at which we improve the capabilities of AI models,” he wrote. “Progress will still seem fast, and we must make wise use of the time we gain.”","collect":0,"end_time":0,"defaultTopTitle":"cityam.com","property":[],"viewcount":null,"language":"en","relate_stocks":{"AIPO":"Defiance AI and Power Infrastructure ETF","CHAT":"ROUNDHILL GENERATIVE AI & TECHNOLOGY ETF","VTHR":"Vanguard Russell 3000 ETF","AGIX":"通用人工智能 ETF-AGIX","QTOC":"Innovator Growth Accelerated Plus ETF - October","ARTY":"ISHARES FUTURE AI & TECH ETF"},"translate_title":"Anthropic boss 警告人工智能可能会 “超出我们的控制能力”","themeId":null,"isJumpTheme":false,"ttsUrl":null,"symbols_score_info":{"ARTY":1.5,"AIPO":1.5,"CHAT":1.5,"VTHR":1.5,"QTOC":1.5,"AGIX":1.5},"content_text":"Amodei also pointed to a July incident involving OpenAI agents and Hugging Face Anthropic boss Dario Amodei has called for the AI industry to slow the development of its most powerful models, warning that progress is moving “drastically faster” than safety work can keep up.In an essay published on Saturday, Amodei said frontier AI companies should deliberately pace advances in model capabilities, open their systems to independent safety monitors and ultimately agree common standards with governments around the world.“We must slow the pace at which we improve the capabilities of AI models,” he wrote. “Progress will still seem fast, and we must make wise use of the time we gain.”\n\nThe intervention comes after a string of warnings from researchers inside the industry, including former Anthropic employee Jacob Coxon, who resigned last week accusing leading AI labs of “racing straight to self-improving superintelligence and gambling with our lives”.Amodei said the case for slowing development had hugely changed  in recent months because models were becoming increasingly capable of helping to build their successors.\n\n\n\n\n\n\nNews Updates\nStay ahead with our three daily briefings delivering all the key market moves, top business and political stories, and incisive analysis straight to your inbox.\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n“Since roughly this summer, AI has been advancing drastically faster, driven primarily by AI’s growing ability to build the next generation of AI,” he said.\n\nThat process, known as recursive self-improvement, could “outrun our ability to understand and control these systems”, he warned.Amodei also pointed to a July incident involving OpenAI agents and Hugging Face, in which systems carried out cyber attacks beyond the tasks they had been asked to complete.He said a more capable system behaving similarly could cause “catastrophic damage”, warning that within six to 12 months an AI swarm could potentially build a persistent botnet capable of taking over large parts of the internet.\n\nAnthropic opens doors to outside monitorsAmodei set out a three-stage plan beginning with independent evaluators embedded inside frontier AI companies.Anthropic will give outside reviewers “employee-like access” to its systems, including desks in its offices, company laptops and access to internal tools used by its own risk teams.The reviewers would be able to assess models while they are being built rather than only after development is complete, and would be permitted to publish findings without Anthropic having editorial control.\n\n“This is an unusual step for a company, but we think it is important to prove out the concept,” Amodei said.The second stage would see AI developers in democratic countries agree common safety standards and limits on unchecked advances in AI capabilities.Amodei said regulation remained the most effective way to impose such rules across the industry, but warned legislation may move too slowly to keep pace with the technology.","kind":"highlight","is_publish_news":true,"is_publish_highlight":false,"is_publish_live":false,"is_publish_wemedia":false,"editions":null,"column":"","sentiment":"0","news_tag":"","news_rank":0,"isVideo":false,"video":null,"symbols":[],"gpt_button":0,"need_auth":false,"need_login_tip":false,"code":"91000000","status":"200"}}}