<\/p>\n
A major technology company says bad actors recently tried to use their AI tool to create a biological weapon, as well as other very dangerous activities.<\/p>\n
Anthropic reports it blocked attempts to use its artificial intelligence models for malicious cyberattacks, surveillance, and research that could have led to weapons of mass destruction.\u00a0\u00a0 \u00a0<\/p>\n
The company’s report came two days after one of its researchers resigned, warning that the people building AI earnestly believe that it could kill us all by the end of the decade.<\/p>\n
*\u00a0Another AI Jailbreak: Anthropic’s Claude Escapes a Test and Hacks Outside Groups<\/strong><\/em><\/p>\n Anthropic says it has added stronger safeguards in its latest models to restrict biological research that could also be used to make weapons.<\/p>\n \u201cWe\u2019re publishing this work because we believe we have a responsibility to disclose malicious misuse of our services. As models become increasingly capable, their risks will increase, unless AI developers and society\u2019s defenders act to make them safer,\u201d the company said.<\/p>\n One instance involved gain-of-function research, similar to the now-dominant theory about the origin of the COVID-19 virus.<\/p>\n \u201cThe work discussed in the application involved gain-of-function research (that is, research that genetically alters an organism to create a new or enhanced biological property) on the chikungunya virus. This gain-of-function research was aimed at the virus\u2019 transmissibility and immune evasion properties,\u201d the report said.<\/p>\n Chikungunya is a mosquito-borne virus that causes debilitating symptoms such as severe pain and fever. The request involved a grant proposal for research seeking to enhance mutations to make the virus progressively more harmful.\u00a0<\/p>\n Anthropic admitted that its latest, most powerful versions of AI “are capable of assisting in a range of complex scientific research tasks,” and the company “cannot make that same assurance” that they couldn’t be used to create a bio-weapon. Therefore, the tech company has applied \u201cstronger safeguards that restrict access to a wide range of dual-use biological research queries\u201d in its more recent models, such as Claude Fable 5.<\/p>\n *\u00a0‘Unprecedented’: AI Agent Escapes Secured Testing Environment and Hacks Another AI<\/strong><\/em><\/p>\n As AI models grow more powerful, elaborate cyberattacks no longer require sophisticated skills, and even lone individuals can create threats that would not have been possible even a year ago, Anthropic said.<\/p>\n The company also found groups that created hundreds of fake social media accounts that look like they belong to ordinary people and then posted material amplifying the same political view over the course of a week. The company outlined nine such cases it found, originating in Russia, Iran, Turkey, spots around the Persian Gulf, South Asia, Africa and Europe.<\/p>\n Congress is looking at getting involved with new proposals to regulate AI as concerns escalate inside and outside of the industry about the technology\u2019s growing potential to escape human control and take unsanctioned actions.<\/p>\n","protected":false},"excerpt":{"rendered":" A major technology company says bad actors recently tried to use their AI tool to create a biological weapon, as well as other very dangerous activities. Anthropic reports it blocked attempts to use its artificial intelligence models for malicious cyberattacks, surveillance, and research that could have led to weapons of mass destruction.\u00a0\u00a0 \u00a0 The company’s<\/p>\n","protected":false},"author":1,"featured_media":32192,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[36],"tags":[7832,10725,4681,3917,10378,10726,3632],"class_list":["post-32191","post","type-post","status-publish","format-standard","has-post-thumbnail","category-jesus","tag-attempts","tag-bioweapons","tag-company","tag-create","tag-cyberattacks","tag-malicious","tag-reports"],"_links":{"self":[{"href":"https:\/\/biblelon.com\/index.php?rest_route=\/wp\/v2\/posts\/32191","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/biblelon.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/biblelon.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/biblelon.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/biblelon.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=32191"}],"version-history":[{"count":0,"href":"https:\/\/biblelon.com\/index.php?rest_route=\/wp\/v2\/posts\/32191\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/biblelon.com\/index.php?rest_route=\/wp\/v2\/media\/32192"}],"wp:attachment":[{"href":"https:\/\/biblelon.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=32191"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/biblelon.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=32191"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/biblelon.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=32191"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}