NHacker Next
  • new
  • past
  • show
  • ask
  • show
  • jobs
  • submit
Amazon CEO's Talks with U.S. Officials Triggered Crackdown on Anthropic Models (wsj.com)
Topfi 14 minutes ago [-]
I still am struggling to understand why they informed the government about something that is known to be an issue in every LLM. There is no LLM that cannot be jailbroken, so unless this means that we have reached the absolute maximum publicly accessible US made LLMs are allowed to operate at with GPT 5.5, this is not grounded in any sane regulation attempt.

Does anyone know what limits Fable 5 has overstepped in the eyes of the government? Parameter count? Certain benchmark results? Training computer?

Cause if it’s just the ability to assist with cyberattacks and being jailbreakable, there is no model previously released that isn’t equally guilty.

Remember that for GPT 5.5 and 5.4, OpenAI also restricted the cybersecurity focused use under designated models, otherwise rerouting to 5.3-codex like Fable did with Opus 4.8. And both OpenAI models can also be jailbroken all the same.

Basically, what was the reason to tell the government now and not with Opus 4.5 or GPT 5.4? sama has been doing the rounds with apocalyptic predictions…

nojito 59 seconds ago [-]
Because there likely is truth to the claims that mythos and fable are significantly better at finding vulnerabilities.
vrganj 11 minutes ago [-]
Its not Fable 5 that overstepped in the eyes of the US government.

It's Anthropic.

This is transparent revenge for them daring to try and push back a little on enabling war crimes.

Cider9986 4 minutes ago [-]
>This is transparent revenge for them daring to try and push back a little on enabling war crimes.

Anthropic wasn't pushing back on enabling war crimes. They said they didn't want the models to work with autonomous weapons because the the models weren't good enough.

logicchains 7 minutes ago [-]
>This is transparent revenge for them daring to try and push back a little on enabling war crimes.

Don't be so pessimistic, maybe they're just trying to give their buddy Musk and XAi a chance to catch up.

Topfi 5 minutes ago [-]
Anthropic is one of the two consistent revenue sources for XAI via their colossus deal. I have been critical of this man longer than most, but I don’t see him hurting his own bottom line.
10 minutes ago [-]
blitzar 37 minutes ago [-]
> Researchers at Amazon had used a series of prompts to get Anthropic’s Fable 5 model to provide them with information that could be used to aid cyberattacks...

Are there going to be bans on things that could be used to aid in school shootings next?

throwawaytea 12 minutes ago [-]
One infringes on a specific constitutional right.

Also, this country would get even more dangerous without good citizens owning guns.

IMO it's like herd immunity. Not everyone has guns. But the criminals don't know who does and who doesn't, so in a way they treat all homes as potentially being armed.

Our criminals are already pretty care free, I can't imagine how much worse it would be if they KNEW no one was armed.

EmoteSupportBot 3 minutes ago [-]
The brainwashing is truly staggering isn't it?
Cider9986 2 minutes ago [-]
A waste of an aged account.
dash2 34 minutes ago [-]
I mean, for most of the world that is not the gotcha you think it is…
satvikpendem 18 minutes ago [-]
It's not supposed to be a gotcha, it's supposed to be an example of the hypocrisy of the government.
logicchains 15 minutes ago [-]
>Are there going to be bans on things that could be used to aid in school shootings next?

The majority of US school shooters are on SSRIs, for which homicidal ideation is listed on the package insert as an extremely rare side effect. But one-in-a-million cases happen regularly when millions of people are using them. That's why school shootings pretty much never happened before the 1970s, in spite of gun ownership being widespread. So would you suggest we ban SSRIs next?

m-hodges 13 minutes ago [-]
> That's why school shootings pretty much never happened before the 1970s

This claim is gonna need a lot more evidence.

logicchains 2 minutes ago [-]
Here's from Wipedia all the mass shootings conducted by students prior to the 1970s. They're incredibly infrequent compared to the shootings of today,

March 26, 1893 – Plain Dealing, Louisiana (Plain Dealing High School): During an evening school dance, a fight broke out. Students fired shots, killing two immediately, fatally wounding two more, and injuring a professor (total: 4 killed, 1 wounded).

December 12, 1898 – Charleston, West Virginia: Young men (including students/former students in the context of a school exhibition) disrupted an event, leading to a brawl with gunfire. At least 6 killed (including students) and 4+ wounded in the chaos.

July 21, 1903 – Jackson, Kentucky (Cave Run School): Students James Barrett and Mack Howard dueled with pistols over a card game, killing each other; a 12-year-old bystander student was wounded (total: 2 killed, 1 wounded).

November 16, 1904 – Riverside, California (Indian School): A gunfight between pupils resulted in one student killed, another fatally wounded, and one wounded (total: 2 killed, 1 wounded).

October 8, 1950 – New Orleans, Louisiana (Booker T. Washington High School): Suspected gangsters (youths tied to students) fired on each other; 6 bystanders wounded.

May 5, 1956 – Seat Pleasant, Maryland (Maryland Park Junior High School): 15-year-old student Billy Ray Prevatte returned with a rifle after a reprimand and shot staff: 1 teacher killed, 2 injured (total: 3 victims).

October 17, 1961 – Denver, Colorado (Morey Junior High School): 14-year-old Tennyson Beard argued with a classmate, shot and wounded him, then fatally shot another student (total: 1 killed, 1–2 wounded).

October 5, 1966 – Grand Rapids, Minnesota (Grand Rapids High School): 15-year-old student David Black killed a school administrator and seriously wounded another student (total: 1 killed, 1 wounded).

Topfi 12 minutes ago [-]
SSRIs are a first line treatment across many EU countries too, yet we somehow manage.
mapontosevenths 11 minutes ago [-]
Everything you said is here is wildly and completely inaccurate and seems to be based on fringe conspiracy theorist RFK Jr's thoroughly debunked lies.

The exact opposite is true. Countries with the highest SSRI use have the lowest mass shooting rates. The evidence doesn't lie. Politicians do.

https://www.factcheck.org/2025/10/rfk-jr-misleads-about-anti...

logicchains 5 minutes ago [-]
>Countries with the highest SSRI use have the lowest mass shooting rates.

That's a stupid comparison because other countries have much less firearm ownership.

>Everything you said is here is wildly and completely inaccurate and seems to be based on fringe conspiracy theorist RFK Jr's thoroughly debunked lies.

It's a documented effect: https://pmc.ncbi.nlm.nih.gov/articles/PMC1564177/ . Try looking a some actual numbers rather than media funded by pharmaceutical companies.

dualvariable 57 seconds ago [-]
> That's a stupid comparison because other countries have much less firearm ownership.

Okay, let's try being slightly less permissive in our firearm laws then, since you've just proven it works.

zephen 8 minutes ago [-]
To be scrupulously fair, the SSRI thing was a conspiracy theory well before RFK Jr. came into the spotlight.
iririririr 6 minutes ago [-]
man, to repeat this (obviously flawed) argument as your own... you are really down a very bad path of pernicious podcasts. reevaluate some values.
graphime 30 minutes ago [-]
> Are there going to be bans on things that could be used to aid in school shootings next?

No.

Because us Americans don’t care about school shootings.

I’d rather the government invest in S&P500 going higher.

You overestimate how many people actually care about mass shootings in America.

rocketpastsix 29 minutes ago [-]
I think you underestimate how many people actually care about mass shootings.
tokioyoyo 25 minutes ago [-]
Caring with no significant action in prevention doesn’t really signal caring. Sure, it sucks, headlines get printed for a couple of months, then people forget and move on.

To put it in the most disrespectful and sad way, it looks like more people have been on the streets for Knicks games than most (any?) school shootings of the past decades.

SecretDreams 18 minutes ago [-]
It's just harder to get the average joe charged up to fight a battle with anything meaningful on the line. Americans are used to living relatively cushy lives where they don't sacrifice their QOL to make the lives of their countrymen better. The closest thing to that are people in the military, and it's probably been a while since the US military is improving QOL, on average.

People will continue to be complacent on multiple fronts until it absolutely comes to a violent boil. I don't really see half measures or peaceful protests changing anything. And maybe I'm pessimistic, but I think the upcoming elections will either not change enough or be strongly manipulated to maintain the status quo.

graphime 28 minutes ago [-]
> I think you underestimate how many people actually care about mass shootings.

Less than 1% of the population, that’s for sure.

You remember the last protest about school shootings? Neither do I.

throwaway-11-1 19 minutes ago [-]
I get what you’re saying but in the last 20 years can you think of any mass protest that accomplished anything substantial? I don’t really blame people for giving up on it as a tool for change. TBH only truly effective one I can think of would be Jan 6
Jcowell 12 minutes ago [-]
The author said nothing of the people but of the government itself. 12 years ago, elementary school children were slaughtered and even that wasn’t enough to ban guns.
blitzar 14 minutes ago [-]
Maybe we can incorporate the children one by one in delaware and then people will care.

On the plus side they will also then qualify for billions in government subsidies.

satvikpendem 18 minutes ago [-]
Hate to say it but you're right. If people cared, they'd actually do something about it.
shimman 58 seconds ago [-]
People are doing something, the issue with you two's extremely poor thinking is that lack of inaction means no one cares. What it actually represents is the massive growing disparity between the political class and average Americans.

There is >70% public support universal background checks for all firearm transactions, safe storage laws, and crisis intervention. Just the same that there is also large public support for things like public jobs programs, medicare for all, universal childcare, or free university; there is a very real obstacle that the political class in this country are adamant about stopping all progress towards better lives and not strictly caring that the elites extract more wealth or corporations get more welfare.

himata4113 41 minutes ago [-]
First of all I found that fable is trained in a way that even if you were to jailbreak it, it would be completely uninterested in exploitation or finding creative solutions for explotation. However, I am unable to verify if this is related to them doing secretive prompt injection. Opus 4.8 is far more powerful in that regard.

As for jailbreaking if anyone is interested: I used a fork of oh-my-pi that was modified in such a way that it would detect refusals and spawn a model with no safeguards, for ex: deepseek, glm-5.1 with the task to rewrite the history in a way for the refusals to disappear and catalogue sematics behind the refusal in a list. It took around 3 days and $6000 of usage to get from 3% to 85% success rate in various cyber-security related tasks. Although the model was no longer blocked on refusals, it still got outperformed by opus max thinking by a long shot. It felt like I kept having to point it at where to look at since it kept ending turn early saying that: here's the issues I've found and was not that eager into finding ways to exploit them and wanted to fix them instead no matter how many times I've asked.

Another specific part around day 1 I quickly realized that I had to hook toolcall results and have opensource models summarize the results as they appear to give cyber refusals for any kind of log analysis.

svara 4 minutes ago [-]
Okay but if I understand correctly what you did, you measured the performance with automatically rewritten prompts on Fable vs. original on Opus? This might be where the difference in performance that you saw came from.
ronsor 38 minutes ago [-]
$6000 of usage in three days???
kubb 26 minutes ago [-]
Crazy to think that people in some places in the world work for $2 per day. Jailbraking fable is economically equivalent to the labor of a thousand people.
lifty 7 minutes ago [-]
Indeed, it’s also crazy to think that some people vaporize tin pellets in order to etch nanometer scale drawings on silicon crystals while others make mud pies. I think that disparity is even bigger.
breppp 16 minutes ago [-]
Wait until you hear how many families could survive on the food you throw away
kubb 13 minutes ago [-]
That's a bit of a miss, I don't throw away much. Restaurants and supermarkets OTOH... I understand the attempt to make me feel bad though, it would make me feel like I'm complicit, and shouldn't say things like that.
rishabhaiover 10 minutes ago [-]
let him derive uneven distribution of income/wealth across the world from first principles through token pricing.
sigseg1v 20 minutes ago [-]
It's high but totally achievable with "loop" style harnesses or lots of parallel subagents/agent teams.
himata4113 32 minutes ago [-]
3x 20x accounts + they reset a couple of times.
jazzyjackson 27 minutes ago [-]
Everybody needs a hobby
cmiles8 6 minutes ago [-]
It’s unclear what Jassy’s angle was here doing this. It’s pretty bad news for Anthropic though. They had built up some real momentum but am waking up this morning to nearly everyone I know outside the US shifting use off Anthropic.

There is no loyalty or revenue stickiness here. These companies get some momentum, do something to piss folks off, and then people just swap API calls and move onto another vendor. It’s a terrible setup for the model companies business wise. There is no moat.

yogthos 1 minutes ago [-]
I expect the blast radius will include every American service provider. The problem isn't exclusive to Anthropic, the same thing could happen with OpenAI tomorrow. Using American platforms is a huge business risk now and there's no putting toothpaste back in the tube here.
timmg 1 hours ago [-]
> Researchers at Amazon had used a series of prompts to get Anthropic’s Fable 5 model to provide them with information that could be used to aid cyberattacks...

All models can do that. I wonder if they found Fable was significantly better at it.

itopaloglu83 23 minutes ago [-]
Maybe the model found something Amazon didn't want to be known, and not necessarily a cyber vulnerability, but a particular way Amazon operates.
iririririr 1 minutes ago [-]
"find aws zero day. makes no mistakes"
tiahura 18 minutes ago [-]
Down AWS East and make the traffic look like it’s coming from the Vatican.
gen220 1 hours ago [-]
Amazon is a large Anthropic shareholder (>5% of the cap table).

I think it’s impossible to interpret the actions of their executives here without considering this information.

SpicyLemonZest 53 minutes ago [-]
I agree! The concerns must have been very serious indeed to overcome Amazon's strong incentives to not bring them up and let Anthropic keep pulling in the revenue from their new frontier model.
ezekg 48 minutes ago [-]
Or they're trying to hype up an investment...
SpicyLemonZest 33 minutes ago [-]
That doesn't really make sense. If Amazon wanted to build hype, wouldn't they have talked publicly about this? What's the point of working hard on a hype strategy and then delivering it only in private to government officials?
aaronrobinson 48 minutes ago [-]
Begs the question why they didn’t present that info to Anthropic directly and if they did why they didn’t act
SpicyLemonZest 41 minutes ago [-]
It does. Anthropic mentions (https://www.anthropic.com/news/fable-mythos-access) they consider jailbreaks that "provide no Mythos-specific uplift" to be minor findings; perhaps they couldn't agree on what kinds of capabilities were unlocked by the jailbreak Amazon found.
tiahura 13 minutes ago [-]
Very questionable and tone deaf response from Anthropic. Irrelevant whether it’s specific to Mythos or Haiku. Dario seems to be looking for an exit.
margalabargala 43 minutes ago [-]
That's one potential interpretation. There are many others.

Hyping an investment, as mentioned.

If they have continued access, being able to use the tool when others cannot to get ahead.

Amazon's incentives are not so clear or simple as your first interpretation. It's important to think about these things beyond a moment's glance. With practice you will improve!

aix1 1 hours ago [-]
Given Amazon's fairly large equity stake in Anthropic, I really don't get their motivation. Anyone care to speculate?
petra 53 minutes ago [-]
It depends what the end goal may be.

If the end goal is that only regulated US companies can use Fable, that is a pretty good outcome for Amazon, and also for Jeff Bezos's new startup which aims to use AI to monopolize large industries that depend on advanced engineering in the physical world.

logicchains 10 minutes ago [-]
>If the end goal is that only regulated US companies can use Fable, that is a pretty good outcome for Amazon

It's a terrible outcome for Amazon because it destroys Anthropic's revenue. Roughly half of Anthropic's customers are foreigners, and they wouldn't use Anthropic if its next generation model was banned while other providers' next generation models aren't. And if the US follows through and bans all Mythos-level models for foreigners, then in 6-12 months the entire global market will be overtaken by China when its models catch up, and Amazon will lose money on its investment in OpenAI too.

vulcan01 57 minutes ago [-]
I think it's just to hype Anthropic. Check it out, we have products so dangerous the government banned them, we must be so advanced. (Their competitors cannot make such a claim.)
SpicyLemonZest 55 minutes ago [-]
You think Dario called up Andy Jassy and told him "Hey, we're trying to get Fable banned, so can you please go talk to the government and tell them that they need to ban it"?
kypro 9 minutes ago [-]
He's always talking about how dangerous AI is, how the models he's building could be used for cyber attacks, and how if his company is successful then at least 50% of the white-collar workforce will lose their jobs.

Doesn't seem that unlikely he might say something like that.. Unless he's super-villain evil it sounds like he believes the government needs to do something?

simianwords 20 minutes ago [-]
sorry but when will this line of cute conspiracy theories stop? do you really think this was premeditated to hype up Anthropic?
lubujackson 55 minutes ago [-]
Everyone is assuming this isn't a positive outcome for Anthropic. Think about the optics: everyone was shitting on Anthropic for silently downgrading Fable. Now that is forgotten, they have a chance to spend a week or two revising their approach, then will come out with a "Gov't approved" version and life goes on.

Most importantly, Anthropic has been too "uppity" and needed to be put in their place by the powers that be. Power hates disruption. Restrictions, control (and investment) are defenses against transformative tech. Amazon needs Anthropic to bend the knee for their investment to have long term value - the sooner the better.

JumpCrisscross 27 minutes ago [-]
> Everyone is assuming this isn't a positive outcome for Anthropic

It’s not. Shitting on or not, Fable was being used and clearly folks were running up bills. This is political retribution against Anthropic, pure and simple. The fact that Anthropic may be able to spin that doesn’t change what it fundamentally is.

whynotmaybe 1 hours ago [-]
In business, nothing's off limit to destroy others.

You can be better, or you can report them for any "illegal" stuff.

re-thc 1 hours ago [-]
It's not ZDR so none of the megacorps are using it anyway. Microsoft already complained.

If you can't use it then might as well get rid of it.

aix1 1 hours ago [-]
But Amazon has a fairly large equity position in Anthropic. Why mess with that?
re-thc 53 minutes ago [-]
> But Amazon has a fairly large equity position in Anthropic. Why mess with that?

Read the fine prints. None of these hyperscaler deals are $ for equity. It's some provide hosting, rentals etc. With how things are going they can just find another customer.

aix1 32 minutes ago [-]
> None of these hyperscaler deals are $ for equity.

As of Feb, Amazon held $45.8 billion of convertible notes and $14.8 billion of nonvoting preferred stock in Anthropic.

Source: https://www.businessinsider.com/amazon-ai-bet-anthropic-soar...

jazzyjackson 25 minutes ago [-]
Yes OP is saying they didn’t pay all cash for those shares
deafpolygon 1 hours ago [-]
Drive it down so they can buy more equity?
SpicyLemonZest 59 minutes ago [-]
I would speculate that they were concerned, as many people familiar with frontier AI models are, that they are dangerous and could be misused to do bad things.
SubiculumCode 40 minutes ago [-]
Everyone assumes that it is business motivated. Perhaps, but perhaps that business motivation is the fact that this group at Amazon had reportedly many past interaction with the Administration about AI safety, and this being just the latest interaction.
sumeno 20 minutes ago [-]
Yeah... because Amazon is famous for caring about safety over profits...
yokoprime 12 minutes ago [-]
I dont buy that Amazon activly tried to interfere with Anthropic while being one of the largest owners. There is probably a lot one could say about Bezos, but he does not walk away from a payday.
skeledrew 31 minutes ago [-]
Just wait until DeepSeek or another Chinese lab drops something with similar capability next couple months. And without any guardrails. See what happens then.
thefounder 13 minutes ago [-]
Dario will start complaining again hoping they will be banned. Let’s hope this guy is flushed out asap
iugtmkbdfil834 52 minutes ago [-]
I feel obligated to ask: Is Jassy competent enough to argue for or against on anything here?

I am willing to accept he has chops with AWS ( or at least hope he understands what he manages ), but my recent encounters with executive class and AI left me kinda depressed in terms of what they are trying to project and what they, clearly, don't know.

cmiles8 12 minutes ago [-]
AWS isn’t broadly seen as credible in AI beyond commodity compute, but they are a shareholder here.

Jassy missed the boat on LLMs quite badly and the only real angle he had left was to use Amazon’s cashflow to buy stakes and buy business for Trainium.

Insanity 49 minutes ago [-]
He has smart people working for him whom he can rely on.
nijave 16 minutes ago [-]
He might be able to rely on them, but can they rely on him? It's fully possible he consults them then completely misses or butchers the message (really I have no idea, I know very little about him)
Root_Denied 26 minutes ago [-]
Competent underlings just means that delegation works to make him look better, it doesn't make him or his actions any smarter or more effective.
tiahura 20 minutes ago [-]
Dario will be shown the door soon.
mrcwinn 6 minutes ago [-]
If this is true, the Trump administration did the correct and responsible thing. All the immediate pouncing last night is a good reminder to wait a moment for the facts. I’m sure there’s more to learn even still.
solenoid0937 33 minutes ago [-]
Amazon owns 5% of Anthropic. I doubt this is the outcome they wanted.

This is the government trying to swing its dick around and kill Anthropic because they wouldn't allow mass domestic surveillance with their models.

They're sending a message to the tech industry as well: "do as we say, or die."

This is the result of decades of Congress abdicating power to the executive.

PeterStuer 31 minutes ago [-]
Amazon has up to 33 billion in Antrophic, but up to 50 billion in OpenAI. They need keep both of them in balance, to mitigate the threat of being disintermediated.
rocketpastsix 29 minutes ago [-]
Amazon isn't just going to sit by while $33 billion is set on fire.
rdtsc 21 minutes ago [-]
If burning $33B would make $66B somewhere else then I can see them doing it.
27 minutes ago [-]
stefan_ 21 minutes ago [-]
It's one thing to have 5%, it's another for Jassys utter failure in Amazon AI efforts. They are nowhere, and the former isn't gonna save the latter job.
AtNightWeCode 14 minutes ago [-]
WH is lying again of course. Has nothing to do with Amazon or security. Vengeance or trying to help SpaceX. Maybe WH did not like the bad stock price development after the IPO.
jmclnx 59 minutes ago [-]
I can't get to the article, but if the headline is right, this is interesting.

This tells me it looks like the start of AI funding drying up. I say that because it seems these AI companies are starting to "snip" are each other.

majicDave 40 minutes ago [-]
[dead]
PeterStuer 37 minutes ago [-]
Waving goodby to my Prime. Long overdue tbh.
tdb7893 32 minutes ago [-]
I haven't bothered to keep up with all the frontier drama, are the latest Anthropic models more dangerous or easier to get around safeguards than other models?
nijave 18 minutes ago [-]
Anthropic released a new class of model called Mythos a tier above the last one, Opus. The Mythos model was designed for cyber security then they tried to undo that (my understanding) for Fable

So arguably "more dangerous" by design and potentially "more dangerous" because they're smarter although there's ongoing debate to "what degree"

Lerc 1 hours ago [-]
One of the things that I have come to trust the least in journalism is any WSJ story that says "people familiar with the matter said"

Can anyone find another source for this?

JumpCrisscross 24 minutes ago [-]
When I speak to journalists, I am always on deep background. I’ll point them to people who can corroborate. But they’ll be off the record. Refusing anything but named sources in one’s information diet is fine, but most people I know who do this are remarkably inconsistent on the other axis, source quality, accepting names randos on Twitter as the word of god while rejecting respected journalism because Congressional staffers aren’t going to get themselves fired over a story.
fg137 15 minutes ago [-]
You don't have to trust WSJ's reporting, but most people do, including fellow journalists. Their track record is also solid.

(Their opinion section is of course a different matter.)

hn_throwaway_99 50 minutes ago [-]
Why? Are there specific examples of WSJ reporting using unnamed sources that turned out to be false/misleading that led you to this conclusion? Unnamed sources carry some risks, sure, but it's obvious that few people would be willing to put their named to leaked info like this.
jsnell 39 minutes ago [-]
Is your objection specifically to the WSJ, or to the sources not being named in general?

If the former, yes, the are other outlets reporting this with independent sourcing (e.g. The Information).

tonfa 48 minutes ago [-]
What's the issue with WSJ? "people familiar with the matter" is standard lingo, means the journalist and editors have vetted the sources (multiple).
nijave 13 minutes ago [-]
& many times the sources don't want to reveal their identity or go on record. A sort of tradeoff--to get the info they have to protect the source

"You may not talk to the media" is pretty standard language in US employee contracts so obviously these people don't want to fireable offenses on the front page of the newspaper.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact
Rendered at 18:26:21 GMT+0000 (Coordinated Universal Time) with Vercel.