Doge Developed Error-Prone AI Tool to "Munch" Veterans Affairs Contracts
124 comments
·June 6, 2025rsynnott
afavour
IMO this is indicative of the kind of questions anyone with DOGE on their resume will need to answer at their next interview.
- why did you do it?
- why did you not quit as soon as you realized how dangerous this was going to be?
"I did what I did, I knew there were mistakes, I don't really know what was done with the output of my work and I never tried to find out" are absolutely disqualifying statements for anyone above associate level engineering.
andrewflnr
Employers inclined to ask those questions will more likely just toss any resumes mentioning DOGE at an earlier stage of filtering.
kjkjadksj
They will probably get a favorable role at a thiel or yc associated company
krapp
Incompetent and destructive as they are, DOGE only did what every company and startup in the world is trying to do, aggressively integrate AI in a way that radically upsets the societal paradigm and makes a ton of money. And much of tech buys into the politics and narrative. They're rock stars. They'll never even need to interview to find work, work will come to them.
afavour
> And much of tech buys into the politics and narrative.
While I agree I think that's a fatalist perspective. It's on all of us working in tech to push back on that. In the unlikely event that someone with DOGE on their resume comes across my desk I certainly will be.
And if folks are able to clear their mind of ideology, this is an account of someone that was straightforwardly bad at their job. It's rare to get such a confession from an applicant, we should use it!
neepi
Ego > engineering.
null
RickJWagner
I’d do it, gladly.
I worked on the Obamacare site after it rolled out, crashing. I gave it my best effort.
I’m in favor of progress and will work for the common good. I think that’s the best way.
delusional
> disqualifying statements for anyone above associate level engineering.
Only if you're an engineer. The Silicon Valley folks love this sort of lawless disregard for wider society.
afavour
I'm not even talking about the wider societal implications. I mean the job of being a software engineer, including in SV. "I knowingly wrote code riddled with mistakes and didn't ever look into how it's being used" is, IMO, disqualifying. The latter more than the former in many ways, being a good engineer above entry level is a lot more than just bashing out code, you need to be understanding the context in which your code operates.
It would be one thing if we were talking about a fresh out of college newbie. But Lavingia was employee #2 at Pinterest and founded Gumroad. It appears he learned absolutely nothing in either place.
collingreen
I live in Silicon Valley and I don't love lawless disregard for wider society.
nilamo
"I needed money." Why is that not a good enough answer?
mrybczyn
"I needed money." - Charles Ponzi "I needed money." - Bernie Madoff "I needed money." - Kenneth Lay "I needed money." - Qusay Hussein
ndegruchy
Because he got paid $0. They hired him as an “intern” or volunteer.
null
rsynnott
Well:
(a) It doesn't appear to actually have come with a salary.
(b) Even if it paid, it slightly stretches credulity given his background that it was the only job that he could get.
nop_slide
> did he just think LLMs were _magic_?
If you happened to follow this particular developer, yes he does think they're magic.
zeta0134
It doesn't even take very long messing around with the things to quickly realize how much smoke and mirrors is involved. Next time you get a good response from your favorite LLM, go ahead, hit "regenerate" a few times. Look at how different the responses can be, from the same initial prompt, with just a liiiiitle push in the RNG weights. Sometimes it's remarkably correct! Sometimes it's remarkably *incorrect* and confident about it. Which one did you get this time?
rsynnott
But, like, in this case, _even if the LLM was a superhuman AGI_, there is _still_ no way it could do what he wants based off the prompt he gave it because it simply would not have the sort of in-depth knowledge of the inner workings of the VA required to make these determinations.
Even if we waive the "LLMs are bit shit" stipulation, it still doesn't really help much.
esafak
@sahillavingia is a member and wrote about his DOGE experience recently: https://news.ycombinator.com/item?id=44116061
nxobject
The only silver lining here is his transparency about being wrong -- and providing evidence of that publicly. Given DOGE's culture of prioritizing avoiding accountability and transparency measures like FOIA [1], it's almost sadly laudable.
[1] https://www.cjr.org/feature-2/trump-100-legal-battle-for-dog...
rsynnott
But he still doesn't seem to get the seriousness of the situation, at all. Like, he's saying no-one should have used his stuff, but also "It would have been cool if the entire federal government used this script".
For instance, imagine you have surgery, and die of a complication. Your relatives will feel very differently, and be in a very different legal situation, if the hospital's explanation is "surgeon was the bottom of their class" vs "yeah, we just handed a visiting 5 year old a scalpel to see what would happen". Neither are ideal, obviously, but the latter is _criminal_.
The idiot in the article is clearly closer to the 5 year old than the scraping-a-pass surgeon; he is simply not in any way a proper person to have been given the sort of access or authority he was, this would have been obvious to whoever gave it to him, and whoever gave it to him is at least morally culpable.
bilbo0s
I mean, hindsight is 20/20, but that's probably why it's a bad idea to give a gaggle-load of inexperienced tech sisses/bros the ability to do stuff like this.
Thinking back on it, a disaster should have been the expected outcome. Drawdowns of the federal government should be measured and deliberate and done by grey haired people not given to rash action. Not by a kid with a python script he thinks is kind of cool.
dylan604
DOGE isn't SpaceX where getting it wrong is a chance to learn for the next iteration. These are human lives being affected by all of these mistakes that they are so nonchalantly making as if the humans are just NPCs in whatever game they are playing. Not only are these mistakes directly affecting humans with the loss of government jobs, they are also affecting citizens that depend on the services these employees worked. I don't care about your silver lining. The damage is done, and it is not easily unwound. All because they had no shits to give and too young to have the life experience to even come close to understanding just how damaging their decisions were.
TrapLord_Rhodo
I think you are misinterpreting the comment here.
>I would never recommend someone run my code and do what it says.
Using this as a tool to signal can be a huge time saver. But not taking the code output as "truth" is what the engineer meant.
> It’s unclear how many have been or are on track to be canceled.
This article, just like you, are taking all of these out of context.
>Google Maps says drive into the lake. Do not drive into the lake.
He's using LLM's as a potential flag, then you go and human review those contracts with lawyers, supply chain, business specialists, nurses on the ground, etc. etc.
Calling him an idiot for being transparent is a personal attack, and has no place here.
Directly from the github: Tools I have written to do stuff more effectively at the VA. Code exists to make humans more efficient; not to replace them. All code leads to human review. Feedback appreciated!
thisisit
Spoken like a developer who doesn't understand how real world works.
> Using this as a tool to signal can be a huge time saver. But not taking the code output as "truth" is what the engineer meant.
Lavingia didn't provide any provable metric that this tool was going a "huge time saver". Additionally, if the output isn't the "truth", what can kind of time saving is expected? That a person needs to run the code, get result and then spend time analyzing results and cross verifying contracts again?
You know what will be a good time saver? Open the contracts and cross check it if it is valid. No AI slop required.
> This article, just like you, are taking all of these out of context.
Real people are impacted by VA contracts. If there is even 1 contract impacting even 100s of people that is enough damage. Saying that this is people taking things out of context shows your of empathy for other human beings, at least if they are not coders.
Because apparently Lavingia should get kudos for his transparency. But calling him an idiot for his lack of self-awareness that he had no clue about government contracts and should not be writing AI and creating this mess, all the while impacting people's life? Well we can't have that.
> He's using LLM's as a potential flag, then you go and human review those contracts with lawyers, supply chain, business specialists, nurses on the ground, etc. etc.
If human review is the point then start from there. Don't write AI slop, generate wrong result and then ask for human review.
To the larger point - Benjamin Franklin said - 'It is better 100 guilty Persons should escape than that one innocent Person should suffer'. In the same vein every well meaning contract/legislation which is helping 100s will have 10s exploiting the loophole. People like Lavingia and from DOGE seemed to have decided that rooting out those 10s is worth hurting the 100s. So, lets write an AI for that.
TrapLord_Rhodo
using an LLM is a very VERY small part of the code he published. 12 lines out of around 13k lines. You seem to be disagreeing with the concept, not the actual code. you prolly could have reviewed the code in the time it took you to google that ben franklin quote.
If you look at the code, he explicitly filters for sole source before he even sicks a LLM on it.
Tell me what you know about far part 6
ryandrake
> Mistakes Were Made
John23832
... and get paid to do it while sidelining anyone with actual experience in the sector/topic.
I called this when it started. They would come in, be totally ineffective to the point of breaking things, and then we would get a "shucks, sorry" later.
rsynnott
I just can't believe how totally incompetent this whole thing is. Even for a Musk/Trump venture, I didn't expect quite this level of just complete nonsense.
eviks
Have you not followed the Twitter acquisition saga and the firing process that followed? It was the same thing
null
nxobject
Imagine hiring a consultancy, and getting stuck with a team of people fresh out of college without any wisdom to guide them... I think that's what the American people got.
FrustratedMonky
Maybe this engineer is just saying, like all big projects, there are mistakes, and there should be more vetting, debugging. It was rushed, so yes, there are mistakes, but not, "generally, all my stuff is bug ridden crap"
davidcbc
This isn't your typical SV startup. Move fast and break things works for garbage like Juicero or Uber for Dogs or whatever silly idea gets VC funding this week, it does not work when you're talking about the lives of millions of people
mdhb
But in this case it WAS all bug ridden crap. Casually rolling the dice with people’s lives like this means you probably won’t be able to live without some fear of people coming looking for you when this is all said and over.
Maybe they don’t realise it yet but their lives have just changed for the worse in a very significant and hard to reverse way. This is going to catch up with them on a reasonable timescale.
FrustratedMonky
I was making a comment on software projects, not a political statement. Thanks for the downvotes. Of course the situation is awful, but not every programmer gets to cherry pick the picture perfect project to work on.
The job market is difficult right now, so who wouldn't take this one? That's the more insidious message from capitalism, there are a lot of cogs in the machine that are fully aware they are cogs, but you still have to eat, so you keep doing cog like things.
mountainb
"That’s not possible — you have 90,000 contracts,” he said. “Unless you write some code. But even then it’s not really possible.”
This entirely possible with some lawyers, some business analysts, perhaps some hospital administrative consultants, and ordinary support staff. That team might even use LLMs in some capacity but not in the way described by the article. Reviewing 90,000 hospital and other service contracts sounds like just another project for a mid-sized or big law firm; or the government. That is how those contracts were created in the first place.
This is like the meme about someone's uncle talking about how there are these 90,000 contracts that no one knows how to review because we've forgotten how to do it. If there's something America still knows how to do it's how to review tens of thousands of turgid government contracts.
ianhawes
Not possible within the 30 day timeframe they were given.
mountainb
With the right teams and resources, this could be done in a shorter time. With that team and skillset there was no way to complete this in a way that did not result in a lot of contract liability to the government and other silliness.
quickthrowman
At 20 working days, that’s 4,500 contracts per day. How big of a team do you think it would take to review 4,500 contracts per day?
smackay
I'd be very interested in learning more about how DOGE got staffed.
If your goal was to dramatically cut government spending, then hiring bright, young people, with no prior experience, who axed first, and asked questions later would be the way to do it, otherwise you'd get bogged down in details since there was probably a good reason, at least initially for the said spending.
However, if you really, wanted to make a spectacular mess then hiring bright, young people, with no prior experience, who axed first, and asked questions later would be the way to do it.
Somebody, somewhere, thought this was a good approach. How could they not know it would turn into a massive clusterfuck. Hubris?
rsynnott
They seem to have gone for option 3, based on the article; hiring _staggeringly incompetent_ people with no prior experience. No-one bright would be saying, to paraphrase the article "no-one should have acted on the output of my shit software, but also it would have been cool if other federal departments had adopted my shit software".
(It's very characteristic of a certain type of AI booster, though; "it's fine as long as you don't use the results for anything, also you should buy more".)
crypto_throwa
I'm in a chat with one of the engineers on DOGE (young college dropout), and they're trying to recruit more young college dropouts to work on DOGE.
I would characterize some in this group as believing they're smarter than everyone else or anything that's been done before, so yes I think it's pure hubris.
There are a lot of bright people in the chat working on very important things, but they're not the ones joining DOGE.
polygotdomain
To start, it was clear that many were Musk fan boys. I don't think "bright" was a driving force, but "young, with no prior experience" would be great if you wanted people to make decisions that have the potential to negatively impact millions of lives. You need people with a lack of context to realize those are the stakes at hand. Since it was also clear they were going to "throw AI at it", I also doubt they were looking for anyone who acknowledged the shortcomings and pitfalls of an all AI approach.
I think this approach got them exactly what they wanted. Musk clearly wanted access to as much data as he could get his hands onto; legally or not. There were contracts and investigations into Musk's interest that he wanted control over, and got. Overall, chaos is not seen as an issue for those in this administration. The attitude from the top was clearly that these agencies and contractors "deserved it" for some reason, even though they have no idea what they really do or why they're doing it.
cwillu
Searching the page for “hiring bright, young people, with no prior experience, who axed first, and asked questions later” shows two results, was that intended?
smackay
Not at all, the slightly snarky wording, was typed on the spur of the moment. Incidentally, I tried the same terms on Google and the AI-powered answer was rather informative with the pros and cons of the approach. Indeed the cons seem to be playing out before our very eyes.
TrackerFF
Here's one guy that posted about his short stint with DOGE, when it was still in the planning stages
https://vinay.sh/i-am-rich-and-have-no-idea-what-to-do-with-...
https://news.ycombinator.com/item?id=42579873
"When I got back home and regaled my friends with my mountain stories, one of my friends joked that I should work for Elon and Vivek at DOGE and help America get off its current crash to defaulting on its own debt. So I reached out to some people and got in. After 8 calls with people who all talked fast and sounded very autistic smart, I was added to a number of Signal groups and immediately put to work.
Working for DOGE for 4 weeks, remembering the power of urgency
Within 2 minutes of talking to the final interviewer for DOGE, he asked me if I wanted to join. I said “yes”. Then he said “cool” and I was in multiple Signal groups. I was immediately acquainted with the software, HR, and legal teams and went from 0 to 100 taking meetings and getting shit done. This was the day before Thanksgiving.
The next 4 weeks of my life consisted of 100s of calls recruiting the smartest people I’ve ever talked to, working on various projects I’m definitely not able to talk about, and learning how completely dysfunctional the government was. It was a blast.
I learned about the power of urgency and having an undeniable mission. Not by reading it somewhere. By experiencing it. I came to realize how laughable my robotics stint had been in comparison. And I started to realize that, although the mission of DOGE is extremely important, it wasn’t the most important thing I needed to focus on with urgency for myself. I needed to get back to ambiguity, focus on my insecurities, and be ok with that for a while. DOGE wasn’t going to fix that.
So, after 4 intense and intoxicating weeks, I called off my plans to move to DC and embark on a journey to save our government with some of the smartest people I’ve ever met. And I booked a 1-way ticket to Hawaii."
rsynnott
> So, after 4 intense and intoxicating weeks, I called off my plans to move to DC and embark on a journey to save our government with some of the smartest people I’ve ever met. And I booked a 1-way ticket to Hawaii.
These aren't serious people.
davidcbc
> The next 4 weeks of my life consisted of 100s of calls recruiting the smartest people I’ve ever talked to
This kid needs to talk to more people
quickthrowman
I remember reading this when it was first posted and being amazed it wasn’t satire.
spaceisballer
You have to demonize the government in order to come in and start trashing the place. Obviously there is going to be some waste to trim. But instead they came in, asked zero questions and started arbitrarily cutting contracts and jobs. In the end all the cuts will just make the government dysfunctional and cost us more than it did before.
insane_dreamer
Serious amount of Kool-Aid being served up here.
ujkhsjkdhf234
All of these people sound like naive psychopaths.
ivape
Dude, I could not even prompt an LLM to be that much of a douchebag. This is novel training data quite frankly. This reads like the developer version of a Blonde bimbo. The true story is probably the jackass is stimmed up and looks good on paper and caught a few lucky breaks that had a windfall.
antisthenes
Textbook narcissism and circumstantial privilege.
antisthenes
Sounds like a micro-dosing narcissist nepo-baby who got rich working at a tech company and doesn't know what to do with themselves, because they assume everything in life is going to be so easy as to not worth doing seriously.
techpineapple
I imagine it was always a weird conflict of intentions.
On the one hand if you're really trying to disrupt an industry, you want to hire at least a good percentage of people who don't understand the industry, so they're not biased by the set of circumstances you may be trying to disrupt - and Thiel and Yarvin and maybe Vance and Elon certainly wanted to disrupt the government. Like Thiel and Yarvin probably don't want people who understand how to renegotiate government contracts, they just want people who know how to burn them to the ground.
But I imagine there were very few people in government, including some of the people "over" them like the senate and house wanted real disruption, and certainly most of the population didn't want real disruption, and Trump and his administration probably didn't want real disruption that would impact their popularity.
So it was probably doomed from the start.
xnx
This is all facilitated by congress and the president. Destruction under any pretense was the goal. They must all be voted out.
glookler
Voted out? Crimes have been committed and the President as dictator nonsense has to be cancelled so these people can all go to federal prison where white collar criminals belong.
masfuerte
But there is no way that is happening while they remain in power.
dylan604
Even out of power, there's no way. SCOTUS said the prez is untouchable. The only hope is that a sweeping change in Congress happens with the mid-terms enough to be able to impeach and convict. But the likelihood of that can be summed up with "wish in one hand and shit in the other. see which fills up faster"
joshstrange
> “I think that mistakes were made,” said Lavingia, who worked at DOGE for nearly two months. “I’m sure mistakes were made. Mistakes are always made. I would never recommend someone run my code and do what it says. It’s like that ‘Office’ episode where Steve Carell drives into the lake because Google Maps says drive into the lake. Do not drive into the lake.”
Sahil Lavingia is a snake. I thought his blog post that was on HN a week or so ago displayed a frightening level of cognitive dissidence and now he wants to distance himself from it all. No way buddy, this will be a millstone hung around your neck. You encouraged this, you participated in this, you cheered this, you will live with the consequences.
mvid
He will probably become a Thiel fellow or raise from YC
nop_slide
Relevant Github repo of the code he apparently used from the article:
gorbachev
Is there a way to -star a github repo?
TrackerFF
They also put a 23 year old to essentially greenlight or stop NSF grants.
https://www.techdirt.com/2025/06/02/a-23-year-old-crypto-bro...
I just don't understand how these people can do what they do? If I was a fresh college grad, and put in that position - to have the final say on whether experts in their fields can get grants, to conduct research on something I have no expertise in...I don't think I could do that job. I'd feel like the biggest empty suit in existence. Don't they feel any shame?
Or do they suffer from some superiority complex, where they think that whatever knowledge they have in AI/ML makes them the smartest person in the room?
EDIT: Reading through it, at least the guy acknowledges his errors.
insane_dreamer
> I don't think I could do that job. I'd feel like the biggest empty suit in existence.
You don't have that level of arrogance. But I've met people who do. They're the worst people to work with.
morkalork
There is a belief that by having grants address DEI and other issues, you're already putting them at the mercy of unqualified individuals and as such "what's good for the goose is good for the gander". Now of course there's some pretty big, atrocious, historical reasons why those parts of the grant application exist.
kevin_thibedeau
> I just don't understand how these people can do what they do
It's narcissistic personality disorder. The 45th administration had a surfeit of responsible adults putting up guard rails to contain the future felon. This one has taken the Hitler youth approach to recruiting like-minded individuals with an inflated sense of their own competence. Minimal critical thinking skills and life experience are a checkbox in the hiring process.
footlose_3815
"AI is the wrong tool to do this" someone said.
Different things need to be addressed, like how someone is able to act outside all three branches of government, and have enough power to destroy the lives of those who protected our country when we needed them most.
It should be crystal clear to even the most skeptical people should turn their opinion on how they bankrupt the poor and bail out the rich every single time.
zenburnmyface
Lavingia should be ostracized from tech for this. What an embarrassment.
eviks
Expected levels of YOLO incompetence, but still fascinating.
bix6
This is honestly unbelievable. Sahil wrote code he knew was bad and it was used to terminate vital medical contracts… how is that not fraud against every person who pays taxes?
jaoane
[flagged]
SketchySeaBeast
I think there's a difference between incompetently squandering government resources and intentionally tearing things apart. Sure, a lot of the time people in government are driving around while staring at their cell phone, but these Doge minions are intentionally driving on the sidewalk because they like hearing the sound of bodies hitting the windshield.
rsynnott
There's a difference between incompetence and recklessness; not all "oops, I did a stupid thing"s are equal.
sjsdaiuasgdia
This is a false equivalency, and it's the kind of false equivalency that is being used to excuse a tremendous amount of what the Trump administration is doing / has done.
insane_dreamer
Arrogance, inexperience, and haste, is a really bad combination when it comes to building fault-tolerant code. And when you're handling government systems, you need fault-tolerant code. This isn't some Tinder app.
Would you hire any ex-DOGE engineer? I ~~probably~~ would not.
This whole thing is just kind of astonishing.
> “I think that mistakes were made,” said Lavingia, who worked at DOGE for nearly two months. “I’m sure mistakes were made. Mistakes are always made. I would never recommend someone run my code and do what it says. It’s like that ‘Office’ episode where Steve Carell drives into the lake because Google Maps says drive into the lake. Do not drive into the lake.”
Well, then why the hell did you write it? For purely entertainment purposes? I mean, what.
EDIT: Oh, wow, just got to the prompt. Did he... did he just think LLMs were _magic_? "Level 1: Necessary consultants that can't be insourced" - how the hell is ChatGPT supposed to know what can and cannot be insourced?
> In late March, Lavingia published a version of the “munchable” script on his GitHub account to invite others to use and improve it, he told ProPublica. “It would have been cool if the entire federal government used this script and anyone in the public could see that this is how the VA is thinking about cutting contracts.”
No, that would not have been 'cool', you idiot. Bloody hell.