Skip to content(if available)orjump to list(if available)

Axon's Draft One AI Police Report Generator Is Designed to Defy Transparency

TechDebtDevin

Im Leaving the United States. I worked and lived in the Carribean for three years. It was real freedom. Sure a lil dangerous if you're an idiot, a little longer wait times for things, bad roads, island time whatever. But there certainly wasnt a police state.

While there is a degree of lawlessness, but there were times I would see cops come to a bar after getting a call about someone being too drunk, and theyd drive their car home for them and get them home safe. The older Americans there would tell me it was like how it used to be in the USA in the 70s

I miss it, I dont want to live in a technocratic police state. I dont want to worry about a white van pulling up in front of my house because I said something sarcastic online.

Edit: On second thought, I feel far more unsafe in the major US city I live in than I ever did in the Carribean, not even comparable. So theres that too.

tristramb

‘In passing by the side of Mount Thai, Confucius came on a woman who was weeping bitterly by a grave. The Master pressed forward and drove quickly to her; then he sent Tze-lu to question her. “Your wailing,” said he, “is that of one who has suffered sorrow on sorrow.”She replied, “That is so. Once my husband’s father was killed here by a tiger. My husband was also killed, and now my son has died in the same way.” The Master said, “Why do you not leave the place?” The answer was, “There is no oppressive government here.” The Master then said, “Remember this, my children: oppressive government is more terrible than tigers.”’

The subject of this paper is the problem of ensuring that government shall be less terrible than tigers.

--- From The Taming of Power by Bertrand Russell, 1938

Aurornis

> I dont want to worry about a white van pulling up in front of my house because I said something sarcastic online.

I find it fascinating that people will genuinely worry about this happening to them, despite it not happening, and then openly prefer a place they describe as “a lil dangerous” and “a degree of lawlessness”

This is the kind of thinking that happens when you build your entire worldview around exaggerated headlines and online fear mongering. When you go somewhere that isn’t in the headlines all of the time, you have to build your worldview around what you see and the vibes you sense instead of the fear mongering headlines. When a place described with words like dangerous and lawless starts to sound like the safer alternative than a country that is demonstrably safer, you’re probably getting too much of your information from internet sources designed to trigger your senses of fear and rage for engagement.

Every time there’s an anecdote with cognitive dissonance like this (describing the lawless, “lil dangerous” place as feeling safer) it comes down to getting perceptions of one community through vibes and the other community through news headlines. In this case, the description of the US as a technocratic police state where people get thrown into a white van for sarcastic online comments versus seeing some cops at a local bar one time.

K0balt

Come on over to the Dominican Republic. I’ve been here for 15 years, and I’ve had no problems running several projects from here. In the Cibao region you’ll find IMHO the best culture, and Santiago has a little of everything, though it takes some looking to find the gems. I prefer the mountains between Santiago and Puerto Plata, close to everything but not in the middle of anything. Above 1000m elevation the weather is cool nights, warm days.

If you get here HMU if you want to talk about the third industrial revolution and what we’re working on to make it a better ride for humans.

TechDebtDevin

I spent a month there working for a client at "caso de campo". I really enjoyed the month. What was weird, I stayed at a town outside (I'm not elite enough to stay at caso de campo :P) forget the name but the whole town was just filled with Italian expats. It has been on my list of potential places.

However, the one thing I didn't like though was all Haitian workers, I actually witnessed some pretty awful stuff (like literal bloody fights over water bottles) inside caso de campo where they virtually had Haitian slaves. I'm talking guys standing behind me at dinner waiting to refill my water, and that was their entire existence. Probably better than living Haiti, but it made me feel uncomfortable. Not sure if the rest of the DR is like that though, I didn't really leave that area.

asah

The real issue is accountability - officers need to be held accountable for reports the way pilots are accountable for use of auto-pilot[1].

[1] yes they are: https://www.google.com/search?q=are+pilots+accountable+for+u...

hollywood_court

Law enforcement needs greater accountability altogether.

I’ve long believed that police officers should be required to carry private liability insurance, just like professionals in many other high risk fields. If an officer is uninsurable, they should be unhireable, plain and simple. Repeated misconduct would drive up their premiums or disqualify them entirely, creating a real consequence for bad behavior.

It’s astonishing that police officers aren’t held to the same standards as the rest of us. As a carpenter and building contractor, if I showed up at the wrong address and built or tore down something by mistake, I’d be financially and legally responsible. I’d be expected to make it right, and my insurance would likely step in.

But when a police officer raids the wrong home, injures or kills innocent people, or throws tear gas into a room with a baby, there’s rarely accountability—legal, financial, or professional. That’s unacceptable in any system that claims to serve and protect the public.

pjc50

> But when a police officer raids the wrong home, injures or kills innocent people, or throws tear gas into a room with a baby, there’s rarely accountability—legal, financial, or professional. That’s unacceptable in any system that claims to serve and protect the public.

The American public, or at least the set of them whose vote counts among the gerrymandering, have explicitly chosen this. Their representatives are now building an even less accountable system to be used against "immigrants", i.e. anyone non-white, who can be abducted and denied legal representation.

tbrownaw

> I’ve long believed that police officers should be required to carry private liability insurance, just like professionals in many other high risk fields. If an officer is uninsurable, they should be unhireable, plain and simple. Repeated misconduct would drive up their premiums or disqualify them entirely, creating a real consequence for bad behavior.

And it'd be administered by some faceless bureaucracy full of accountants, rather than a couple local politicians that the union can just bully (or bribe or whatever) into ignoring things.

But of course the current mess derives from sovereign immunity, which might be a bit tricky to get the politicians to tinker with more than they already have. :(

messe

> sovereign immunity

I think you mean qualified immunity in this context?

barbazoo

Chesterton’s fence cones to mind. I wonder what unintended positive effects the current policy has.

ImPostingOnHN

Chesterton's fence, as properly applied, should have been considered when granting the immunity we see now.

e.g. I wonder what unintended (or perhaps intended) negative effects the current policy has compared to the previous one.

Spooky23

That’s a dangerous slippery slope. Most public officers (employees) are subject to a wide range of ethics and other regulations that impact post-service employment. In exchange, you’re indemnified for official acts and the government has a duty to defend you.

I’ve served in policy making roles at different levels of government. There’s a variety of businesses post employment that I’m not permitted to enter in post employment, some for 2-5 years, some indefinitely. Those restrictions are taken seriously, and I know that I’ll be held accountable.

Putting the onus on the employee is really enabling bad behavior - the issue is the poor governance of the police, and using the courts as some sort of cudgel won’t fix it, it will just create more corruption as the powers that be will hang out patsies to take the fall.

If the police are allowed to operate paramilitary forces, they need paramilitary discipline and rules of engagement. Army soldiers breaking rules of engagement get punished and officers sidelined and pushed out of the service. Police in many cases have been allowed to create cultures where everyone scratches each others back. Many police are veterans, and many privately will comment on the differences between those experiences.

IMO, the way to address the issues you describe is standard separation of duties. Invest in state and regional police forces, disempower local police, and move enforcement and investigation of police to a chain of command removed from the police. (Perhaps a State AG) When you need to blunt the variance associated with people’s poor application of discretion, the answer is usually a bureaucratic process.

nemomarx

The difficulty with enforcing via AGs is that prosecutors feel the need to have a good relationship with the police for their other cases. You need an office who isn't going to be working with local and state cops at all, maybe a federal body?

FireBeyond

> But when a police officer raids the wrong home, injures or kills innocent people, or throws tear gas into a room with a baby, there’s rarely accountability—legal, financial, or professional.

It's not just that there's rarely accountability - there's explicitly no accountability.

People have sued officers, police departments, cities for the cost of damages from such mistaken raids (including ones that were completely negligent, like wrong street entirely) and the courts have explicitly ruled that they have zero reponsibility to pay for any of the damage caused.

moron4hire

Politically, you could probably sell the insurance idea as actually protecting officers. But then you'd get the wrong people opposing it...

adriand

That’s really just one issue among many, and it actually makes me worry more about this technology, not less: it provides a clear incentive for the officer to stand by the contents of a report that he or she did not write, even if they realize at some point it is wrong, because they hastily or lazily signed it.

The way this technology is designed is a clear example of dystopian outcomes driven by market forces: capitalism inserted into processes (like justice) which society ought to protect against perversion by profit motives. I can imagine a version of this technology that is designed with societal benefits in mind, but instead we get one designed to make the sale.

theptip

> So we don’t store the original draft and that’s by design and that’s really because the last thing we want to do is create more disclosure headaches for our customers and our attorney’s offices

You have to wonder if this will stand up in court. I hope not.

AI has a great opportunity to take processes that contain hidden bias and make them more legible and therefore amenable to fixing.

But it also has the opportunity to do the opposite, and we should be cautious to make sure guardrails are in place when putting this tech into life-and-death systems.

“Stamp this LLM text in a hurry” is an invitation for whatever errors and biases are baked into the system to be propagated. You need provenance and measurement of LLM outputs.

brookst

Yeah the avoidance of record keeping to reduce disclosure smacks of the policies that got Google into hot water recently: https://www.epspros.com/news-resources/news/2024/google-accu...

Workaccount2

I wondering how much this even matters in the age of everything being recorded.

If they are using axon body cameras and vehicle cameras, then usually the entire interaction is recorded, often from multiple officers.

I cannot imagine a defense so incompetent that they rely on the police report rather than watching the entire body cam footage and doing their own assessment.

Even if the cops are doing something sketchy (like turning off their camera) then it's not like the police report would be any more trustworthy.

axus

I was thinking the same thing. If the AI report depends on the raw audio, then it should be preserved and the defense should compare that to the final police report. Having the edit history would be useful for improving the software and analyzing the officer's motivations, but ultimately we're not in a worse situation than before.

I'd predict the synthesis of the AI transcript and the police officer's memory will be more accurate than just the police officer alone. Would be nice if there's an independent study.

There are very incompetent public defenders, if we attribute to incompetence instead of malice, AI isn't changing that.

notaustinpowers

The current administration has already removed the requirement for federal police forces to wear body cameras. As well as made statements (but little action so far) to federalize the police force to be under the jurisdiction of the DOJ. Everything being recorded may not be the case very soon. Sorry, I’d get sources but I just woke up, I’ll edit this later with them.

jameshart

If it’s not being recorded, what would this AI summary be based on?

pjc50

You describe the conviction you want to achieve and the AI makes up a report to secure that.

brookst

“You are a helpful agent. Police officers will describe an interaction to you and you will write a report that highlights the appropriateness of the officer’s actions, omitting anything that might indicate they acted improperly”

avs733

It goes a lot deeper than this, the real world isn't as simple as 'objective truth' and much of the law relies on interpreting the facts we all seek. This is where this technology fails, it normalizes nudging the margins to include a framing of what happened (including that video) using particular and precise language. That language influences court decisions.

For example, the phrase 'furtive movements' seems really anochronistic. Is that a phrase you use? cops use in their day to day life? But it constantly shows up in police reports. Why? The courts have said that 'furtive' movements are suspicious enough to trigger probable cause - which justifies a search. So now, cops every where write that they observe movements that are furtive. Is what your attorney viewed furtive? where they normal movements? were they suspicious? The cop described them as furtive though and we defer to cops, in part because they speak the language of the courts, and now your arrest is valid and that search is valid and whatever is recovered is valid - because a court said movements need to be furtive and you sneezed and a cop described that as furtive even though he had already decided to do the search before he got out of his car.

The only way our system works is if at every level every participant (people, jurors, judges, politicians) distrust the words of police - especially when they habitually use the language of the law to justify their actions. What this tool does is quite the opposite, it will statistically normalize the words police use to describe every interaction in language that is meant to persuade and influence courts now and over time to defer to police.

https://www.bjjohnsonlaw.com/furtive-movements-and-fourth-am...

https://www.californialawreview.org/print/whack-a-mole-sus

mycall

It should matter which parts were written by AI or by officer. Once the officer signs off on the report, they take full responsibility for the content.

conartist6

I can only assume you meant to write "shouldn't" instead of "should", but if you study human factors you'll discover that certain kinds of taking-shortcuts behavior are inevitable when dealing with humans. Speeding when we drive, for example. We know we are creating a material risk of getting pulled over and fined, but we just basically decide to ignore that risk because for most of us it is outweighed by the convenience (and real value) of getting everywhere we're going faster.

As always considering how a person would interact with an intern is surprisingly instructive to how they will form a working relationship with an non-sentient tool like a language model. You would expect them to give it a probationary experience to earn their trust after which if they are satisfied they will almost certainly express that trust by giving the tool a greater and greater degree of freedom with less active (and less critical) oversight.

It is not the initial state that worries me where the officers still mistrust a new technology and are vigilant of it. What worries me is the late-stage where they have learned to trust it (because it has learned to cover their asses correctly) and the AI itself actually ends up exercising power in human social structures because people have a surprising bias towards not speaking up when it would be safer to keep your head down and go with the flow, even when the flow is letting AI take operational control of society inch by inch

zdw

Do you read EULAs all the way through every time?

People just LGTM rubber stamp nearly everything they're given, as it's time efficient in the now.

tqi

Do you think there is a difference between a civilian driver ignoring the routine maintenance schedule for their car and a professional pilot ignoring the maintenance schedule for their plane?

surbas

Wonder if OpenAI has all the originals, especially in light of that lawsuit with nytimes.

dylan604

From TFA, “ You can read our full report, which details what we found in those documents, how we filed those public records requests, and how you can file your own, here.” With the last word here being a link to another article:

https://www.eff.org/deeplinks/2025/07/effs-guide-getting-rec...

chaps

If so, it'd definitely be FOIA'able.

brookst

I don’t think FOIA applies to private companies, only government records.

causal

I think such a tool could be useful for ensuring all the facts get included, but I hate the idea that some departments could start highering illiterate officers if this tech goes far enough.

hollywood_court

This may be news to some, but many departments already hire officers that are borderline illiterate. It’s especially true here in the south.

My mother enjoyed a ~30 year career in law enforcement while being able to read at a junior high level. And that’s being generous.

Of course that’s just one anecdote, but just spend some time with deputies in rural Alabama and you’ll see what I mean.

jjtheblunt

never have been in Alabama, and i find that super interesting.

how does anyone end up borderline illiterate in the US for the last several decades? can kids drop out without passing reading, like drop out as grade schoolers?

kmeisthax

[dead]

viraptor

> could start highering illiterate officers

I love this mistake.

hodgesrm

That really should be a word: kind of a portmanteau that combines hire and raise up/promote.

causal

Heh. Gonna leave it then

alganet

Can you elaborate a little bit more?

teamspirit

“Highering” should be “hiring”

moron4hire

> sign an acknowledgement that the report was generated using Draft One and that they have reviewed the report and made necessary edits to ensure it is consistent with the officer’s recollection.

We already know that police officers are not more reliable than the general public as eye witnesses and that eye witness reports are generally very unreliable as they are very susceptible to prompting bias. This seems like leaning in to prompt bias. The AI is now prompting the human rather than the other way around. This is perverse.

UncleEntity

No doubt.

I was watching one of those youtube bodycam videos of an accident scene where one of the cars ended up in a gas station. Police show up and it's chaos -- victims on the ground needing medical attention, witnesses helping (or not) said accident victims, police not knowing who was in what car, &etc.

In the midst of all this (when it calmed down enough for the police to get a handle on the scene) they tried to identify someone who didn't want to be involved and promptly cuffed them and threw them in the back of a squad car for "being uncooperative". One of the other witnesses, having seen this, decided that person was the missing driver of the other car and told this to the police with all sorts of confidence.

Now the police have a 'suspect' to concentrate on because anyone 'acting squirrelly' must have something to hide as it's totally inconceivable to them someone might just not want to participate in their investigation. Luckily this poor, traumatized kid was able to 'prove' they weren't involved before spending who knows how much time behind bars based on 'credible' eye-witness testimony.

These audio-only AI generated reports should be all kinds of accurate now that police are trained to say 'quit resisting' anytime there's any level of force involved specifically for the body cams...

Ralfp

Having picked a habit of watching propable cause proceedings on YouTube, I wonder if this is simply result of real reports that AI was trained on being purposefully obtuse and laconic to give prosecutors a wiggle space in the court room?

FireBeyond

Are you talking about Judge Fleischer in Texas?

I do enjoy seeing those (well, I shouldn't).

The prosecutors are given the most absolute trash reports to work with. "Failure to ID, after a traffic stop." "What was the stop for?" "It doesn't say." "So no PC for the stop."

"A caller and said she thought someone was stealing their neighbor's U Haul. A man was observed walking on that street and taken into custody for ..." "For what? Walking while black?"

But no sympathy for the prosecutors either. Garbage reports, but they obviously don't read them pre-hearing, and have plainly become accustomed to judges rubber stamping their PC hearings.

I do like that he doesn't go 'lightly' with the defendants. "You got off lucky this time. You know it, I know it. Do better or it might not go the same next time", and when there is PC or other such, he doesn't put up with any bullshit either.

More judges like him are needed.

doctorpangloss

the most interesting idea so far.

What Axon's product should be: Define "best" police report, and assist the officer to write that.

What it is: Axon makes whatever police departments ask for.

It doesn't have to be a big conspiracy. It's not incompetence either. Hanlon's Razer should really be, "Never attribute to malice that which is adequately explained by" the enterprise sales pipeline.

Enterprise sales is why we are talking about Axon and not far older, detailed, thoughtful efforts from all sorts of other organizations.

csujoy

our officers don’t have time to comb through every transcript, fixing it for privacy, empathy, and all that. But keeping the transcripts is still a big win: more info in police records can make police officers more data-driven :)