Dataminr tracked Gaza-related protests
264 comments
·March 17, 2025whatshisface
Here's an interesting thought about how preferential surveillance can lead to repression even when it's public and not itself acted on:
1. Every demographic commits petty crimes and code violations at about the same rate (things like parking violations and music piracy).
2. However, people who are being watched will be caught more often.
3. The end result is that people in the "wrong" crowd on average are punished more than people in the "right" one at an equal level of misbehavior.
coolspot
> Every demographic commits petty crimes and code violations at about the same rate
Do you have data backing this claim? For example, homicides (that are not a subject for reporting bias) don’t follow a uniform distribution, so I would expect other crimes to also be non-uniform.
Centigonal
I remember, back when cannabis was illegal in most states, a common argument was that white and black people reported using cannabis at the same rate when surveyed. However, many, many more black people ended up in prison for it.
Here is a survey of US youths that supports this premise: https://monitoringthefuture.org/data/panel/demographic-subgr...
coolspot
> people reported using cannabis at the same rate when surveyed. However, many, many more black people ended up in prison for it.
As I understand it, people went to prison mostly for selling or possessing amounts that are implying selling. Which might explain the difference. Would you go to prison for possessing a single joint back then?
Aloisius
I'm confused. That doesn't appear to show the same rates between demographics.
It appears to show generally more frequent use in men than women, younger than older and until somewhat recently, white than black or hispanic.
decremental
[flagged]
southernplaces7
Do you know of some society in which "petty crimes and code violations" are more or less similar socially to homicides? I'd suggest pondering a comment more carefully. People mostly don't contemplate gunning someone down anywhere near as frequently or thoughtlessly as they might jaywalk, or get a speeding ticket. (though there are exceptions of course)
gottorf
The comparison doesn't have to be with homicides. "Every demographic does X at about the same rate" is such a flat-out wrong assumption that you'd really have to cherry-pick X, with lots of caveats and conditions, for it to hold true.
I think there's an ingrained sense of revulsion, in all of us that live in the cultural era that descended from Enlightenment ideals of equality for all, against the idea that there exist observable group-level differences on nearly any metric you could think of, but that doesn't make it any less true.
bhouston
> Do you have data backing this claim? For example, homicides (that are not a subject for reporting bias) don’t follow a uniform distribution, so I would expect other crimes to also be non-uniform.
Crime rates are likely different for different socioeconomic classes for many reasons, but also the socioeconomic class likely determines in part the types of crimes.
For example, poor people are more likely to do petty crime and physical crimes, while rich people tend to do complex frauds involving large sums.
So you cannot compare rates for one particular crime across socioeconomic groups because they will gravitate towards the opportunities that are present to their class.
null
null
tbrownaw
> Do you have data backing this claim?
I read it as a scenario / "even if" for the presented thought experiment, not a load-bearing assertion about reality. As in the argument being made works equally well whether either way, and trying to challenge it misses the point.
alasdair_
homicide is not a "petty crime" or a "code violation" - that should be all the data you need.
maest
This conversation is basically:
"All zebras are red"
"Actually, if you look at studies, you can see that horses come in all types of colours. So I would expect zebras to be the same"
"Horses are not zebras, that should be all the proof you need to accept that all zebras are red."
sitkack
[flagged]
kristjansson
If there are lost keys everywhere you will actually find some looking under the streetlight. Honest statistical reports may even be written highlighting the frequency of lost-key-findings under streetlights. Credulous readers might begin to suggest that some innate factor of the pooling of their light causes keys to fall exactly within boundaries of their illumination. They might even prefer elected representatives that propose streetlight removal policies, to reduce the scourge of lost keys.
monkeyfun
Beautifully written. I especially adore:
> Honest statistical reports may even be written highlighting the frequency of lost-key-findings under streetlights.
The fact you note them as honest is so rhetorically powerful that I'm dead certain to reference this concept/phrasing again in the future.
tempodox
“Never trust a statistic you haven't faked yourself”. Of course “faked” is deliberately overblown, but just the way you collect your data could already amount to a “fake”, even if it wasn't deliberate. So those statistics mentioned by GP could be honest as far as intentions are concerned. It would merely be incompetence.
amarcheschi
Just today I was preparing some slides for a course that makes the student participate and show some topics we're interested in regarding social and ethical issues in compsci
I googled a bit and I found a hn comment that talked about an article which explains what you say
Basically, they estimate drug use in the population, and they draw a map, and black and white people more or less have the same habits in drugs use. They draw a map of the past arrests by the police for drug crimes and they're skewed towards the black neighborhood. There's a bit more about it since the article dealt with predictive policing and Ai but the gist is what you're saying, and this causes a self reinforcing feedback for the police (which in turn arrests more black people and the loop goes on)
https://rss.onlinelibrary.wiley.com/doi/full/10.1111/j.1740-...
jimbob45
Sounds like that estimate is doing all of the heavy lifting and cannot, by definition, ever be verified.
amarcheschi
Yeah, that's quite a strong assumption. Basically, they're assuming that the local drug use is similar to the national one. While not perfect, they provide some other cases in which these data were deemed more trustworthy than police reports. at least to me it is quite crystalline that a system relying on past police data to predict future crime will be inherently biased by the fact that the police data itself is biased towards certain demographics
Wumpnot
Also arrests are going to be targeted at people selling more so than using, so it isn't the correct metric to begin with.
Aloisius
> 1. Every demographic commits petty crimes and code violations at about the same rate (things like parking violations and music piracy).
What? The rates of parking violations and music piracy vary dramatically with age and gender.
bryanrasmussen
I suppose the implication could be that the set petty crimes and code violations, which includes many things, among which are parking violations and music piracy (two things that vary dramatically between demographics), has an equal distribution between all demographics.
If parking violations are an old demographic problem, and music piracy are a young demographic problem for example (even though it is assumed that more things are in the set than just these two) then it could be that they roughly cancel each other out.
I guess one would really need to know what the full set petty crimes and code violations consists of to be sure.
wahnfrieden
See NYC's recent law changes to legalize jaywalking. I won't pull up the exact citations but there were evenly distributed tendencies to jaywalk yet something like 80-90% of police engagements were with PoC
RVuRnvbM2e
In which HN deduces the existence of Institutional Racism from first principles.
catlikesshrimp
My post is maybe a huge straw man that supports your post (parent)
Incoming Leo Sharp. He transported thousands of kilos of drugs in his car for the Sinaloa Cartel during his career. In the United States. https://en.m.wikipedia.org/wiki/Leo_Sharp
Of course, He was white, he was old, he was a United States Veteran. This is just a funny single case.
eastbound
[flagged]
pesus
What exactly is a "good demographic"? This sounds an awful lot like judging people based on their inherent characteristics.
JumpCrisscross
> What exactly is a "good demographic"?
Let's be realistic, given two towns, one whose median age is 70 and the other filled with teenage boys sporting new licenses, one of them is going to need to invest more into policing resources than the other, ceteris paribus.
I wouldn't extend that to calling teenage boys "bad." But we did come with higher negative externalities to our communities, particularly when behind a car, than other demos.
blorkusmelorkus
[flagged]
deepsun
1. Bogus claim. I'm pretty sure Swiss drivers run red light way less than Lebanese, for example.
bawolff
Am i weird in that this feels kind of normal (im not american)?
Protests should be protected, but i normally assume protestors get permits, and a reasonable police presence is around. Not to intimidate anyone, but just to make sure nobody gets too rowdy, keep protestors and counter-protestors away from each other (to prevent violence), provide aid if anyone gets hurt (big masses of people is always a trample risk). Otherwise just do normal crowd control sort of things.
If they were surveiling individuals who participated afterwards, maybe that would be something, but it seems like (according to the article) all they were doing was keeping track of when protests were happening.
Protests are not private events. They are literally the most non-private event possible. That is the entire point. I dont think there is any reasonable expectation of privacy in terms of time&date of demonstrations.
diegolas
> but i normally assume protestors get permits
can't help but find this hilarious (also not american either)
bawolff
That is kind of the central idea of democracy.
Instead of revolution and all its upheavel & damage, you get a mini controlled revolution every 4 years.
Instead of unmitigated riots, you get demonstrations but with some crowd control & beurocracy to prevent injuries (and well chaos, riots and looting).
Democracy is kind of a deal - you get to have the popular discontent but without the extreme forms that end up damaging bystanders.
hulitu
> That is kind of the central idea of democracy.
What you are describing here, are the requirements. The implementation, is usually, much, much different.
aprilthird2021
Yeah it's a tool, the use of it will show the issue. For example if they only surveil certain types of protests and not others.
Another worrying element of protest surveillance is the documented practice of sending in provocateurs who commit violence or break stuff or cause problems to allow a pretense for crackdowns.
chakintosh
> but i normally assume protestors get permits,
Good luck obtaining a permit for a Gaza protest from people in Israel's payroll.
bawolff
In most democracies there are rules about being fair in terms of issuing permits and a court system where you can sue if they aren't fair in issuing permits.
hulitu
> In most democracies there are rules about being fair in terms of issuing permits and a court system where you can sue if they aren't fair in issuing permits.
But this does not guarantee that you will get a permit.
lenerdenator
Is this really surprising to anyone?
If you're out in public and using public websites to organize protests, it's a given that data will be mined about that.
The trick is to make it unattractive for those doing the enforcing to act upon their analysis of that data.
tdb7893
I think that while not surprising it's still interesting and useful to know exactly how they are doing it and what tools they are using. In the US protests are a constitutionally protected right and visibility into how they are monitoring and reacting to them is important.
shadowgovt
If we remove the tech from the story and consider the old "colonial village test":
A man walks up and down the street either shouting about, or handing out flyers, that say "We should get together and blockade main street in protest of the illegitimate taxes Congress has passed on our whiskey." Is it legal for the cops to stop him? Probably not.
Is it legal for the cops to move their plans around to show up on main street that day? I can't see why it wouldn't be.
tptacek
It's more than legal for the cops to do that; it's a longstanding norm. In fact, at many protests, it's something you actively want to see, because counterprotests can get rowdy and dangerous.
mmooss
> If we remove the tech from the story
If we remove the tech from the dropping of the atomic bombs, what's the big deal?
You can't remove the tech; it is intrinsic to the issue.
null
CalChris
This is surprising. Why are the police monitoring constitutionally protected activity?
imperfect_light
Police in my city go to pretty much every protest and take video and photos (with big zoom lens) from the roofs of nearby buildings. It's always surprising to me that more people don't notice.
bjoli
I am pretty sure this would be a crime in my home country. There are court cases cementing that anything except superficial photography/filming by law enforcement lacks any kind of support in law. There are even laws restricting use of photography in situations when exercising any coercive measures ("tvångsåtgärd").
null
CodeWriter23
Acts in public are not protected. This, however is:
"The right of the people to be secure in their persons, houses, papers, and effects, against unreasonable searches and seizures, shall not be violated, and no warrants shall issue, but upon probable cause, supported by oath or affirmation, and particularly describing the place to be searched, and the persons or things to be seized.
stvltvs
Posting on a publicly accesible website is the legal equivalent of standing on the street corner having a conversation. A police officer doesn't need to search anything because it's out in the open.
shadowgovt
For the same reason they use ancestry databases to narrow the field of potential serial killers to a few that can be investigated through legally-admissible means.
There is a vast gap between what the cops can do in general and what holds up in court, but to a first approximation: the things they aren't allowed to do because it would taint the case are in general explicitly spelled out, and if it isn't spelled out it's legal to use as a stepping stone to conventional, more-understood-protections police tactics. Thus arresting someone for a general Twitter post is probably off-limits (the incitement-to-riot or sedition laws are narrowly tailored), but taking someone online who says "Hey let's all get together and do a riot" seriously, and allocating police resources to prepare for it as if they're telling the truth about their intentions, is almost certainly legal.
(This is the battleground that the ACLU fights on in this day and age).
lenerdenator
They do it more than you'd think. There're a ton of pictures of La Cosa Nostra members walking around in Brooklyn taken by FBI agents. They even made sure to get the good side of Casso and Gotti.
Walking around and talking to each other? Constitutionally protected.
mmooss
Very possibly those people were named subjects of active investigations for crimes; the protestors are not named (it's a dragnet), not subjects of investigations, and are suspected of no crimes.
tptacek
When the police watch you walk down the street they are also monitoring constitutionally protected activity.
text0404
a police officer observing you briefly with their eyes is quite different than an entire police department outsourcing surveillance of protected activities to a third party which monitors your online activity over time.
null
CalChris
Walking down the street is not a constitutionally protected activity not that the police should monitor it without a statutory reason. Driving also isn’t. If you think different you’ll have to cite different. But assembly and expression are constitutionally protected.
But back to my original question, why are the police monitoring constitutionally protected activity?
throwawayffffas
Because it involves gatherings of large crowds in public spaces. It is their job to make sure that such gatherings result in no harm of either the protesters nor the local community.
Mountain_Skies
[flagged]
mmooss
> Protests over issues like Gaza have a high probability of turning violent
What is the probability? I'm not saying it never happens, but a 'high probability'? Let's see some data!
Maybe there's a bias based on what you see in the news - they naturally cover the violent ones (and then depict them as the entire protest instead of something that happened off to the side that most people didn't even know occurred).
skrtskrt
True, when the Zionist gangs showed up at UCLA and started shooting Roman candles, and choking out and beating protestors it did get violent really quick.
Luckily the police showed up to protect the Zionists so they could keep committing violence.
giraffe_lady
How many gaza protests have there been in the US alone in the past two years and how many of them had any violence at all? I wouldn't call it a "high probability."
prophesi
It's not surprising to me because The Intercept regularly reports on the use of Dataminr by various US agencies.
https://kagi.com/search?q=dataminr+site%3Atheintercept.com&r...
Teever
It is unfortunately surprising to a lot of people.
For what ever reason many people lack the ability to understand the casual connections between things that happen online and in the real world.
delichon
Imagine the reverse: A police department vows not to use social media to help predict where to deploy their forces to protect public safety. That sounds like malpractice. A commitment to civil rights doesn't restrict them from gathering real time public intelligence, a.k.a. situational awareness, to do their job.
bigolkevin
Respecting people's civil rights and the spirit of the Constitution? Oh, the horror!
typon
Imagine the actual reverse: police surveil American jews for attending pro Israel/pro genocide protests. The police chief would be fired within a day.
kazinator
So let's get this straight. People are tweeting that they're going to protest somewhere. But when cops see these tweets, that "surveillance".
mattigames
That's an oversimplification, it's when cops start keeping track on people based on such data, plus analyzing their behavior as a group.
chneu
Is it though? People are willfully submitting all this information to American companies that we know share info with police.
When cops start using geolocation data that isn't enabled I'll be more worried.
kazinator
Peaceful protest sometimes attract a few bad apples. Things have ways of going wrong. If the police weren't on top of these activities, they would look massively incompetent in their job.
ngruhn
Don’t you have to register protests in the US? So if there registered the police already knows about them, right? And if not they are illegal, no?
JumpCrisscross
> And if not they are illegal, no
Usually not, no. At least not until lawfully ordered to disburse.
7402
It depends where you are and the circumstances. You certainly need a Parade Permit if you will be marching down a city street blocking traffic, e.g, for New York City: https://www.nyc.gov/site/nypd/services/law-enforcement/permi...
zdragnar
Even then, it isn't often enforced. A few times a year people walk out into freeways in groups to shut down traffic and get at most a slap on the hand for it.
sureglymop
This isn't a statement about these specific protests (that I'm not informed enough about) but don't you find "registering" a protest at least a little bit laughable?
blorkusmelorkus
Twitter started as TXT2MOB for organizing protests, and now it and social media have become surveillance tools. The irony.
JumpCrisscross
> Twitter started as TXT2MOB for organizing protests, and now it and social media have become surveillance tools
Propaganda, communication and surveillance vary only inasmuch as the sender and/or receiver are coöperating. When done in public, communication necessarily empowers the other two.
Centigonal
This is a really great piece of wisdom. Thank you!
blorkusmelorkus
What are “the other” two here?
JumpCrisscross
Propaganda and surveillance. If you’re communicating in the open, it’s trivial for a non-coöperating receiver to tap in. And it’s only a touch more trivial for a non-coöperating sender to join in on the rabble. You cannot have a private and public communication protocol.
nemo44x
This whole thing is “why won’t you let us undermine you?! The law says we can subvert and overthrow you!”
Coercion has limits.
jeffbee
It is not "surveillance" when the cops see your tweets.
tptacek
It technically is! The ACLU has a model ordinance called CCOPS, which it encourages municipalities to pass (I got my own muni to pass a version of it last year), and it includes an expansive definition of "surveillance" that definitely includes tools that read public posts on social media.
Importantly, CCOPS doesn't forbid surveillance; it simply requires new instantiations of it to be approved at an open board meeting. Things like Dataminr would almost certainly pass.
jeffbee
As you say, expansive. As in: it expands the definition of surveillance in a way that isn't widely accepted.
sejje
Expansive means large, vast.
Not necessarily growing.
milesrout
It "technically is" if you redefine it to include it. In other words, it isn't.
bjoli
I think the idea of no expectation of privacy in public places crashes with the ever increasing capabilities of law enforcement and companies to register your activities and views.
What is now registered with digital dragnets that can be queried at any time is what would require actual man-hours 50 years ago for just following one person.
rynohack
That's basically the approach taken in Carpenter v. United States. The Supreme Court said, sure, the police could track people in public with dozens of cars and thousands of man hours, but using CLSI data means it can be done with a few mouse clicks.
You can't apply the "reasonable expectation of privacy" standard when you get into these new electronic forms of surveillance. It's become far too cheap and easy to surveil.
Not that I fully endorse their broaded view of privacy, I see it as much more of a fundamental right. That said, I was impressed that this court(who constantly misunderstands technology) understood this.
jeffbee
I cannot endorse this overbroad definition of "privacy" and in fact I can't see the logic in it at all. It is true that in the past the cops could not automatically hoover up your posts, but is also true that in the past no individual person could reach millions/billions of other individuals instantly with short messages and videos. The increase in scope of police collection of public communications is proportional to the increase in reach of those communications platforms. It is all well-balanced.
unethical_ban
Does surveillance need to be covert? Historically, if the police are observing you or your event specifically, that's surveillance.
nickff
I mostly agree with you, but there’s a difference between using a non-covert method of communication like telephone or SMS, and a social media post, which is designed to be relayed and amplified.
Tostino
What legitimate reason would the police have for monitoring everything on social media that is protected by the Constitution?
bawolff
That said, if you put a classified advert in a newspaper and police read it,i wouldn't call it survelience, and that feels more similar to reading twitter posts.
giraffe_lady
Judging by the cops I see around chicago their main responsibility is reading tweets actually.
bavent
Or eating Portillos. Or napping in their cars.
rqtwteye
Unless there is a massive rethink of a lot of laws we are running into a surveillance state worse than Orwell could have come up with. "No expectation of privacy in a public space" made sense when there were no databases that could record and analyze everything that's going on and people didn't live half of their lives on the internet. And tech is only going to accelerate the ease of total surveillance.
I think Jefferson proposed to let the constitution expire every 19 years. I think he had a point there. Instead of viewing the "Founding Fathers" as the ultimate source of wisdom we should accept that they made decisions that made sense during their time but times have changed so some decisions should change.
_bin_
> Jefferson proposed to let the constitution expire every 19 years.
This is a terrible idea, actually. The risks of opening the door to majorly modifying the Constitution are very, very high. There are a lot of core freedoms (speech, arms, press come to mind) that would likely come off worse, not better, were we to do so. Which get hit hardest would depend mostly on who's in office at the time, which is extra bad.
johnisgood
You could always make sure it could only increase and not decrease privacy or what have you.
Similarly, the "expire every 19 years" must always be included and must never be removed.
Gotta keep this small though, because then what's the point...
krapp
>You could always make sure it could only increase and not decrease privacy or what have you.
How could one "make sure" of this, and with what authority?
>Similarly, the "expire every 19 years" must always be included and must never be removed.
Again, says who? The constitution has expired, and with it any legal basis for such a requirement.
Aurornis
> I think Jefferson proposed to let the constitution expire every 19 years. I think he had a point there. Instead of viewing the "Founding Fathers" as the ultimate source of wisdom we should accept that they made decisions that made sense during their time but times have changed so some decisions should change.
These ideas sound great when you imagine ideal politicians doing exactly what you want.
They're not so appealing when you remember that on a long enough timeline you'll get some political leaders who would abuse such a power to no end: Rewriting the constitution to give the president unchecked power or remove term limits would be more likely targets than anything you're imagining working in your favor.
krapp
...and simply not including the 19 year expiration in the new version because why would you?
eej71
While Jefferson is an understandably venerated figure in the foundation of America, he was not active in the creation of the constitution. He of course wrote The Declaration of Independence and while having misgivings about the strength of the executive branch, he went on to become a hugely influential president.
On the filp side, it took him a while to come around to see the folly that was the then French Revolution whereas his political critics - notably Adams, Washington, and the frequently maligned Hamilton, were quick to keep their distance from it.
I like Jefferson but he sometimes seems to have an overly rosy and romantic view of revolutions. Tearing down is easy. Building up is very hard.
null
JumpCrisscross
> Jefferson proposed to let the constitution expire every 19 years. I think he had a point there
You want every state to come up with its own way of determining how to send delegates to a convention literally unbound by any law?
sitkack
We are about to watch that show!
null
geodel
Why wait for 19 years? Lets change constitution along administration change in DC.
gs17
Jefferson wanted 19 years to make it something each generation gets the chance to do, based on life expectancy at the time.
>And the half of those of 21 years and upwards living at any one instant of time will be dead in 18 years 8 months, or say 19 years as the nearest integral number. Then 19 years is the term beyond which neither the representatives of a nation, nor even the whole nation itself assembled, can validly extend a debt.
>[...] On similar ground it may be proved that no society can make a perpetual constitution, or even a perpetual law. The earth belongs always to the living generation. [...] The constitution and the laws of their predecessors extinguished then in their natural course with those who gave them being. This could preserve that being till it ceased to be itself, and no longer. Every constitution then, and every law, naturally expires at the end of 19 years. If it be enforced longer, it is an act of force, and not of right.
baggy_trough
You can! Just have to get the votes.
ryandrake
Headline is kind of clickbaity. They could have just as easily used "LAPD Surveilled Gaza Protests Using A Tool Called Dataminr". Bonus: The tool name is in the URL itself!
xmprt
I'd change it to "A Social Media Tool called Dataminr". On its own, the name of the tool is meaningless.
null
https://archive.md/ofFDk