Skip to content(if available)orjump to list(if available)

40 percent of fMRI signals do not correspond to actual brain activity

Aurornis

This isn’t entirely news to people in the field doing research, but it’s important information to keep in mind when anyone starts pushing fMRI (or SPECT) scans into popular media discussions about neurology or psychiatry.

There have been some high profile influencer doctors pushing brain imaging scans as diagnostic tools for years. Dr. Amen is one of the worst offenders with his clinics that charge thousands of dollars for SPECT scans (not the same as the fMRI in this paper but with similar interpretation issues) on patients. Insurance won’t cover them because there’s no scientific basis for using them in diagnosing or treating ADHD or chronic pain, but his clinics will push them on patients. Seeing an image of their brain with some colors overlayed and having someone confidently read it like tea leaves is highly convincing to people who want answers. Dr. Amen has made the rounds on Dr. Phil and other outlets, as well as amassing millions of followers on social media.

kspacewalk2

Dr. Mike, a rare YouTube doctor who is not peddling supplements and wares, and thus seems to be at the forefront of medical critical thinking on the platform, interviewed Dr. Amen recently[0]. I haven't finished the interview yet, but having watched some others, generally the approach is to let the interviewee make their grandiose claims, agree with whatever vague generalities and truisms they use in their rhetoric (yes it's true, doctors don't spend enough time explaining things to patients!), and then lay into them on the actual science and evidence.

[0] https://www.youtube.com/watch?v=J-SHgZ1XPXs

patmorgan23

Dr. Mike did an incredible job in that interview. He gave Dr. Amen all the rope to hang himself with his own words. When you're hawking a diagnosis method and you're not interested in building up the foundation of evidence for it by doing a double blinded, randomized controlled study. And that the results of said study would change how your treating patients it's pretty clear who the snake oil salesman is

kafkaesque

People questioned his values and his "medical thinking" after he had a party during the pandemic without masking or distancing[1], so he is probably not exactly "at the forefront."

From a Medium article[2]:

"The issue was that he attended a party on a boat and someone took a picture of him and over a dozen other people in close proximity without masks. After getting caught, he made an apology video on his second channel, which only has 58k subscribers compared to his main channel’s 6 million. Not only was this apology riddled with flawed logic and self-justification, but now the opposition to COVID guidelines now has more ammunition."

[1] Image from November 2020: https://miro.medium.com/v2/resize:fit:1400/format:webp/0*Lr_...

[2] https://therewiredsoul.medium.com/the-real-problem-with-the-...

ahmeneeroe-v2

Wow a masking-maximalist in 2025! I admire your tenacity!

yomismoaqui

I have been treated by very good doctors that smoke.

And also... https://en.wikipedia.org/wiki/Ad_hominem

dpark

I hate that this is what modern discourse has become. “This person once did something stupid so you clearly shouldn’t trust them.”

Meanwhile habitual frauds and incompetents get a pass because at least their stupidity is consistent.

ashleyn

Back in 2009 I remember reading about how dead salmon apparently turns up brain activity in fMRI without proper statistical methods. fMRI studies are something frequently invoked unscientifically and out of context.

https://www.wired.com/2009/09/fmrisalmon/

api

Pop science guru-ing is a giant flashing red sign for me. I am never even a little surprised when the latest “sense maker” or pop science guru comes out as a complete loon or is consumed by some kind of scandal.

Influencers in general are always suspect. The things that get you an audience fast are trolling or tabloid-ish tactics like conspiracism.

badlibrarian

I thought I was being clever by coining the term "non-invasive phrenology" but it appears people are already using it non-ironically.

telotortium

In many ways old-school bump measurement is actually less invasive

fluidcruft

("wallet biopsy" is another fun term if you haven't encountered it)

suyash

Dr. Amen is more of a marketing/sales guy than a medical expert.

NalNezumi

My previous job was at a startup doing BMI, for research. For the first time I had the chance to work with expensive neural signal measurement tools (mainly EEG for us, but some teams used fMRI). and quickly did I learn how absolute horrible the signal to noise ratio (SNR) was in this field.

And how it was almost impossible to reproduce many published and well cited result. It was both exciting and jarring to talk with the neuroscientist, because they ofc knew about this and knew how to read the papers but the one doing more funding/business side ofc didn't really spend much time putting emphasis on that.

One of the team presented a accepted paper that basically used Deep Learning (Attention) to predict images that a person was thinking of, from the fMRI signals. When I asked "but DL is proven to be able to find pattern even in random noise, so how can you be sure this is not just overfitting to artefact?" and there wasn't really any answer to that (or rather the publication didn't take that in to account, although that can be experimentally determined). Still, a month later I saw tech explore or some tech news writing an article about it, something like "AI can now read your brain" and the 1984 implications yada yada.

So this is indeed something probably most practitioners, masters and PhD, realize relatively early.

So now that someone says "you know mindfulness is proven to change your brainwaves?" I always add my story "yes, but the study was done with EEG, so I don't trust the scientific backing of it" (but anecdotally, it helps me)

SubiculumCode

There are lots of reliable science done using EEG and fMRI; I believe you learned the wrong lesson here. The important thing is to treat motion and physiological sources of noise as a first-order problem that must be taken very seriously and requires strict data quality inclusion criterion. As far as deep learning in fMRI/EEG, your response about overfitting is too sweepingly broad to apply to the entire field.

To put it succinctly, I think you have overfit your conclusions on the amount of data you have seen

D-Machine

I would argue in fact almost all fMRI research is unreliable, and formally so (test-retest reliabilities are in fact quite miserable: see my post below).

https://news.ycombinator.com/item?id=46289133

EDIT: The reason being, with reliabilities as bad as these, it is obvious almost all fMRI studies are massively underpowered, and you really need to have hundreds or even up to a thousand participants to detect effects with any statistical reliability. Very few fMRI studies ever have even close to these numbers (https://www.nature.com/articles/s42003-018-0073-z).

jtbayly

But none of this (signal/noise ratio, etc) is related to the topic of the article, which claims that even with good signal, blood flow is not useful to determine brain activity.

D-Machine

The difference is that EEG can be used usefully in e.g. biofeedback training and the study of sleep phases, so there is in fact enough signal here for it to be broadly useful in some simple cases. It is not clear fMRI has enough signal for anything even as simple as these things though.

yboris

In related news: ironically, Psychedelics disrupt normal link between brain’s neuronal activity and blood flow - thus casting some doubt on findings that under psychedelics more of the brain is connected (since fMRI showed elevated blood flow, suggesting higher brain activity).

https://source.washu.edu/2025/12/psychedelics-disrupt-normal...

HocusLocus

As a caveman pondering "Stoned Ape Theory" during the rise of MRI in the 80s, having done light reading of Huxley, McKenna et. al, the claim that vascular variations were so tied to thought patterns in a purely calm and cognitive activity was fascinating. To see the brain of someone as they went through a deck of cards and paused to look at each... astounding! But frustrating also. My first question always was, was the person's hands busy going through the deck and holding up the cards, focusing on them... or were they merely shown the cards sitting still? It seemed the popsci articles often glossed over that information, and any simple "control for coordinated body movement" played second fiddle to the novelty of it all. Then I worked in a club where I was often surrounded by tripping people. I'd fetch them glasses of water and they would always drink. Do you know you can smell them, they smell like fear? The experience has every sweat gland working overtime. When I learned that I greeted this "tripping people MRIs light up indicating enhanced brain connectivity" with a grain of salt. I would not be the least bit surprised if the sweat gland thing also has the brain's vascular system in overdrive.

SubiculumCode

I'll get raked for this, but as someone in the field, I can say with high confidence that the majority of comments in this thread are not from imaging experts, and mostly (mis)informed by popular science articles. I do not have the time to properly respond to each issue I see. The literature is out there in any case.

strongpigeon

I’m sure you’re right, but given the spectrum of answers here, it’d be much more useful to point out which ones you think are wrong.

DANmode

Seeing HN take on your speciality or topic can be brutal.

Condolences.

Loughla

I hide any thread that deals with education, education funding, or teaching in general for that specific reason. It really saddens me to see that this place is full of so much misinformation and anecdotes made into data (and usually with much more self-confidence than other forums, which is interesting to me).

It's why I generally only ask questions, or ask for clarification instead of directly challenging something I think might be wrong now in threads that aren't related to something I have deeeeep personal knowledge of. I know when I'm out of my area, and don't want to add to the ignorance.

georgeecollins

As someone who used to work at the Cognitive Neurophysiology Lab in the Scripts Institute-- doing some work on functional brain image-- I can confirm this was not news even thirty years ago. I guess this is trying to make some point to lay people?

tlb

Are there proposed reasons for increased blood flow to brain regions other than neural activity? Are neurons flushing waste products or something when less active?

D-Machine

Many reasons, and yes, basically, that is one of them.

Ekstrom, A. (2010). How and when the fMRI BOLD signal relates to underlying neural activity: The danger in dissociation. Brain Research Reviews, 62(2), 233–244. https://doi.org/10.1016/j.brainresrev.2009.12.004, https://scholar.google.ca/scholar?cluster=642045057386053841...

DANmode

The glymphatic system, sure.

Aurornis

fMRI has been abused by a lot of researchers, doctors, and authors over the years even though experts in the field knew the reality. It’s worth repeating the challenges of interpreting fMRI data to a wider audience.

sigmoid10

The way I understood it is that while individual fMRI studies can be amazing, it is borderline impossible to compare them when made using different people or even different MRI machines. So reproducibility is a big issue, even though the tech itself is extremely promising.

SubiculumCode

This isn't really true. The issue is that when you combine data across multiple MRI scanners (sites), you need to account for random effects (e.g. site specific means and variances)...see solutions like COMBAT. Also if they have different equipment versions/manufacturers those scanners can have different SNR profiles. The other issue is that there are many processing with many ways to perform those steps. In general, researchers don't process in multiple ways and choose the way that gives them the result they want or anything nefarious like that, but it does make comparisons difficult since the effects of different preprocessing variations can be significant. To defend against this, many peer reviewers, like myself, request researchers perform the preprocessing multiple ways to assess how robust the results are to those choices. Another way the field has combatted this issue has been software like fMRIprep.

D-Machine

It is in fact even difficult to compare the same person on the same fMRI machine (and especially in developmental contexts).

Herting, M. M., Gautam, P., Chen, Z., Mezher, A., & Vetter, N. C. (2018). Test-retest reliability of longitudinal task-based fMRI: Implications for developmental studies. Developmental Cognitive Neuroscience, 33, 17–26. https://doi.org/10.1016/j.dcn.2017.07.001

Aurornis

Individual fMRI is not a useful diagnostic tool for general conditions. There have been some clinics trying to push it (or SPECT) as a tool for diagnosing things like ADHD or chronic pain, but there is no scientific basis for this. The operator can basically crank up the noise and get some activity to show up, then tell the patient it’s a sign they have “ring of fire type ADHD” because they set the color pattern to reds and a circular pattern showed up at some point.

freehorse

The BOLD response (oxygen-neuronal activity coupling) has been pretty much accepted in neuroscience. There have been criticisms about it (non-neuronal contributions, mysteries of negative responses/correlations) but in general it is pretty much accepted.

D-Machine

The measurement of the BOLD response is well-accepted, but the interpretation of it with respect to cognition is still basically mostly unclear. Most papers assuming BOLD response uniformly can be interpreted as "activation" are quite dubious.

georgeecollins

Yes, I stupidly read the headline and said "no duh" but they are making a point about our understanding of brain activity. I was thinking about the part of the signal that is reliably filtered out, they are talking about something else. Sorry, I was wrong.

sgt101

Good for you George E Collins.

jtbayly

Really? This was known: "there is no generally valid coupling between the oxygen content measured by MRI and neuronal activity"?

georgeecollins

The coupling was always debated, but you are right, that wasn't known or at least decided. I made a mistake and you are right.

Hasty post. I apologize.

rcv

I remember reading a paper back in grad school where the researchers put a dead salmon in the magnet and got statistically significant brain activity readings using whatever the analysis method à la mode was. It felt like a great candidate for the Ig Nobel awards.

kspacewalk2

This study is validating a commonplace fMRI measure (change in blood-oxygenation-level-dependent or BOLD signal) by comparing it with a different MRI technique, one that uses a multiparametric quantitative BOLD model, a different model for BOLD derived from two separate MRI scans which measure two different kinds of signal (transverse relaxation rates), and then multiply/divide by a bunch of constants to get at a value.

I'm a software engineer in this field, and this is my layman-learns-a-bit-of-shop-talk understanding of it. Both of these techniques involve multiple layers of statistical assumptions, and multiple steps of "analysing" data, which in itself involves implicit assumptions, rules of thumb and other steps that have never sat well with me. A very basic example of this kind of multi-step data massaging is "does this signal look a bit rough? No worries, let's Gaussian-filter it".

A lot of my skepticism is due to ignorance, no doubt, and I'd probably be braver in making general claims from the image I get in the end if I was more educated in the actual biophysics of it. But my main point is that it is not at all obvious that you can simply claim "signal B shows that signal A doesn't correspond to actual brain activity", when it is quite arguable whether signal B really does measure the ground truth, or whether it is simply prone to different modelling errors.

In the paper itself, the authors say that it is limited by methodology, but because they don't have the device to get an independent measure of brain activation, they use quantitative MRI. They also say it's because of radiation exposure and blah blah, but the real reason is their uni can't afford a PET scanner for them to use.

"The gold standard for CBF and CMRO2 measurements is 15O PET; but this technique requires an on-site cyclotron, a sophisticated imaging setup and substantial experience in handling three different radiotracers (CBF, 15O-water; CBV, 15O-CO; OEF, 15O-gas) of short half-lives8,35. Furthermore, this invasive method poses certain risks to participants owing to the exposure to radioactivity and arterial sampling."

freehorse

Most studies in non-clinical populations afaik do not use 150 PET though? Afaik this is mostly used for clinical purposes. Could be wrong though.

kspacewalk2

If you have a PET/MR system [0], you can probably do this "gold standard" comparison, and I know that one is used for research studies. I think you can piggy-back off a different study's healthy controls to write a paper like this, if that study already uses PET/MR and if adding an oxygen metabolite scan isn't a big problem. But that's speaking as someone who does not design experiments.

[0] https://www.siemens-healthineers.com/en-us/magnetic-resonanc...

riazrizvi

The researchers found that “40% of increased fMRI signal correspond to a decrease in neuronal activity”, so it’s even worse than the headline.

mrcrm9494

this headline is a bit misleading on the first read, since it only affects functional (f)MRI, which is controversial since a longer time. a prominent example is the activity that has been detected in a dead salmon

kspacewalk2

It's not that fMRI itself is controversial, it's that it is prone to statistical abuse unless you're careful in how you analyse the data. That's what the dead salmon study showed - some voxels will appear "active" purely by statistical chance, so without correction you will get spurious activations.

giancarlostoro

So, is fMRI like "fast" MRI? Can someone fill the rest of us mortals in on this? :)

jawilson2

f is functional. MRIs are basically huge magnets used for imaging. When you apply a strong magnetic field, different tissue types and densities will react differently, and the MRI is basically measuring how those tissues react to the magnet. It is very good for imaging soft tissues, but not so much bone. Someone figured out that you can measure blood flow using the MRI, because blood cells react in a magnetic field, then "relax" at a known rate. Since we can measure blood flow, that is correlated with increased brain activity, i.e. since more neurons are firing, they require more energy, and therefore more blood. So, fMRI is using blood flow as a proxy for brain activity.

parpfish

Fmri doesn’t measure blood flow, it measures the oxygen level in the blood. Hemoglobin molecules change shape when they carry oxygen and the different shapes react differently to magnets, which is a real stroke of luck

freehorse

Structural MRI does not record brain activity, because it is, like, structural, not functional.

Structural MRI is even more abused, where people find "differences" between 2 groups with ridiculously small sample sizes.

SubiculumCode

The dead salmon was just a lesson in failing to correct for multiple comparisons.

prefrontal

As the first author of the salmon paper, yes, this was exactly our point. fMRI can be an amazing tool, but if you are going to trust the results you need to have proper statistical corrections along the way.

kgarten

wondering why you are downvoted. You are right, though it's kind of inferred that the author means fMRI as the title focuses on brain activity only.

zerof1l

I wonder how much variation there is between a person who does certain mental activity regularly vs a person who rarely does it.

If they were to measure a person who performs mental arithmetic on a daily basis, I'd expect his brain activity and oxygen consumption to be lower than those of a person who never does it. How much difference would that make?

cj

I did a fMRI study as a volunteer in college.

It involved going to the lab and practicing the thing (a puzzle / maze) I would be shown during the actual MRI. I think I went in to “practice” a couple times before showing up and doing it in the machine.

IIRC the purpose of practicing was exactly that, to avoid me trying ti learn something during the scan (since that wasn’t the intention of the study).

In other words, I think you can control for that variable.

(Side note: I absolutely fell asleep during half the scan. Oops! I felt bad, but I guess that’s a risk when you recruit sleep deprived college kids!)

darfo

Can the OP change the HN item title so scrollers don't think there is a problem with MRI? Isn't fMRI being questioned?

antipaul

Biotech industrial complex

fMRI is a cool, expensive tech, like so many others in genetics and other diagnostics. These technologies create good jobs ("doing well by doing good").

But as other comments point out, and practitioners know, their usefulness for patients is more dubious.