A little fMRI knowledge can be a dangerous thing
Wednesday, December 17th, 2008
I intend to get back into writing for this blog again now that I’ve completed my diploma. But before that I’d like to present this piece by one of the intelligent, thoughtful people I befriended during the past year. So here’s Jack White with a few cautions regarding our use and understanding of fMRI research findings.
-Mark
***
Show someone a brain scan and there’s a better chance they will accept accompanying scientific evidence that contains faulty logic and flawed reasoning. A study published in Cognition shows the persuasive value of brain scans that use functional magnetic resonance imaging (fMRI), or at least their ability to switch off critical thought. Interestingly, this effect may not be limited to members of the lay public. Researchers from Yale University showed that neuroscience students were more satisfied with descriptions of psychological phenomena if neuroscientific explanations were included. But the neuroscience did not contribute any real evidence to the findings being reported – it was “scientific-sounding but empirically and conceptually uninformative” information – in other words, bunk.
When used to explain cognitive phenomena, the seductive allure of fMRI and its appeal to scientific legitimacy tend to obscure its very real limitations. Its capacity to observe the neural correlates of mental constructs, such as learning and emotion, is often misrepresented by an overenthusiastic news media. A Stanford study into media coverage on fMRI over a 13-year period found that a significant majority did not explain the capabilities and limitations of the technology. Most coverage was optimistic in tone, rather than balanced or critical, presenting fMRI as a modern cartographer of the mind.
While the popular press has never been associated with ideals of scientific rigour, its treatment of fMRI and cognitive neuroscience is an illuminating example of the interplay between science and public interest. The perception that fMRI can provide hard evidence to soft topics places a premium on stories that can cite neuropsychological measures to back up reported findings. While newspapers and popular magazines are not the right forum for in-depth discussions of specialised areas of scientific knowledge, the superficial nature of reporting on neuroscience can be problematic. Readers may be excused for adopting a philosophy of “neuroessentialism”, what the Stanford study defines as the tendency to equate subjectivity and personal identity with mechanisms of the brain. Headlines that trumpet the latest findings into the psychology of schoolyard bullies or psychopathic prison inmates often outline the fMRI evidence used to justify the researchers’ claims, without delving into the assumptions behind such work or its implications.
Dangers associated with trusting our sources are not limited to the responsible reporting of research findings in the mainstream press. As cognitive neuroscience seeks out correlations between mental phenomena and biological patterns, it’s tempting to overextend the significance of fMRI results. Despite the impression gleaned from reading some journal articles, the efficacy of neuroimaging to investigate higher-order cognitive processes is currently the subject of vigorous debate. On the technical side of things, Nikos Logothetis and Russell Poldrack both provide succinct overviews of what we can and cannot infer from fMRI data. Some pertinent items are summarised as following:
- Indirect measures: Standard fMRI scanning uses the blood-oxygen-level dependent or BOLD method, which measures increases in oxygenated blood flow to areas of brain tissue. Although they are highly correlated, the BOLD signal is an indirect measure of neural activity and the exact relationship between the two is unknown.
- Limited visibility: Neurons are densely packed and can fire hundreds of impulses per second. Current fMRI scanning methods are limited in spatial resolution to volume elements of tissue that, while remaining small in size, contain millions of neurons and tens of millions of interconnections. These limitations can be partially overcome by single electrode research on animals and new statistical methods, but not all research is taking advantage of these methods.
- Ambiguous baselines: Cognitive experiments rely on baseline measures of the participant’s metabolic activity while at rest, which are then subtracted from scans of the BOLD signal taken while the task in question is being performed. The fMRI signal therefore indicates a differential measure of brain metabolism – not raw quantity. It is assumed that the subtraction method isolates the metabolic activity related to the experimental task. This neglects the fact that the brain is metabolically active even at rest. If cognitive functions are distributed across areas of the brain that are active in both conditions, then the subtraction process renders the overall picture incomplete and inaccurate.
- Emergent processes: Rather than mapping onto the brain in a one-to-one fashion, cognitive functions are distributed across the brain and operate interdependently. For example, the process of visual word recognition involves perception, attention, lexical search processes and semantic classification. Each of these functions exhibit patterns of brain activity that are mutually intertwined and impossible to deduce from fMRI signals alone.
Poldrack also outlines the inherent problem of reverse inference that so often typifies fMRI work into cognitive neuroscience. This occurs when neuroimaging evidence is used to infer the workings of specific cognitive functions, such as memory recall or word learning. Not only is this a logical fallacy, Poldrack argues, it reflects the tendency for scientists to adopt a “strongly modular approach to structure-function relationships” in the brain, one that is not borne out by data. He opines that
this facile leap to localizationist conclusions [is derived] from lesion and neuroimaging results. Despite the longstanding appreciation for the importance of functional integration within the neuroimaging literature, the widespread use of functional and effective connectivity analyses has not yet come about. Given that many cognitive processes may be distinguished not by activity in specific regions but by patterns of activity across regions, there is reason for caution regarding many of the inferences that have been driven by highly modular approaches.
While the debate rages on, the nexus between public interest and scientific discourse provides an interesting vantage point to observe attitudes and approaches to fMRI. One can only expect that more knowledge about the limitations involved with its use will instruct rather than deter, given the steady encroachment of neuroscience into applied fields of public policy, law, and economics.
Related links:
- Brain imaging: a decade of coverage in the media - Science Communication
- The role of fMRI in cognitive neuroscience: where do we stand? - Current Opinion in Neurobiology
- Seeing is believing - Cognition
- Seductive allure of neuroscience explanations - Journal of Cognitive Neuroscience
- The fMRI smackdown cometh - Mind Hacks
- Fake method for research impartiality (fMRI) - The Scientist
If you're new here, you may want to subscribe to my RSS feed. Thanks for visiting!

