Are you confused, because you attended a lecture reading out the myths from the original 1940s version? Welcome to this very important update.
The old 1940s version of autism has turned out to be based on very poor evidence, and deserves a decent burial.
What’s it like, trying to grow up in a world that wants to see you as a fault, because that’s what two men said, 80 years ago, after looking at a handful of mostly male, white children with profound support needs?
So, how on earth have we ended up with this many myths continuing painfully from one decade to the next?
I’m afraid the answer is that too much of the training has been stuck in the 1940s. Too much is done by non-autistic people, often ones who happen to know an autistic person in some way (maybe a relative) but seemingly have never asked them about life. I mean ‘asked’ in any communication sense, not just speech. Over a million autistic people in the UK, and too often, such trainers have none of them as personal friends, none of them as colleagues. Isn’t that odd?
Such trainers pass on the ancient myths, generation after generation. They write them down, put them on Powerpoint presentations, and deliver them to you as if they are fact. Research based in part on materials from the 1990s and 1980s, which was based largely on watching groups of profoundly disabled young men in a care home, as far back as the 1940s. As far removed from a balanced view of autism as one can get, in fact.
Worse still, they often expect you to pay for this. It might look slick, with excellent graphics, and the trainer might look like they could pose for a fashion magazine . But…are you really wanting 1940s material?
And if it turns out that, contrary to widespread assumptions, behavior modification techniques aren’t supported by solid data even when used with autistic kids, why would we persist in manipulating anyone with positive reinforcement? A rigorous new meta-analysis utterly debunks the claim that applied behavior analysis (ABA) therapy is the only intervention for children with autism that’s “evidence-based.” In fact, it raises serious questions about whether ABA merits that description at all.
You might assume that those who use the phrase “evidence-based practice” (EBP) are offering a testable claim, asserting that the practices in question are supported by good data. In reality, the phrase is more of an all-purpose honorific, wielded to silence dissent, intimidate critics, and imply that anyone who criticizes what they’re doing is rejecting science itself. It’s reminiscent of the way a religious leader might declare that what we’ve been told to do is “God’s will”: End of discussion.
Moreover – and it took me awhile to catch on to this – behaviorists often use “EBP” just as a shorthand for the practices they like, in contrast to the (progressive or humanistic) approaches they revile. It doesn’t matter if the evidence is actually weak or ambiguous or even if it points in the other direction. They’ll always come up with some reason to dismiss those inconvenient findings because their method is “evidence-based” by definition. (On social media and elsewhere, you can get a glimpse of how modern behaviorism resembles a religious cult – closer to Scientology than to science – with adherents circling the wagons, trading ad hominem attacks on their critics, and testing out defensive strategies to employ when, for example, people with autism speak out about how ABA has harmed them. Or when scholarship shows just how weak the empirical case for ABA really is.)
Which brings us back to that new research review. The work of eleven authors – including, interestingly, an ABA therapist – representing the University of Texas, Boston College, Vanderbilt, and Mount Holyoke, it was published in January 2020 in Psychological Bulletin (PB), a prestigious social science journal that specializes in lengthy integrative research reviews. The article is not a polemic. It does not consider, and appears not even to be informed by, any of the broader objections to ABA that are raised by autistic people or that I’ve raised here. It confines itself to describing peer-reviewed research. The authors cast a wide net, looking for every English-language study in the last half-century that compared an intervention group with a control group in treating children up to age 8 who had been diagnosed with Autism Spectrum Disorder. This yielded 1,615 separate results from 150 reports representing 6,240 participants.
The most striking finding in this research review is how few high-quality assessments of “the primary approach used in clinical practice” – that is, ABA – have ever been conducted. In fact, the great majority of ABA studies were so poorly designed that they didn’t merit inclusion in this review. Rather than comparing the results of different treatments for groups of children, behaviorist journals commonly publish single-subject studies, in which one child is assessed before and after treatment. (This method was invented by behaviorists back when their behavior-shaping efforts were limited to lab rats.) You don’t have to be a trained data analyst to see the serious limitations of this method in terms of the results’ lack of generalizability. For the authors of the PB review, these limitations were so glaring that it didn’t even make sense for them to bother with the results of single-subject studies. Yet those dubious results are the primary basis for behaviorists’ claims that ABA is “evidence-based.”
I think we’re just going to have to let the term “evidence-based” go. There seems to be an inverse relationship between the extent to which a practice is described as evidence-based, and the quality of evidence supporting its use.
This is a snip from the paper which talks about the horrifying things done to autistic children and young people, without ever once checking whether it’s actually done harm. Yes, now, 2021.
Yes, ‘therapies’ paid for with public money. Goodness me.
In choosing to believe that ‘success’ looks like a silent, still autistic child, the teams gave themselves no chance at all to assess for harm. Or to even realise that such a situation is, or could be, harmful for a child with different neurology & very real needs & emotions.
In choosing to believe that 'success' looks like a silent, still autistic child, the teams gave themselves no chance at all to assess for harm. Or to even realise that such a situation is, or could be, harmful for a child with different neurology & very real needs & emotions/
— Ann Memmott PgC MA 🌈 (She/They) (@AnnMemmott) July 28, 2021
"Structural dehumanisation is the failure to measure harm in intervention studies." @DrMBotha#INSAR2022
— Kelly L. Coburn (they/them) (@KCoburnSLP) May 14, 2022
"We must recognize, understand, take responsibility for, and reduce the unacceptable biases that have led to autistics being considered unharmable, such that anything can be done to them". Exactly this. And goodness me, we see that cruel thinking in so many setting now.
— Ann Memmott PgC MA 🌈 (She/They) (@AnnMemmott) June 26, 2022
Attention to adverse outcomes was absent in almost all studies and inadequate in the remaining few: 139 (93%) did not even mention or allude to this possibility, 11 (7%) had cursory statements, and none indicated that adverse events were monitored, much less how. Scrutiny of the poorly reported reasons for participant withdrawal and of effect sizes for reported outcomes yielded evidence that harms had occurred, yet were never interpreted as such.
Bottema-Beutel et al. follow Rodgers et al. (2020), whose systematic review of early intensive applied behavior analysis (ABA)-based autism interventions also found a pervasive failure to consider harms. Nowhere in this highly influential literature was there any reported effort to monitor or collect data on adverse outcomes. Study protocols, where plans to assess adverse events should prospectively be specified, were unavailable. Reported long-term outcomes, crucial for understanding harms, were lacking for early autism interventions claimed to have lifelong effects. What harms there may have been across any timescale thus could not be determined. Instead, Rodgers et al. found poor quality studies at high risk of bias, leaving ignored ergo unknown harms balanced against uncertain and inconclusive evidence for benefits. Such “preventable uninformativeness” due to poor standards in intervention research has been flagged as a violation of research ethics, entailing de facto harms for study participants and the studied population (Zarin et al., 2019). In this way, the widespread promotion of early intensive autism interventions, based on the biased deployment of a literature uninformative about their benefits versus harms, has been and continues to be inherently harmful to autistics.
Failures in addressing harms have proliferated across autism research, Bottema-Beutel et al. suggest, for reasons such as the embrace of low standard by journals, and the omnipresence of unchecked conflicts of interest (Bottema-Beutel et al., 2020b). Disregard of harms has in turn wrongly been interpreted as evidence of no harms, with consequences rippling out to other areas (e.g. early detection and screening), distorting research and practice. Despite a large literature spanning decades, accumulated knowledge about potential or actual harms to autistics from interventions that may occupy many of their waking hours, for years, is negligible. The foundations for adequate systems or methods for monitoring harms beyond the scope of intervention studies are thus lacking. Indeed, conflicts of interest entangled with low standards in research and practice would undermine future efforts to accurately capture harms via routinely collected data. Nothing justifies these multiple failures on the part of autism researchers.
We welcome the attention to harms shown by Bottema-Beutel et al. and Rodgers et al., as well as by Benevides et al. (2020), who include, among their top 5 autism research priorities, a question about the harms of behavioral and other interventions. But this attention is as rare as it is terribly overdue. We are left with an influential literature lacking fair tests of the benefits versus harms of autism interventions that have been widely implemented for decades. Autism researchers should be deeply troubled by this comprehensive failure to apply fundamental standards. We must recognize, understand, take responsibility for, and reduce the unacceptable biases that have led to autistics being considered unharmable, such that anything can be done to them.
Why is autism research such a harm factory? In large part because private equity and big autism charities distort everything.
This study is the first systematic investigation into COIs in autism early intervention research. We found that COIs exist in a majority of studies, but are widely unreported.
Via Ann Memmott, who breaks it down better than we ever could in this Twitter thread:
This is such an important piece of research by @autismcrisis@SueReviews I want to put some of its findings on this thread. How most autism researchers, in the studies here, haven’t even thought about whether they’re damaging the children & young people/
@KristenBott & team investigated this in 150 bits of research. 139 (93%) did not even mention harms as a possibility, 11 (7%) had vague summaries, & none wrote that possible harm was even monitored/
Rodgers & team looked at ABA (applied behavior analysis research. Nowhere in this highly influential literature was there any reported effort to monitor or collect data on possible harm to the children. None at all. Nothing./
These poor standards in research has been flagged as a violation of research ethics. Promotion of “early intensive” interventions (EIBI) when clueless about possible harms, “…has been and continues to be inherently harmful to autistics”/
This is a snip from the paper which talks about the horrifying things done to autistic children and young people, without ever once checking whether it’s actually done harm. Yes, now, 2021. Yes, ‘therapies’ paid for with public money. Goodness me/
In choosing to believe that ‘success’ looks like a silent, still autistic child, the teams gave themselves no chance at all to assess for harm. Or to even realise that such a situation is, or could be, harmful for a child with different neurology & very real needs & emotions/
“Nothing justifies these multiple failures on the part of autism researchers”.
I agree entirely.
Not a career path. Not a pretty award. Not cash in the bank.
These are children whose lives have been treated as an cost-free experiment, & the damage could be lifelong.
What I find particularly shocking is that I read so many papers that have the gall to write “Yeah, we complied with Ethics and the Helsinki stuff, honest gov”. Like hell they did. Didn’t even think about it from start to finish.
An industry backed by a couple of rogue charity leaders who threaten researchers with, “You’ll never work again unless you do exactly as you’re told”. Where the end result is whatever the ‘stakeholders’ want delivered (including those profiting from this misery)
“We must recognize, understand, take responsibility for, and reduce the unacceptable biases that have led to autistics being considered unharmable, such that anything can be done to them.”
Ethics is a vital part of research. It is about ensuring we do no harm to those we serve.
As researchers, teams are there to serve the autistic communities. Not to hurt and insult them.
Autistic people are not there to serve researchers as a convenient sample or a way to advance their careers.
I’m part of these communities. As a proud parent of a fantastic autistic son. As an autistic person myself. As a researcher. As a consultant and lecturer in this field, including to the NHS in various roles.
I am so sad to see some research teams behaving in these frankly callous ways. I wish the example above was rare. It is not.
Every day, for me, it is such an honour to do what I can to uphold the lovely autistic people I am delighted to share life with. My family, my friends, my colleagues, the general autistic public on social media. Their honesty, integrity, determination, courage and friendship are worth more than words can say.
We are not “ASD cases”.
We are your friends. We are your research colleagues. We are your neighbours. We are your fellow NHS workers. We are artists, and musicians. We are faith leaders and authors. We are parents and grandparents, brothers and sisters.
We are worth every bit as much as every other human on this planet. Our way of interacting, our emerging cultures and ways of being, are worth their place.
Those that need support have been asking for things that actually matter to us. There is more research than you could shake a journal at, on this subject. Instead, we get paper after paper describing us like we’re some form of disease to be eradicated.
I won’t despair of research, as I see so many good people emerging. People who put us front and centre of research into our own lives. People who treat us as valued colleagues. As equals, not as laboratory specimens. People who are our allies. People who are autistic and working at the top levels of new thinking, new theories, new understandings. I am honoured to work with several such teams.
I would very much like some researchers to stop hiding behind one another, and behind dehumanising words. To have the courage to re-evaluate their thinking and their beliefs. To have the curiosity to read those new narratives, to meet autistic teams and really collaborate, really understand.
If you cannot gaze upon us and see our worth, our love, our caring, our whole humanity, this is not the field you should be in.
This is our future. Our lives. Our present. Our history. Our community.
You are not called to erase us, as researchers.
You are called to earn our trust, and share in our future, with love.
Are You Qualified?: Don’t Confuse Your Lecture with Our Life Experience
This is one of the heartbreaks about being autistic. We tend to love certainty and support science. Yet, we constantly face scientific and medical professionals whose credentials we want to trust but whose information has been greatly misinformed. It’s a systemic problem.
Doctor: Don’t confuse your Google search with my 6y at medical school.
Patient: Don’t confuse the 1-hour lecture you had on my condition with my 20y of living with it.
This is one of the heartbreaks about being autistic. We tend to love certainty and support science. Yet, we constantly face scientific and medical professionals whose credentials we want to trust but whose information has been greatly misinformed. It’s a systemic problem.
An example of how crucial Autistic insights can be, because when it comes to #Autistic kids, too often “the people society says are the most qualified to help are the people least equipped to understand.” From the #TPGA archives:https://t.co/v9B363mAHz#neurodiversity
— thinkingautism.bsky.social (@thinkingautism) October 3, 2018
The people society says are the most qualified to help are the people least equipped to understand.
It takes some mental acrobatics to be an intellectual racist in light of the scientific information we have today, but those who want to do it, will. Racists will find validation wherever they can, even if it means working a little harder than usual. And this is the reason that good scientists who do reliable research, ones who are also well-intentioned and antiracist, like Cavalli-Sforza, can’t afford to be cavalier or leave too much room for misinterpretation. There’s an uncertain space between recognizing that there is a gap of knowledge and actually filling that gap. It’s a place where speculation thrives, where the racists reside. Racists adopted the same concepts as good scientists—and the same language as antiracists—to assert that, if certain groups can show some average differences to other groups then, by that logic, certain groups might be better on average than others at certain things. When Steve Sailer and his followers talk about “human biodiversity,” this is what they mean. This wolf in sheep’s clothing is twenty-first-century scientific racism.
And we were told this might happen. A caustic report on the Human Genome Diversity Project released in 1995 by UNESCO’s International Bioethics Committee sounded precisely this warning. It argued that the project, whether it meant to or not, could give racists some basis to believe that certain groups were inferior or superior to others. In particular, the committee was concerned that by bringing genetics to the fore in telling the human story, people would ignore culture and history, and return to the kind of simplistic biological thinking that propelled the eugenics movement in the early twentieth century. It advised scientists to resist the temptation to use their work to shore up any kind of political ideology, whether racist or antiracist. “Racism,” it reminded them in case they had forgotten, is “socially and politically constructed.”
Six years ago, I began investigating how genetics research gets appropriated and integrated into white supremacist ideologies. (1/n)
As many of you know, the Buffalo shooter’s screed explicitly invoked genetics research papers, and the scientific community has loudly been grappling with the implications…What do we do about it? Who's to blame? What qualifies as “censorship?”
In light of these conversations, it’s clear to me that many scientists are completely oblivious to the ecosystem that fostered the shooter’s embrace of these research papers, so I hope to provide some foundational information to guide ongoing discussions.
The shooter’s document follows an all-too-familiar playbook for extremist appropriation of genetics research that I’ve been yelling about since 2016, and I think these can be distilled into 4 primary features that the scientific community should keep in mind.
First is the existence of extremist “journal clubs.” These groups pop up like weeds on the far-right’s preferred social media platforms, and essentially function as crowdsourced bibliographies.
Take, for example, a Telegram channel called “Iron Mirror”—this channel operated for 2+ years as “an online Library on Society, Economy, Psychology as well as Genetics,” and curated hundreds of papers deemed to be supportive of far-right ideology.
This channel was deeply embedded in the network of far-right extremist channels–one particularly notorious channel (that openly promotes violence and has been linked to various Atomwaffen Division offshoots) described Iron Mirror as a “sister channel.”
(apropos of nothing, the creator of the Iron Mirror channel now appears to be a PhD student at Texas Tech, and has recently published several papers under the umbrella of race science).
Virtually all far-right bibliographies follow a similar structure—community members with a strong interest (and/or training) in science scour the literature for papers and dump them into the laps of peers, acting as the “intellectual vanguard” of ethnonationalist networks.
The Buffalo shooter’s screed is unique because it’s the first I’m aware of that has included links to the primary scientific literature, almost a carbon copy of what you’d see in one of these “journal clubs.”
This should alarm you! The rhetoric about genetics in spree shooter screeds has morphed from colloquial “beliefs-stated-as-facts” (e.g., what you’d see in the words of Breivik/Roof/Tarrant) into direct references to scientific results.
Violence directly linked to misappropriation of research is no longer a hypothetical—it’s an actualized harm that should factor into every decision made by IRBs, funders, and journal editors.
It’s unlikely that the Buffalo shooter was deeply engaged with any of the papers he cited…consequently, any supplementary materials or FAQs or authors’ tweets asserting that they reject any racist implications are entirely irrelevant to the act of misappropriation.
What matters is that the papers had a single feature or two that could be construed as supportive of his ideology…a catchy title, a coauthor deemed to be ideologically aligned, or a figure taken out of context are all common conduits for appropriation.
If you insist on an action item, here’s what I’d suggest: familiarize yourself with how papers are appropriated in this way and conduct your research conscientiously assuming there’s a chance it will receive a stamp of approval from a hateful terrorist.
Second is the “meme-ification” of figures from scientific research papers/posters, which I’ve tweeted about extensively—basically, PCA/STRUCTURE plots often get pulled out of context and re-annotated to amplify perceived racial differences
Folks like @lpachter have commented on the shooter’s specific usage of such figures, and with some careful googling, you can roughly trace a figure’s trajectory from the ivory tower into extremist communities
Understanding how our modes of visual communication are (mis)interpreted is essential scientific praxis, and improving established paradigms can be extraordinarily difficult…I encourage everyone to read this vitally important paper on the topic:
Third is the overwhelming enthusiasm for research on the genetics of cognitive and behavioral traits. In 2020, we published a paper that systematically quantified the “white nationalist sector” of Twitter audiences engaging with bioRxiv preprints.
We found over 10% of preprints had detectable white nationalist audience sectors, mostly concentrated on topics of intelligence, cognitive/neurological function, and behavior. In some cases, over half of the Twitter audience was aligned with far-right ideology.
The paper with the largest white nationalist audience sector (65%!!!) we analyzed was a GWAS meta-analysis for intelligence (published in Nature Genetics a month before EA3).
I don’t know what to say, other than “what did you expect?” Scholars have been criticizing the IQ research to far-right pipeline for 50+ years, and things have arguably gotten much worse, exacerbated by social media and increasing political polarization
If scientists aren’t even the loudest voice in the room discussing their own research, this is a massive, massive problem. If you study socially sensitive topics, defend your work!
Everyone’s claws come out to defend against critics, but do you also defend against those who have a warped appreciation of your research? I hate to break it to everyone, but a project doesn't just stop being worthy of your stewardship once it's published.
Finally, earlier this year, @Kelley__Harris and I published a paper about the scientometrics of Richard Lewontin’s classic 1972 paper, “The Apportionment of Human Diversity.”
We conclude with an anecdote describing how the originator of “The Great Replacement” theory specifically attributes Lewontin to be the architect of an “anti-racist dogma” that put into motion the “eradication” of the white race.
We debated mentioning the connection between TGR and past mass shootings in El Paso and Pittsburgh…was it really relevant? Were we overstating our concern that genetics research is prone to being swept up in violent ideologies?
It didn’t even take a month to get our answer, in the form of another horrific tragedy followed by the same string of tired excuses of a broken society that’s already bracing for the next headline.
Six years ago, I began investigating how genetics research gets appropriated and integrated into white supremacist ideologies. (1/n)
As many of you know, the Buffalo shooter’s screed explicitly invoked genetics research papers, and the scientific community has loudly been grappling with the implications…What do we do about it? Who's to blame? What qualifies as “censorship?”
The shooter’s document follows an all-too-familiar playbook for extremist appropriation of genetics research that I’ve been yelling about since 2016, and I think these can be distilled into 4 primary features that the scientific community should keep in mind.
Violence directly linked to misappropriation of research is no longer a hypothetical—it’s an actualized harm that should factor into every decision made by IRBs, funders, and journal editors.
We found over 10% of preprints had detectable white nationalist audience sectors, mostly concentrated on topics of intelligence, cognitive/neurological function, and behavior. In some cases, over half of the Twitter audience was aligned with far-right ideology.
I don’t know what to say, other than “what did you expect?” Scholars have been criticizing the IQ research to far-right pipeline for 50+ years, and things have arguably gotten much worse, exacerbated by social media and increasing political polarizationhttps://t.co/HLthVd9fY1
Mainly what happened is that the credibility of science was stolen to bolster rationalizing prior bigotries. They instead learned that bastardized evolutionary theories could be weaponized to justify all kinds of abuses. From my perspective, though, the deepest of the rifts was the emerging anti-feminist wing and the active neglect of social justice issues. I realized it’s destination was where it is now: a shambles of alt-right memes and dishonest hucksters mangling science to promote racism, sexism, and bloody regressive politics.
