(This essay is based on a presentation I gave in the OpenAthens Access Lab series on February 24, 2025, titled “Misinformation, Disinformation, and Trust in Scholarly Communication: Challenges and Strategies.” Part 2 of the post is also available.)
First Things First: Definitions
“Misinformation” is most commonly defined as “false or inaccurate information,” whereas the term “disinformation” is generally used to describe misinformation that is wielded deliberately to mislead. The distinction between the two categories of false information lies in intention, which makes it a bit problematic – to discern the difference we must know not just that the information is false, but also the intent of the person wielding the false information, which sometimes seems easy, but may be more difficult than we think. Furthermore, talking about mis- or disinformation at all requires us to deal with the issue of truth – which seems to make everyone uncomfortable, often including those who wish to act as misinformation watchdogs. For example: last year, here in The Scholarly Kitchen, I interviewed the principals of the American Sunlight Project, an organization dedicated to “protect(ing) American democracy from the threat of disinformation.” One of my interview questions had to do with how the organization would deal with difficult issues in which facts themselves are in dispute – would they remain silent on such issues, or “follow a particular line of strategy in deciding what side to take on the factual question”? They responded that they “have no interest in arbitrating truth,” which strikes me as fundamentally incoherent, not to say disingenuous: if your stated goal is to fight false information, you are absolutely setting yourself up as an arbitrator of truth. To claim to be fighting disinformation while also claiming not to be interested in “arbitrating truth” is like claiming to be a firefighter while also saying you’re not interested in discriminating between buildings that are and are not on fire.
In the past year or so, some have suggested the existence of another category of mis/disinformation: malinformation. This term is used to describe information that is technically true, but is taken out of context or presented in a partial manner so as to mislead.
And I would suggest yet one more example: what I call uninformation and some have called (after George Orwell) memory-holing. This is when information that was once, or should be made public is deliberately hidden or suppressed – not because the information is false, but because those with stewardship over it simply do not wish it to be made public or because they want to hide evidence that it was made public in the past. Governments, media outlets, pressure groups, and political organizations do this all the time, of course; unfortunately, sometimes scholars and researchers do as well, sometimes by publicly asserting that others’ research does not exist, other times by refusing to make their research results public out of fear that the data might prove useful to their ideological opponents, or for any number of other reasons.
For purposes of this discussion, I will use the term “misinformation” generically to refer to all of the above, making finer distinctions where context requires.
Fighting disinformation means assessing truthfulness. To claim to be fighting disinformation without “arbitrating truth” is like claiming to be a firefighter without discriminating between buildings that are and are not on fire.
One other important thing to note at the outset: disinformation is weaponized by definition. People do not intentionally spread false information (or suppress true information) without some kind of malign intent. They may say, and in a few cases actually believe, that they’re committing a small offense against honesty and intellectual integrity in the interest of a greater good, but far more often, I believe it’s safe to assume that deliberate attempts to deceive arise from a desire to do some kind of harm.
Underlying Assumptions
Meaningful discussion of misinformation in scholarly discourse is necessarily built on several important assumptions:
- Truth exists (otherwise there is no coherent definition of “misinformation”)
- Truth is not purely subjective (otherwise there is no coherent definition of “falsehood”)
- It is possible to discern truth from falsehood (otherwise, discussing misinformation is pointless)
I will add two additional assumptions that inform my treatment of this issue, though neither is strictly, logically required for a discussion of disinformation; both of these might be called statements of belief:
- Truth matters in itself, apart from its instrumental value (and regardless of who speaks it)
- Not all truths and falsehoods are equally consequential
If we take the above assumptions as given, then some very important questions follow naturally in the context of scholarly communication: How do we discriminate between the true, the false, and the misleading in science and scholarship? How do we decide which sources to trust – and to what degree should we place implicit trust in any information source? In the context of libraries, how do we balance the need to discriminate between truth and falsehood with the need to present a diverse spectrum of views on contested issues (not to mention the need to provide access to bad or false content for educational purposes)? In the context of publishing, how do we navigate the line between legitimate minority views and faulty scholarship?
These questions are neither simple nor easy.
On the one hand, we understand the importance of trusting science; on the other hand, it has long been obvious (and has recently become more so) that not everything presented to the world as “science” is trustworthy.
On the one hand, a fundamental driver of progress in scholarship is the successful challenging of established conventional wisdom by upstart minority hypotheses; on the other hand, upstart hypotheses are often held by only a minority of scholars or scientists precisely because they’re wrong.
On the one hand, the scholarly communication ecosystem needs gatekeepers to filter out nonsense and – even more dangerous – falsehood that is not obviously nonsense; on the other hand, gatekeepers are human beings with prejudices, ideological commitments, commercial involvements, and other interests that may conflict with their interest in dispassionately assessing the validity of scholarly information.
The obvious key to navigating these difficulties is relevant expertise combined with honest critical thinking and analysis – which are essential not only in discriminating between truth and falsehood, but also in assessing the relative importance of different truths and falsehoods. The problem with critical thinking, of course, is first of all that it is difficult and demanding – and second of all, that when we engage in it in an honest way, it does not always lead us to conclusions that we like or that are convenient for us, either operationally or ideologically. New truths (or old truths that are new to us) might have disruptive implications for our processes and workflows, our understandings of our disciplines, and even our social and political beliefs. The question for every scholar, scientist, librarian, and editor, is: how willing am I to accommodate truth that challenges my prejudices and preferences? Can I assess such information in a way that reflects fealty to actual truth over fealty to my preferred understanding of the world?
Fundamental Mission Differences between Libraries and Publishers
When it comes to misinformation, it is important to recognize a significant difference in mission between libraries and scholarly publishers. For libraries, providing access to both true and false information is fundamental to the mission; for publishers, the filtering out of false information is fundamental to the mission. The former assertion may seem counterintuitive, but upon reflection it should be obvious: A research library can’t support the study of political science without providing access to examples of (for example) misleading wartime propaganda or false claims by politicians; it can’t support inquiry into religious history without collecting a broad range of documents containing mutually contradictory statements about spiritual matters; it can’t support the study of economic history without providing examples of false and disproven economic theories. Research libraries exist not only to provide access to truth, but to support teaching and research, both of which rely not only on access to high quality information from a wide range of viewpoints and perspectives, but also on access to instructive examples of falsehood and dishonesty.
The purpose of a scholarly publisher is different, however. A journal or book publisher seeks to acquire and publish scholarship that is true and reliable, and to filter out that which is false and misleading. (At least this is true of legitimate scholarly publishers; there are deceptive publishers that claim to produce legitimate peer-reviewed scholarship, but will in fact publish anything submitted, scholarly or truthful or not, as long as the author pays a publishing fee. These are not actual scholarly publishers and are not considered in this discussion.) The function of a scholarly publisher is to support teaching and research by providing access to truth, rather than to support them by providing access both to truth and to pedagogically useful falsehood.
Discussion
23 Thoughts on "Misinformation, Disinformation, and Scholarly Communication (Part 1)"
Rick, you assert that “People do not intentionally spread false information (or suppress true information) without some kind of malign intent.” My experience with my Central Asian ethnographic survey on the topic of bacha bazi tells me otherwise. The reports of the native informants consistently refute the presentation of the phenomenon in the Western media. That misinformation can not be the reflection of evil intent. Rather, I believe it is a case of misguided idealism. The road to misinformation hell sometimes IS paved with good intentions.
Hi, Andrew —
I did also acknowledge that people “may say, and in a few cases actually believe, that they’re committing a small offense against honesty and intellectual integrity in the interest of a greater good” — but I would still characterize such offenses as malign. Spreading disinformation isn’t a benign act just because you’re engaging in it to fight something you believe is wrong.
I realize not everyone will agree with me on this, of course.
Rick,
How much value could be found in understanding the strength and type of commitment an author, publisher, speaker, politician, or scholar has to the stated purpose of what is being published (i.e,, the answer to the research question)? I study commitment and you got me thinking! Thank you.
Rick, I understood that distinction, I just do not believe that the suppression of accurate information in this case is a conscious act. Western sources are simply parroting each other, out of enthusiastic do-goodism. If they really understood the reality “on the ground,” who knows how they would react? Of course, I am just guessing. Perhaps they are being militantly idealistic, as you suggest. Hard to know, but nonetheless I think that an “unconsciousness category” is required. Is everyone who argues against the validity of global overheating an ill intentioned person? Some certainly are, but I suspect that most are simply conformist and ignorant. “Ignorance is strength!”
Consciousness or intentionality definitely goes to the distinction between misinformation and disinformation, as those terms are generally used. Unintentionally sharing false information would be the former, whereas intentionally sharing false information (regardless of one’s ultimate motivation for doing so) would be the latter.
“Meaningful discussion of misinformation in scholarly discourse is necessarily built on several important assumptions:
• Truth exists (otherwise there is no coherent definition of “misinformation”)
• Truth is not purely subjective (otherwise there is no coherent definition of “falsehood”)
• It is possible to discern truth from falsehood (otherwise, discussing misinformation is
pointless)”
If I’m reading the statement above accurately, I would contend that the meaningful discussion of misinformation is possible in only limited cases, if at all. I’ll start with one of the most contentious areas today. Any discussion of abortion depends on when human life begins, but the current debates show that any answer is only opinion. No way exists to determine whether a literary scholar’s interpretation of a text is true because once again how can this be determined. Discussion of historical events depends upon documents, accounts, and other evidence that at best can create probabilities. Furthermore, no scholarly discourse could discuss possible futures because the future hasn’t happened. I could give many other examples, but I’ll stop here.
I subscribe to the theory that the best that can be done is to depend upon probabilities and reasonableness. I write a management column where I give advice on how to manage but am careful to say that I’m giving my opinion based upon what I consider to be best practice, but results will vary.
Hi, Bob —
Stay tuned for Part 2, tomorrow! I actually mention the abortion debate in just this context.
Which of these examples is not like the others… I suppose the current debates about climate change show that any answer is only opinion.
I think one can pretty easily separate a clearly defined and measurable scientific concept from an ill-defined article of religious faith that just has to be believed and cannot be empirically measured.
I agree with your statement completely, but truth is a 100% proposition. Reputable scientists on many issues can come to different conclusions. Let’s look back at the discussion about whether sugar or fat was more unhealthy. According to current thought, sugar is the right answer, but fat was chosen earlier in the debate by reputable scientists. The discussion about whether Shakespeare wrote the plays has been around for centuries without any ability to come to a definitive answer that everyone accepts. Contrary to what you say above, many things can’t be empirically measured. Even those that can be empirically measured require interpretation because of the issues of causation versus correlation.
I had this conversation with Rick behind the scenes while the post was being edited, and it was the subject of much conversation at a recent publishing meeting. Scientific “truth” largely means the current conclusion that best fits the available evidence. The mark of a good scientist is one who is willing to change their mind as further evidence accumulates.
Dietary studies are notorious areas of bad data collection — first, so many are funded by food producers with an inherent conflict of interest that one must take great care in interpreting the results. The other big issue is that humans are terrible laboratory specimens and are not reliable narrators of the 14 Twinkies they binged on late one night.
But yes, we agree — some things can’t be empirically measured, and thus you can’t equate something like climate change (a defined concept with empirical evidence) and “when life begins” (a religious concept that is ill-defined and offers no route to measurement). Further, yes, evidence should be interrogated and interpreted, but it also must be done so through good faith approaches that are as objective as possible rather than argumentation from the point of view of which conclusion will result in my making the most money.
And I’ll just add that we need to be careful not to let the existence of questions for which the truth can’t really be established (such as when life begins) lead us to conclude that objective truth either doesn’t exist or can’t be established for any question.
Shakespeare’s authorship is a good example of a question about which objective truth clearly does exist, even though it may be difficult to establish it in light of currently available evidence. Shakespeare either did or did not write Hamlet — to say that “my truth” is that he wrote it, and that “your truth” is that he didn’t would be absurd. But that’s not the same thing as saying that, in light of current evidence, a solid claim can be made that the question has been settled. (Though even if such evidence isn’t known now, that doesn’t mean it won’t emerge later.)
I think it’s also worth noting that when we’re talking about reports of scientific experiments, there are multiple layers of truthfulness at play. We expect scientists to carry out their work honestly and report on their work truthfully. We can (and should) hold them to a very high standard of objective truthfulness in their reports, and would not (and should not) tolerate compromise on that standard in the name of subjectivity. On the other hand, we recognize that in most cases, what any scientific study itself produces is contingent knowledge that is subject to change based on new evidence later — which is not, again, to say that there is no objective truth regarding the scientific question being studied.
Are you really suggesting that biologists cannot empirically determine when a unique genome is formed during sexual reproduction, something that every high school biology student has known since the late 19th century, and that any claim that we can is motivated by… religious faith? That is a rather revealing statement, particularly in this context. I get that you have your ideological commitments, but…
At first I thought I was leading us off-topic, but it seems you’ve actually provided a neat illustration of the phenomena under discussion.
A unique genome is created every time mitosis or meiosis and recombination happens. So life begins when one of my skin cells divides? And “life” and the “soul” are determined by the formation of a unique genome? Please do enlighten us with all the evidence you have collected to demonstrate that.
Thanks for engaging with me on this, David. I find your position fascinating and I’m happy to provide a bit of sport if it helps your readers understand it. Are you claiming that there is no meaningful difference between A) a combination of cells generated by sexual reproduction which, under certain conditions normally accorded by nature in the context of sexual reproduction, will develop into a unique complex organism (i.e. in the case of humans, someone’s daughter or son), and B) skins cells engaging in mitotic recombination?
Not sure why you are bringing soul into it – no one has mentioned souls. Even teleology doesn’t need to come into it. They’re just obviously two different things and it is remarkably obtuse to suggest otherwise.
It’s also interesting that you put “life” in scare quotes, which suggests a novel academic discipline for our brave 21st century – “bio”logy.
This is now the third time you’ve moved the goalposts in this conversation. It began with your initial username “life begins at conception”, then shifted to the “creation of a unique genome” defining life, and now you’ve moved to “a combination of cells generated by sexual reproduction”. I put “life” in quotes because you have yet to offer a coherent, consistent, or measurable definition of the term, nor any rationale for why it is important and should be studied/measured.
By your new definition, prokaryotic organisms are not alive, nor is any organism produced through parthenogenesis. Both fraternal twins are alive, yet only one identical twin is alive as it came about through mitotic division. Pity the poor sextuplets, only one of whom is alive.
Let’s go back to your original argument: “I suppose the current debates about climate change show that any answer is only opinion.” I can offer you a consistent, coherent, and measurable definition of climate change, and why it is meaningful without delving into matters of faith. Can you do the same for whatever it is you’re getting at (taking you at your word that “soul” and teleology have no place in your argument) when you define “life”?
Hi David, thanks for continuing this conversation. You seem to be under the impression that I am trying and failing to define life, but that’s not the case. I’m genuinely curious about this exotic form of (feigned?) ignorance that pretends not to recognize life when it’s politically inconvenient, bringing in absurd comparisons to skin cells and prokaryotic organisms, and treating the very concept of life itself as irrelevant to empirical inquiry.
For the purposes of this discussion I’m happy for you to choose a any biology textbook’s definition. I’ll co-sign it and it won’t change anything.
Would you be willing to answer my question? What would you say is the most meaningful difference between those two cellular structures? I’m interested.
Denying humanity to those who are self-evidently human has a pretty bad track record, David. I respect your work here, so it’s disappointing to see you apparently adopt that position.
I think I’m done with this conversation. This is now the fourth goal post shift, from life begins at conception to life is the creation of a unique genome to life requires sexual reproduction to now something something something “humanity”. Any textbook definition of “life” would indeed include prokaryotes I’m afraid, but I’m sure if I supply one you’ll just change the subject to something else. If you have an empirical way to measure “humanity”, I’m sure it will be revelatory to us all. Feel free to respond, but this will be my last word.
I think the problem may be more complex than this Rick, or at least much less tidy. Our shared sense of reality is built on a great many gradations of truth and distortion, and these gradations mix, evolve, spin off into new information dimensions, and evolve again over years and generations.
Science has been more insulated from these influences, but not immune. Take the Wakefield study on vaccines and autism, for example. This started out as misinformation—a fraudulent paper—but in the 12 years it took to retract, it evolved into malinformation. The vaccine-autism link became ingrained in the public perception and has been extremely difficult to dislodge since (as happens in psychology). Some of the continued propagation of this malinformation has been malign—it has become weaponized disinformation—but a lot of the spread and persistence is just innocent. It isn’t that people don’t trust science or scientists (at least on average, although trust in science is increasingly partisan), but that our information ecosystem is increasingly polluted, making it difficult to discover truth. “Doing your own research” backfires today because the internet contains so much mis- and disinformation that viral truth outranks reality.
So, spreading mis-mal-disinformation like “I heard vaccines cause autism” is just a fact of modern society, neither careless nor malign, but just the way things are today. So too with spreading disinformation. We all have friends and relatives who rely on Fox “News.” They aren’t dumb or evil people; they’re just repeating what Fox tells them about the world, whether it’s “the stock market is fine today,” or “climate change is a hoax,” or “January 6th was a day of peace and love.” So when/if we talk about current events and my MSNBC-informed view of the world is entirely at odds with their Fox-informed view, we are both victims of complete information ecosystem dysmorphia, where truth has become entirely fungible and reality subjective.
How we re-establish our bearings going forward is a question for the ages—good luck with this. But in this quest, it’s also important to distinguish between trusting science and trusting science publishing. One of these things is not like the other. Science has a process for determining truth, while science publishing is still working on their process. These are two different quests with two different solutions. We shouldn’t throw our trust in science under the bus because science publishing is struggling to adapt to the new information multiverse. Providing better gatekeeping, ensuring better peer review, and filtering out the nonsense are all things scientists want from publishers. Libraries and scholarly publishers have a role to play in helping ensure high-quality research findings are published and shared. But these actors aren’t the arbiters of scientific truth. Science is built to pursue truth, and to the extent we can help science succeed, we make the existence of truth—or at least scientific truth—all the more certain.
The meme of the century? “We’re living in a post-truth world, now!”
Rampant individualism has commandeered Opinion – turned it into an online messaging trope – shared it for the dollars and takedowns across the interwebs and so… the entire information landscape is a fairground Hall of Mirrors with nearly everyone angsty-confused about what’s *really* what amidst the distortions.
It’s all rather exhausting.
It IS exhausting, and not credible. And what is also incredible is that with the wealth of accurate information that IS out there, so many can be so easily misled. It is not their fault. We, as a society, have failed them academically. Is this the cycle of all opulent societies?