Editors’ Note: Today’s post is by Julia Romano. Julia is a Licensed Professional Counselor in private practice in West Virginia, with graduate training in clinical psychology and yoga therapy. 

I am not a paper mill. I am a Licensed Professional Counselor in private practice in West Virginia, with graduate training in clinical psychology and yoga therapy, three master’s degrees, and a book on postpartum healing published by Singing Dragon in 2024. I see patients every week. I am also, by the standards increasingly being applied across scholarly publishing infrastructure, no one in particular. I have no current institutional affiliation. I have no prior peer-reviewed publications in psychology. When a preprint server’s moderation system runs a database check on my name, it finds nothing. If that search is a gateway to publication, then that gate is closed to me.

My goal in writing this is to share something important with the people who are building these systems. This is what the gate sounds like from the other side — especially right now, as the field moves toward stronger researcher identity verification in response to real and serious fraud. Tim Lloyd’s recent post in this space laid out the case clearly: editorial platforms were designed for trust, not verification, and the rise of paper mills and generative AI has made that trust exploitable at scale. He is right; the fraud problem is real. But Lloyd also named the risk on the other side of the ledger: “we risk replacing an integrity problem with an exclusion problem.”

I am one version of the exclusion problem. It’s likely there are others who do not write essays about it. They feel dejected and powerless — or maybe they just don’t know that The Scholarly Kitchen exists, and that the policies shaping their professional lives are being debated here.

Picket Fence

What Happened

Last month I submitted a paper to PsyArXiv — a postpartum screening instrument I have spent several years developing, grounded in a literature review of the existing tools and their gaps. I am not going to re-litigate the paper’s content here, because the content turned out to be beside the point. The moderator rejected the submission without engaging with the work at all. The decision read, in part:

“For submissions in this format, we need to look at the author’s expertise via past publications… As we found no record of previous relevant peer-reviewed publications by the author(s) in a brief search, we cannot accept the work into the repository. This moderation decision is final.”

I understand the need this policy is meeting. Preprint servers operate at volume, with limited moderator time, against a rising tide of fraudulent and AI-generated submissions. A quick check of an author’s publication record is cheap, and it is likely mostly correct: most bad-faith submissions come from identities with no legitimate research history. The past-publication-as-gate policy catches them.

The danger with this particular filter is that it does not distinguish between a paper mill and a practitioner-researcher who has spent years building a clinical tool and simply has not yet entered the publication pipeline. The filter treats both of us identically, because the filter is not evaluating work. It is evaluating pedigree. With a legitimate contribution to share, I stood on the wrong side of that filter. It wasn’t that I was evaluated and found wanting — the substance of my submission wasn’t evaluated at all.

The Unaffiliated Researcher in an Era of Identity Verification

Lloyd’s post describes a world in which scholarly publishing is moving toward stronger mechanisms for confirming that the people submitting research are who they say they are. Validated institutional emails, federated authentication, organizational affiliation checks, publication history as a trust marker — these are reasonable tools for catching fraudulent work flooding editorial workflows at industrial scale.

But each of these tools carries an assumption about what a legitimate researcher looks like, and the assumption is not neutral. A legitimate researcher, in this emerging framework, has an institutional email address, a recognized organizational affiliation, and a publication history verifiable through ORCID or a similar system. They exist, in other words, inside a structure that can vouch for them.

I do not have an institutional email address. I am not currently affiliated with a university — I purposefully stepped out of that realm in order to investigate my field through a different lens. As a first-time contributor to scholarly literature, my publication history is nonexistent by database standards; the clinical experience and intellectual work behind the submission are not. I am a practitioner who built a tool because the existing tools were failing the people I serve, and I tried to put it somewhere clinicians could find it. By every emerging standard of researcher identity verification, I am indistinguishable from noise.

Lloyd acknowledges this risk. He writes that verification systems must offer multiple routes to trust, and that early-career, unaffiliated, and technically limited researchers need equivalent pathways. My case underscores how urgent that qualifier is, because the direction of travel right now is toward systems that will make my experience at PsyArXiv not an aberration, but the default. If publication history becomes a trust marker, then people without publication history or institutional affiliation are by definition untrusted, regardless of their credentials, clinical experience, or the quality of the work they are trying to contribute.

The fraud these systems are designed to catch is real — and the exclusion they produce is also real, and it is not random. It clusters around practitioners rather than academics, clinicians rather than researchers, people whose training crosses disciplinary boundaries, and independent scholars working outside the university system. These are not the populations producing fraudulent research. They are the populations most likely to see what institutional insiders cannot, precisely because they are working at the edges of the field rather than at its center.

A Different Gate

After the PsyArXiv rejection, I submitted the same paper to SocArXiv, the social sciences preprint server that shares PsyArXiv’s OSF infrastructure. SocArXiv accepted it. The paper now has a citable home, and the practical problem is solved.

I raise this not as vindication, but as evidence that the gate is a choice. Two preprint servers on the same platform made different decisions about what to evaluate at the point of entry. One checked my publication record and stopped there. The other evaluated whether the submission was recognizably scholarly and appropriate to the repository. Both are trying to filter out noise. They produce different outcomes for the same submission, and the difference is not inevitable.

This matters because it shows that the tradeoff between integrity and inclusion is not fixed. It is possible to build systems that take fraud seriously without defaulting to pedigree as the primary filter. SocArXiv is a functioning example of a server that does just this.

What the Field Loses

The cost of the current approach is invisible by design, because the people it excludes are the people the system never sees. When a practitioner-researcher submits a paper and is rejected on credentialing grounds without the work being read, that rejection does not appear in any dataset, or generate a retraction or a correction. It does not register as a problem the system needs to solve, because the system was built to produce exactly this outcome. The work simply does not enter the literature, and the field continues without knowing what it missed.

I am not suggesting that practitioner-researchers should be exempt from scrutiny, rather that the people who design these systems should take seriously the possibility that a fraud-prevention infrastructure built entirely around institutional markers of legitimacy will, as a predictable and systematic byproduct, exclude the independent and cross-disciplinary voices the academy most needs. Not because those voices are always right — being right has never been a precondition to publication. But a field that can only hear from people already inside has limited its own capacity to see what it is missing.

The solutions to fraud being built right now need to be tested not only against the question of whether they catch bad actors — but also whether they catch the practitioner in West Virginia sharing a novel screening tool. If the system can’t tell the difference between those two cases, it’s solving for a different problem — who belongs — and calling it quality control.

Author’s note: This essay was drafted with the assistance of Claude, Anthropic’s AI. The argument, clinical experience, and professional judgment are mine; the drafting process was collaborative. This piece is also under peer review at the Journal of Reproductive and Infant Psychology and available as a preprint on SocArXiv (https://doi.org/10.31235/osf.io/bse4j_v3).

Julia Romano

Julia Romano, MA, MS, LPC-P, is a licensed professional counselor in private practice in West Virginia, where she specializes in postpartum care within an integrative, whole-person framework. She holds graduate training in yoga therapy (MS, Notre Dame of Maryland University's School of Integrative Health) and clinical psychology (MA, Chicago School of Professional Psychology), and a Master of Arts in International Relations (Johns Hopkins SAIS). Julia is the founder of Developing Awareness Therapy (www.developingawarenesstherapy.com) and the author of Yoga Therapy for the Whole Mother: Developing Awareness in Service of Postpartum Healing (Singing Dragon, 2024), grounded in in-depth interviews with fifty postpartum women. She is the developer of the Comprehensive Postpartum Assessment Index (CPAI), a free, open-source, 44-item whole-person postpartum screening instrument currently available as a preprint on SocArXiv (https://doi.org/10.31235/osf.io/bse4j_v3). She writes about yoga therapy, embodiment, and parenting at www.juliaromano.substack.com.

Discussion

4 Thoughts on "Guest Post — The Guild and the Gap: What One Rejection Revealed About the Cost of Credentialism"

Thanks for contributing your experience, Julia. Stories are a powerful and engaging way to turn statistics into issues that we can relate to, understand, and design for, and your post does a great job of showing what exclusion looks like in practice. And, as you note, it’s an absolutely solvable problem as long as we pay attention to the workflows we build.

I think I was the moderator who accepted the paper at SocArXiv; it certainly sounds familiar. So let me give you more context. First, I actually do check credentials as well as skim a paper. I give much more scrutiny to someone with no prior record and sketchy identity credentials than I do to a well-established academic. Second, I do skim over the paper, but it is impossible to actually read all the submissions. I moderate one day a week and in a typical half-day shift I “review” 40 papers. So I am looking for cues in a fast skim that it is “real research” rather than AI slop. I quickly reject lots of things as “not a contribution to social science research” based on other other cues. Submitting authors are often angry at these human-generated decisions based on content. Third, it takes actual human labor to even skim a paper and I am growing increasingly hostile to people spewing out AI-generated text and expecting human beings to treat it respectfully. I very quickly reject submissions from “unknown persons” that are entirely typological or only literature reviews or have other the markers of AI-generated text. I slow down and take more time with pieces that appear to be reporting real research. But then I (human being whose time is precious, at least to me) have to read more carefully to distinguish AI-generated fake research from what appears to be true research. Fifth, we do sometimes reject what appears to be AI slop from people with academic credentials and established records. Those people get especially angry at us. People also get angry at us for setting boundaries about what is or is not within the domain of social science research. We do, for example, regularly reject pieces that are medical research or offer only clinical prescriptions or typologies without accompanying research. Further, our team of moderators do not all agree with each other about where the boundaries are. And our moderators quit often because they wear out. I am one of the longer-lasting moderators because I am retired and have more time. But, as I said, I also am burning out from wading through the volume of AI slop and am very sympathetic to credentialism at times.

This is a very useful, informative and reassuring summary of your work. Keep it up, and continue to tell people what the parameters are within which you are working.

I fear if there is any use in responding to a post written by a machine, but in my opinion publishing in the formal literature should have hoops and requirements as it is part of a *formal system*. Preparing manuscripts takes training, practice and experience. If someone has no experience, no affiliation, no supervision or advisory colleagues, etc., then the system should be very careful with that person, especially in today’s environment. There is nothing stopping anyone from writing something and publishing it as a blog or other such format. The field will find it, if it has any utility or interest.

From what I see happening with the explosion in poor AI-mediated manuscripts, it may be that authors will need to pass some credentialing system (say, membership of a society) before being able to submit. This is not ideal at all, but how else to fight the machine?

Leave a Comment