The Open Library of Humanities has just published a new policy on the use of AI in scholarly publishing that is well worth a read: Making sure you're not a bot!
(Sorry “making sure you’re not a bot” reflects the way OLH is defending itself and its journals against bots scraping OLH journals for content)
“authors planning on submitting research to an OLH journal must consult these guidelines first and must always provide a declaration of any substantial and known uses of generative AI to the editors of the journal they are submitting to for their consideration”
This helps editors in making quick decisions about papers if they find that the author has used AI without acknowledging it: you can always refer to the policy. At Glossa, we have found that several authors use AI to confabulate non-existing references, i.e. references that attribute non-existing papers to existing authors, and DOIs that do not lead anywhere. Desk reject!
At @uminhoeditora, Editors are also finding that fabricated or non-existent references are becoming an issue. At the Practical Community of Editors, we are addressing this topic in a meeting today, so this post could not have come at a better time.
Perfect timing indeed! I’m really curious to hear what comes out of your meeting and how editors are tackling this issue, including any feedback or tools they might be using.
The French Network Medici is also hosting a webinar at the beginning of February on the use of AI, showcasing tools that could be very useful, though unfortunately they are only available in French:
AI-generated abstracts check (detection of AI-generated summaries): aiAbstractCheck
Bibliographic integrity (detection of retracted or “hallucinated” references): bibCheck
I’m curious if there are any similar tools available in English/or others languages?
Hi Johan, that’s an interesting idea, it would be worth looking into it and seeing what might be possible, as well as how it could be managed in practice
Simon Everett of OLH just replied to me to say that iThenticate is also able to identify hallucinated references. But then again iThenticate is a service that may be too expensive for many publishers. Perhaps something EDCH shd look into
We have iThenticate at the @uminhoeditora . The problem is that it only works for English, Spanish, and Japanese.
One of the suggestions we gave, and it was proven by one of the journals, was doing a first triage of the article. The editorial assistant evaluates the article on those aspects more “formal”, such as the correct use of the template, identifying if the references are within the norms that they defined, and if they exist. Then they have another triage by a group of junior investigators of the investigation center, and they do a more in-depth work, such as seeing if the article is valuable or not.
Of course, some journals can’t do this job, and this journal is considering APCs because it cannot sustain the editorial assistant much longer without funding…
Research Libraries UK has bought together resources that examine the role and impact of AI in research and in the research library, including AI strategy and futures, skills development, open-source infrastructures, ethical and legal considerations, and the potential of AI to support more inclusive and trustworthy knowledge ecosystem. Some of the resources may be useful publishers as part of the same ecosystem.
