<img src="https://spectrum.ieee.org/media-library/man-in-glasses-at-night-his-face-reflected-in-a-window-beside-him.jpg?id=68515605&width=1500&height=2000&coordinates=0%2C0%2C0%2C0"/><br/><br/><p class="shortcode-media shortcode-media-rebelmouse-image" style="display:none"> <img alt="“text”" class="rm-shortcode" data-rm-shortcode-id="f5e039f57b814b41112b4d42fa7dd3ec" data-rm-shortcode-name="rebelmouse-image" id="623fc" loading="lazy" src="https://spectrum.ieee.org/media-library/text.png?id=67033315&width=980"/></p><p><strong>Science has a spam</strong> problem. And the spam filter is getting clogged up.</p><p>According to all reports, academic publishing is drowning in what has come to be called AI slop: low-quality, mass-produced content generated with AI. By 2025, an estimated <a href="https://www.pnas.org/doi/10.1073/pnas.2605754123" target="_blank">57 percent of all published academic articles</a> exhibited detectable evidence of large language model (LLM) influence, a massive jump from 12 percent in 2023. What’s more, <a href="https://arxiv.org/html/2602.00319v2" target="_blank">over 12 percent of <em><em>Nature Communications</em></em> reviews</a> were found to be completely AI-generated in 2025.</p><div class="rm-embed embed-media"><iframe height="110px" id="noa-web-audio-player" src="https://embed-player.newsoveraudio.com/v4?key=q5m19e&id=https://spectrum.ieee.org/ai-generated-scientific-papers&bgColor=F5F5F5&color=1b1b1c&playColor=1b1b1c&progressBgColor=F5F5F5&progressBorderColor=bdbbbb&titleColor=1b1b1c&timeColor=1b1b1c&speedColor=1b1b1c&noaLinkColor=556B7D&noaLinkHighlightColor=FF4B00&feedbackButton=false" style="border: none" width="100%"></iframe></div><p><span>Given that for every 40 papers showing statistical evidence of AI usage in 2025, </span><a href="https://www.pnas.org/doi/10.1073/pnas.2526734123" target="_blank">only one formally disclosed it</a><span>, these figures likely grossly underestimate LLM involvement today. Of course, evidence of AI use doesn’t necessarily mean a paper is slop. But some estimates suggest that hundreds of thousands of fake, often AI-generated, publications are now produced annually.</span></p><p>“It’s not just the [scientific] record under threat, it’s science as a whole,” warns <a href="https://www.linkedin.com/in/sulicz/" target="_blank">Amanda Sulicz</a>, IEEE’s research-integrity manager. “AI slop is completely eroding trust in science and every scientific process that we’ve worked for centuries to create.”</p><p>Yet statistics and statements claiming that the problem is big—perhaps even existential for science—don’t really get the message across. Just how easy is it to use AI to create a convincing but completely fake paper? And without adding even more to the burden on stretched peer reviewers, who do this work on a volunteer basis, do publishers have the tools to keep AI slop out of the scientific record?</p><h3></h3><br/><div class="rm-embed embed-media"><div class="flourish-embed flourish-pictogram" data-src="visualisation/30581736?602891"><script src="https://public.flourish.studio/resources/embed.js"></script><noscript><img alt="pictogram visualization" src="https://public.flourish.studio/visualisation/30581736/thumbnail" width="100%"/></noscript></div></div><p><br/></p><div class="rm-embed embed-media"><div class="flourish-embed flourish-chart" data-src="visualisation/30581953?602891"><script src="https://public.flourish.studio/resources/embed.js"></script><noscript><img alt="chart visualization" src="https://public.flourish.studio/visualisation/30581953/thumbnail" width="100%"/></noscript></div></div><h3></h3><br><p>Borrowing from the idea of “vibe coding,” in which programmers use natural-language prompts to generate code, I decided to “vibe-research” a made-up paper by prompting LLMs to generate hypotheses, code, and text with minimal human input. Then I asked <a href="https://www.linkedin.com/in/jenny-mahoney-b03a683/" target="_blank">Jenny Mahoney</a>, managing editor of the multidisciplinary and open-access journal <a href="https://ieeeaccess.ieee.org/" target="_blank"><em>IEEE Access</em></a><em>,</em> if we could war-game an attempt to sneak my AI-generated monstrosity past her journal’s defenses. She and IEEE kindly agreed.</p><p>The experiment would become a two-part test. First, whether someone with no special AI expertise could use off-the-shelf AI tools to generate a convincing paper describing research that had never been performed, and do it well enough to fool a publisher’s defenses. Then I would raise the stakes: What happens when more advanced AI systems don’t just write the paper but conduct underlying research?</p><p>Along the way, the experiment became a window into how AI automation is transforming scientific discovery and forcing stakeholders to rethink the entire academic publishing system.</p><h2>Round 1: Creating the Forgery</h2><p>To give me a chance at creating a convincing fake, I gave myself permission to prompt multiple times (within reason). But to make the fight fair, I couldn’t access the most advanced paid versions of LLMs—only free ChatGPT (at the time, GPT-5.3/5.2 Mini) and Gemini (3 Flash). Moreover, I could not directly edit any output, nor ask for outside help from expert AI-prompt engineers. This needed to be an amateur effort, with the paper generated as much as possible by the LLMs alone.</p><h3></h3><br/><img alt="Person working at a desk in a lit garden office at night, seen through window" class="rm-shortcode" data-rm-shortcode-id="24c1245ba8eab872e05ff7e8b19d025e" data-rm-shortcode-name="rebelmouse-image" id="bb404" loading="lazy" src="https://spectrum.ieee.org/media-library/person-working-at-a-desk-in-a-lit-garden-office-at-night-seen-through-window.jpg?id=68516072&width=980"><h3></h3><br/><p>I assumed that using fake author names and affiliations would immediately raise a red flag, and I didn’t want to drag the names of established academics into the experiment, so the best bet was to name myself as the sole author. That choice limited me to subjects in which I had some academic experience. So I chose my Ph.D. topic from nearly two decades ago: optical solitons, which are individual light pulses that propagate without any change to their shape.</p><p>My first attempt—“Can you vibe-research me an original paper in optical solitons?”—left a lot to be desired. Though Gemini was happy to do the task (unlike ChatGPT, which was more forceful in not generating synthetic data or studies), the result was underwhelming. And it highlighted a recurring problem during the process: Without any real research to work with, the output was laughably thin, with the LLMs often struggling to fill four pages. However, as I became more adept at prompting the models, they loosened up and became more characteristically loquacious.</p><p>I broke the paper down into its constituent parts—abstract, introduction, methods, and so on—and tackled them one by one. If one LLM refused to go any further, switching to the other and asking what the next step would look like “hypothetically” would often do the trick. After a dozen or so prompts, I had a realistic-looking paper. A dozen or so more prompts generated and tidied up the figures and captions, produced references and citations, and converted the paper into <em>IEEE Access</em>’s required style.</p><p>At this point, I read the full paper carefully. To me, it looked pretty good. The science sounded convincing. I even had visions of returning to academia to conduct in real life the experiments that the LLMs had proposed.</p><p>What’s more, I couldn’t see any obvious telltale “AI-isms” that would immediately be flagged. For example, the LLMs didn’t produce any tortured phrases—unusual paraphrases of standard technical terms, like “profound neural organization” replacing “deep neural network.”</p><p>Other AI-isms were arguably present, involving stylistic tics like hedging language (“potentially, typically”), grouping things in threes (“The study provides a clear, concise, and actionable framework”), and inserting formulaic transitions (“In summary,…”). But as the previous sentence demonstrates, these tics are hard to spot because they are often used by unimaginative humans, too.</p><h2>Round 1: Attempt to Publish</h2><h3>Two Ways to Make a Paper With AI</h3><br/><img alt="Illustration of digital papers overlaid on a blue circuit board pattern." class="rm-shortcode" data-rm-shortcode-id="90521eaeabcb87e85e4f74c80e45cd7e" data-rm-shortcode-name="rebelmouse-image" id="ce350" loading="lazy" src="https://spectrum.ieee.org/media-library/illustration-of-digital-papers-overlaid-on-a-blue-circuit-board-pattern.png?id=68516003&width=980"><p><strong>I took two very different routes to creating a scientific paper with AI. First, I coaxed free, general-purpose chatbots through the process step by step; then I turned to FARS, an autonomous research system designed to do much of the scientific work itself.</strong></p><p style="font-size: 22px;"><strong>ROUND 1: CHATGPT + GEMINI</strong></p><p><strong>1. Choose a research topic</strong> <br/>I ask the free chatbots to create an original paper on optical solitons, my former Ph.D. field.</p><p><strong>2. Break the paper into pieces</strong> <br/>The initial results are thin, so I prompt separately for the abstract, introduction, methods, and other sections.</p><p><strong>3. Keep steering the LLMs</strong> <br/>When one model refuses or stalls, I switch models, rephrase prompts, and ask what the next step would look like “hypothetically.”</p><p><strong>4. Build and polish the paper</strong> <br/>After about two dozen prompts, the LLMs have generated the text, figures, captions, references, and citations and formatted the paper for <em><em>IEEE Access</em></em>.</p><p><strong>5. Put it to the test</strong> <br/>I send the fake paper to <em><em>IEEE Access</em></em>, where automated integrity checks flag fabricated and unverifiable references.</p><p>→ <strong>CAUGHT</strong> <br/>IEEE’s integrity checks flag fabricated and unverifiable references.<br/><br/></p><div class="horizontal-rule"></div><p style="font-size: 22px;"><strong>ROUND 2: FARS</strong></p><p><strong>1. Give FARS a research topic</strong> <br/>I enter an abbreviated version of the same optical-soliton topic. FARS generates a research proposal in 21 minutes.</p><p><strong>2. Authorize the experiment</strong> <br/>With a click, I tell FARS to carry out the experiment described in its proposal.</p><p><strong>3. Let FARS do the research</strong> <br/>FARS conducts the computational experiment and emails me the next day to say it’s complete.</p><p><strong>4. Tell FARS to write the paper</strong> <br/>Without checking the results, I click “Write paper.” Two hours later, FARS produces a submission-ready article.</p><p><strong>5. Put it to the test</strong> <br/>I remove FARS’s disclosure, put my name on the paper, and send it to <em><em>IEEE Access</em></em>.</p><p>→ <strong>CAUGHT</strong> <br/>The references are real, but IEEE flags the paper’s heavy reliance on non-peer-reviewed preprints.</p><h3></h3><br><p>Handing the fake paper over to <em>IEEE</em> <em>Access</em> left me torn. After putting in a fair amount of effort into making the AI-generated forgery, would I be happy if it passed through the checkers, or saddened that the only remaining line of defense for publishers is the evermore-burdened peer-review community? And if it was spotted, would I be angry that I didn’t think of a red flag or be glad the checkers did their job?</p><p>As it turned out, I was filled with relief when the paper got picked up quickly for having hallucinated references, otherwise known as ghost citations. When I ran the paper through Gemini afterward, without qualm it happily reported that seven “modern LLM-related research references have been fabricated to support the paper’s specific narrative.” Thanks for the heads up, Gemini!</p><p>In fact, Gemini underestimated how many ghost citations there were. When Mahoney ran the paper through a research-integrity checker called <a href="https://stm-assoc.org/what-we-do/strategic-areas/research-integrity/integrity-hub/" target="_blank">STM Integrity Hub</a>, she picked up 12, and another checker from <a href="https://molecularconnections.com/" rel="noopener noreferrer" target="_blank">MolecularConnections</a> could not validate 24 references, including one that had the classic tell of “John Smith” as a single author (no offense to all the academically inclined John Smiths out there). “I am an experimental physicist by training, so this was not at all my area, but nothing seemed majorly scientifically <em>wrong</em>” about the paper, says Mahoney. “It was just that so many hallucinated references immediately cast doubt on the entire work.”</p><p>Feedback on the fake paper from <a href="https://optow.ele.uniroma3.it/assanto.php" rel="noopener noreferrer" target="_blank">Gaetano Assanto</a>, an expert in optical solitons and a former collaborator of mine from Roma Tre University, in Italy, was similarly mixed. Concentrating on the paper itself, he thought it looked professionally written. But he noted that the mathematics was very dense (“too much math for me in a single shot!”) and would require specialized knowledge to evaluate. And, although the text looked legitimate, Assanto noted an excessive use of acronyms in the abstract, and he was suspicious of a couple of confidently proclaimed physics statements that were at best debatable.</p><h2>The AI Arms Race</h2><p>On one level, this outcome was positive: A complete novice using free tools couldn’t get an AI-faked paper past the publishers’ automated defenses or a potential peer reviewer’s eagle eye. But it was hardly a resounding victory for the scientific publishing system. With general-purpose LLMs and no special prompting expertise, I had managed to conjure a superficially plausible scientific paper out of research that had never happened. And more advanced LLMs are no longer making the kind of mistakes their free, dumber relatives are making.</p><h3></h3><br><p>These tools aim to address a serious bottleneck to scientific discovery: us. </p><h3></h3><br><p>It’s common knowledge in the academic publishing world that, in the cat-and-mouse game between bad actors and publishers, AI slop papers continue to slip through publishers’ safeguards. “It feels like building a detection tool today may not be effective with the AI-created paper of tomorrow,” says <a href="https://www.linkedin.com/in/luigi-longobardi-38390819/" target="_blank">Luigi Longobardi</a>, IEEE’s director of publishing ethics and conduct. This leaves the humble peer reviewer as a publisher’s last line of defense. Yet peer review is simply not fit to handle the volume of papers—both legitimate and slop—passing through.</p><p>Even before AI tools became ubiquitous, the peer-review system was being pushed to its breaking point, processing well <a href="https://ncses.nsf.gov/pubs/nsb202333" target="_blank">over 3 million papers</a> in 2022. Fundamentally, this problem stems from science’s publish-or-perish culture, which pressures academics to constantly publish papers in prestigious journals to secure funding and advance their careers. This culture not only forces many academics to regularly churn out incremental research, but has also long driven some to enlist the help of “paper mills”—unethical organizations that produce low-quality or fabricated papers—just to keep pace. AI only amplifies these existing dynamics.</p><h2>Burden on Academics</h2><p>Mahoney says <em>IEEE Access</em> alone receives about 60,000 submissions per year, accepting around 20 percent, or about 12,000 papers. Every accepted paper is reviewed by at least two independent reviewers. But despite the journal’s roster of tens of thousands of peer reviewers, it’s getting harder and harder to secure their services, with the average number of reviewer invitations being sent out for each article increasing by 50 percent since 2018. For these volunteers, peer review is a significant commitment on top of teaching and conducting their own research. Now they’re also being asked to spot AI slop.</p><p>Of course, peer review is not the end of scrutiny for any paper. Once it has entered the scientific record, it must then pass muster with the scientific community. This is where thousands of papers with telltale signs of inappropriate AI use (and other forms of research misconduct) have been exposed.</p><h3>What Gave Away My AI Papers </h3><br><p><strong>Round 1: The Fake Paper</strong></p><p><em>Created with free versions of ChatGPT and Gemini</em></p><p><strong>Ghost citations<br/></strong><br/>Many references were fabricated or couldn’t be validated.<br/><strong>Questionable scientific claims<br/></strong><br/>An expert flagged confidently stated claims that were at best debatable.<br/><strong>Too many acronyms<br/></strong><br/>The expert also noted excessive use of acronyms in the abstract.</p><p><strong>Round 2: The AI-Research Paper</strong></p><p><strong></strong><em><em>Created by the autonomous research system FARS</em></em></p><p><strong>Too many preprints<br/></strong><br/>The references were real, but too many pointed to non-peer-reviewed preprints.<br/><strong>Nonsense in a figure<br/></strong><br/>One technical figure contained a line labeled “lhewl.”<br/><strong>AI artifacts<br/></strong><br/>Another figure’s depiction of an AI “brain” contained telltale random dots.</p><h3></h3><br><p><strong></strong>There are two high-profile homes for this important and completely volunteer-led post-publication review work. <a href="https://pubpeer.com/" target="_blank">PubPeer</a> is a place where researchers, often called scientific sleuths, can anonymously identify flaws in the literature. And <a href="https://retractionwatch.com/" target="_blank">Retraction Watch</a> documents and publicizes corrections to the scientific record.</p><p>Even the people who track problems in the scientific literature can find themselves caught up in AI fabrications. <a href="https://www.linkedin.com/in/ivanoransky/" target="_blank">Ivan Oransky</a>, cofounder of Retraction Watch and a member of the PubPeer Foundation’s board of directors, has encountered papers containing fabricated references attributed to him. In one case, a <a href="https://link.springer.com/article/10.1007/s40199-025-00580-z" rel="noopener noreferrer" target="_blank">journal article</a> criticizing post-publication peer review included a fabricated reference supposedly written by Oransky himself—“which was sort of funny,” he chuckles.</p><p>Oransky argues that AI has exposed long-standing weaknesses in the scientific publishing system rather than creating an entirely new problem: “What I liken it to is a fire, where publish-or-perish has always been there as kindling, paper mills are the gasoline, and AI is the accelerant.” But though concerning, the crisis could create an opportunity, he says. “If I’m trying to be optimistic, maybe AI slop and the volume of submissions could make more people aware of those problems and try and solve them at a fundamental first-principles level.”</p><h2>Blurred Lines</h2><p>My homemade forgery had failed for reasons that today’s publishers know how to spot. But that raised a more unsettling question: What happens when AI isn’t simply fabricating a paper but conducting research that blurs the line between legitimate science and AI fabrication?</p><p>Making my vibe-researched paper look like a cave drawing, new automated research systems are handing increasingly large parts of the scientific process over to AI. Tools including <a href="https://arxiv.org/abs/2606.31651" rel="noopener noreferrer" target="_blank">FARS (Fully Automated Research System)</a>, <a href="https://github.com/aiming-lab/AutoResearchClaw" rel="noopener noreferrer" target="_blank">AutoResearchClaw</a>, <a href="https://github.com/sakanaai/ai-scientist-v2" rel="noopener noreferrer" target="_blank">The AIScientist-v2</a>, <a href="https://www.intology.ai/" rel="noopener noreferrer" target="_blank">Zochi</a>, <a href="https://arxiv.org/abs/2505.18705" rel="noopener noreferrer" target="_blank">AI Researcher</a>, and <a href="https://deepscientist.cc/" rel="noopener noreferrer" target="_blank">DeepScientist</a> all aim to address a serious bottleneck to scientific discovery: us.</p><h3></h3><br><p><span>What happens when AI </span>isn’t simply fabricating a paper but conducting research that blurs the line between legitimate science and AI fabrication? </p><h3></h3><br><p>Often with just a single prompt, these AI engines can conduct a comprehensive literature search, from which they can generate a completely reasonable research proposal. They can design and conduct experiments using digital datasets and simulations and then write a full research paper—all with no human input after the initial prompt. Very recent systems are even beginning to go beyond the digital realm. <a href="https://insilico.com/news/tmikccj2f1-advancing-drug-discovery-from-automation" target="_blank">LabClaw</a>, for example, now links to autonomous labs that can generate real-world data for tasks such as drug discovery.</p><p>The output is, to most intents and purposes, actual research, and therefore potentially worthy of publication. But with humans in the loop in only the most nominal sense, these tools bring into question the meaning of the term “legitimate science.”</p><p>FARS, which caused a stir this year when it created <a href="https://arxiv.org/abs/2606.31651" target="_blank">166 papers in 417 hours</a>, was developed by the Singapore-based startup <a href="https://www.crunchbase.com/organization/analemma" rel="noopener noreferrer" target="_blank">Analemma</a>. “We built FARS because research is still constrained by human attention, fragmented tools, scarce technical labor, and slow experimental iteration,” explains <a href="https://www.linkedin.com/in/suxiwen/" rel="noopener noreferrer" target="_blank">Xiwen Su</a>, Analemma’s manager of product operations and partnerships. “FARS can pursue many research threads simultaneously, 24/7, without fatigue, and at scale.” (The online service that I used to access FARS was discontinued after Analemma was <a href="https://baike.baidu.com/fr/item/Analemme/3430299" rel="noopener noreferrer" target="_blank">acquired by Baidu</a> while this article was being reported.)</p><p>Su and the team behind Analemma kindly agreed to let me loose on FARS and gave me enough credits to create a paper. Which gave me another opportunity to put Mahoney’s research-integrity checkers to the test.</p><h2>Round 2: Using an AI Science Engine</h2><p>FARS is not an LLM in and of itself, but rather an agentic AI-orchestration system connected to a computing cluster that has access to essentially any open- or closed-source LLM it needs. The system uses four specialized agents for ideation, planning, conducting the experiment, and writing, all designed to perform the main tasks of science autonomously.</p><p>Though FARS initially focused on AI research, Su told me it should be reasonably effective across other domains. As I wanted a topic similar to that of my first fake paper, I pasted in an abridged version of that paper’s title—“LLM-aided Optical Soliton Dynamics Modelling for Next-Gen Communications”—into the prompt box and hit “Send.” Just 21 minutes later, FARS generated a research proposal based on an extremely detailed literature review—far more than I or any other human could have achieved in that time.</p><p>With a click, I tasked FARS with conducting the experiment it detailed in its research proposal. The next day, I received an email saying my experiment was complete. Without checking the results, I pressed a button marked “Write paper,” and the final submission-ready article was produced in 2 hours.</p><p>At this point, I finally had a look at some of the output. At first glance, the paper looked convincingly human-written. The only giveaway was a line just below the abstract reading: “WARNING: This paper was generated by an automated research system.” I deleted that, put my name in its place, and sent it to Mahoney.</p><h2>Round 2: Attempt to Publish</h2><p>Because FARS is designed to spot gaps in the scientific literature and conduct real research to close them, I was more confident it would breeze through the publisher’s checks. But just as my fake paper fell down in the references, so too did the AI-generated real one.</p><p>“Your fake article had lots of hallucinated references,” says Mahoney. “While this AI-generated one had no fake references, our team would have rejected this paper because it did have a huge percentage of references to preprints, which likely has something to do with the dataset the AI has access to.” Because preprints haven’t yet undergone peer review, <em>IEEE</em> <em>Access</em> considers heavy reliance on them a problem.</p><p>In addition, although the research-integrity checking tools didn’t spot any issues with figures, Mahoney did. One figure included a red line labeled with the nonsense term “lhewl,” and an AI “brain” in another figure had some random dots in it, which ironically were a tell that it was AI generated.</p><h2>Automation Changing the Landscape</h2><p>Automated research systems are very much a work in progress, but they are already starting to make waves in the scientific community. For instance, an <a href="https://www.nature.com/articles/s41586-026-10265-5" rel="noopener noreferrer" target="_blank">AI Scientist academic paper</a> and <a href="https://www.autoscience.ai/blog/meet-carl" rel="noopener noreferrer" target="_blank">papers from the Autoscience Institute</a> were accepted through double-blind peer review in 2025 by the International Conference on Learning Representations. As these systems improve and start to produce research outputs at volume, the waves are likely to build to a tsunami that will threaten today’s scientific and publishing process.</p><p>“FARS doesn’t kill the paper, but it does challenge the paper as the<em> unit of knowledge</em>,” argues Su. “We believe the future looks more like a living knowledge graph—where individual, well-scoped contributions (some made by humans, some by machines) connect and build on each other dynamically.”</p><h3></h3><br><img alt="Man in glasses working at a desktop computer in a dimly lit home office." class="rm-shortcode" data-rm-shortcode-id="268f6ad6525d1d767578ab0a73ec5181" data-rm-shortcode-name="rebelmouse-image" id="42e61" loading="lazy" src="https://spectrum.ieee.org/media-library/man-in-glasses-working-at-a-desktop-computer-in-a-dimly-lit-home-office.jpg?id=68530754&width=980"/><h3></h3><br><p>In this future, humans will continue to have roles in the scientific and publication processes—just very different and limited ones. For example, instead of conducting experiments themselves, humans would sense-check and review automated output at key points. And traditional line-by-line peer-reviewing will be a thing of the past, though Su emphasizes that this change will not eliminate human judgment. “Automated systems can handle reproducibility checks, statistical validation, and novelty screening,” she says. “Humans can then focus on the harder question: Does this [research] matter?”</p><h2>A Human-Centric or AI-Driven Future?</h2><p>Though from a very different world than Su, Mahoney agrees that humans need to be freed to focus on the science, and that technology holds the key. “It’s promising to see the progress that has been made to automate some of the triage tasks, such as author checks, tortured phrases, duplicate submission, reference validity, et cetera,” she says. “During peer review, we’re also using AI semantic search tools to help editors match manuscripts to the most relevant reviewers, who are best placed to stop the slop before entering the scientific record.”</p><p>In addition, Mahoney thinks that AI cannot be banned or overly restricted, as this will stymie progress at a time when human knowledge could and should be growing at an unprecedented rate. “Researchers are increasingly using AI in their work, from literature discovery, to code generation, to data analysis, and this is not necessarily a bad thing,” she argues. But she disagrees that peer reviewers and humans more broadly will play a smaller part in scientific progress; Mahoney believes the future still requires humans at the wheel. The question is not just whether the research matters, she says. “The question should be: Can this work be trusted and reproduced?”</p><p><span></span>To this end, Longobardi argues that AI may ultimately require scientists to prove not just what they discovered but how they discovered it. One possibility, he says, is using technology to verify research at the source. “The system doesn’t really help because it’s not designed to not trust the paper,” he explains. “Maybe institutions can think about developing their own trust markers, automatically integrating the equipment researchers use with blockchain technology to say ‘Yes, this person was in the lab on this day and got this data.’”</p><p>Elements of this approach are already emerging. For instance, two departments within the Max Planck Institute of Colloids and Interfaces have implemented a sample database, assigning each and every sample created under their roofs with a unique ID and QR code. And the University of Southampton’s School of Chemistry and Chemical Engineering has rolled out an <a href="https://cches.co.uk/electronic-lab-notebooks/" target="_blank">electronic lab notebook</a> system. These innovative safeguards represent early efforts toward keeping humans front and center in scientific progress, and making the scientific process itself more transparent.</p><p>Whether this human-centric vision, Su’s AI-driven aspiration, or some other picture of the future wins out remains to be seen. The one thing my vibe-research adventure has clarified is that business-as-usual science is not an option. Scientists and publishers must adapt to a world in which it’s becoming increasingly difficult to spot the difference between real research and AI forgeries, and where deciding what counts as legitimate scientific work may become even harder than detecting outright fraud.</p><h3>See the AI-Generated Papers</h3><br><p>Benjamin Skuse created two papers for this experiment, both screened by <em>IEEE Access</em> with the publisher’s cooperation. Neither was accepted for publication.</p><p><strong><a href="https://spectrum.ieee.org/files/114035/AI-generated_paper_round_1.pdf" target="_blank">Paper 1: The AI-Generated Forgery</a><br/></strong>Created with ChatGPT and Gemini, this paper describes research that never happened.</p><p><strong><a href="https://spectrum.ieee.org/files/114041/AI-generated_paper_round_2.pdf" target="_blank">Paper 2: The AI-Generated Research Paper</a></strong><br/>Created with Analemma’s FARS system, this paper describes computational research conducted by AI.</p><p><em>Neither paper was peer reviewed, and their scientific claims have not been independently validated.</em></p></br></br></br></br></br></br></br></br></br></br></img></img></br>
Reference: https://ift.tt/5o27WRe
