A new study argues that scientific journals should evaluate a manuscript's quality and its potential impact as two separate judgments rather than blending them into a single verdict. The proposal, reported by the journal Science, is based on a pilot experiment that explores alternatives to the traditional model of journal peer review.
Under the conventional system, reviewers typically weigh how rigorous a study is alongside how important or exciting its findings appear. Critics have long argued that combining the two can tilt decisions toward eye-catching results and away from carefully executed work that may seem less newsworthy, a concern that has fed wider debate about how research is assessed and published.
The pilot is designed to test whether separating the two questions produces clearer and more consistent evaluations. By asking reviewers to rate soundness on its own terms and to assess likely impact independently, the approach aims to reduce the pull of prestige on judgments about methodology. The reporting describes the work as exploratory, so its broader applicability remains to be tested in larger settings.
The article also places the experiment within a longer conversation about reforming peer review, a process that has come under scrutiny for its speed, its reliance on volunteer reviewers and its occasional inconsistency. Whether separate ratings will change how journals decide what to publish is an open question that later research will need to answer.
Credit. Based on reporting for Science Magazine News. Is this your work? Write to us.
32





