{"id":8802,"date":"2021-05-14T10:36:54","date_gmt":"2021-05-14T10:36:54","guid":{"rendered":"https:\/\/thepublicationplan.com\/?p=8802"},"modified":"2023-10-02T08:42:49","modified_gmt":"2023-10-02T08:42:49","slug":"will-machines-replace-peer-reviewers-the-role-of-artificial-intelligence-in-scientific-publishing","status":"publish","type":"post","link":"https:\/\/thepublicationplan.com\/2021\/05\/14\/will-machines-replace-peer-reviewers-the-role-of-artificial-intelligence-in-scientific-publishing\/","title":{"rendered":"Will machines replace peer reviewers? The role of artificial intelligence in scientific publishing"},"content":{"rendered":"<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" data-attachment-id=\"8809\" data-permalink=\"https:\/\/thepublicationplan.com\/2021\/05\/14\/will-machines-replace-peer-reviewers-the-role-of-artificial-intelligence-in-scientific-publishing\/big-data-analytics-visualization-technology-with-scientist-analyzing-information-structure-on-screen-with-machine-learning-to-extract-strategical-prediction-for-business-finance-internet-of-things\/\" data-orig-file=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/05\/artificial-intelligence-peer-review.jpg?fit=724%2C483&amp;ssl=1\" data-orig-size=\"724,483\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;Getty Images\/iStockphoto&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;Big data analytics visualization technology with scientist analyzing information structure on screen with machine learning to extract strategical prediction for business, finance, internet of things&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;Nicolas Herrbach (Nicolas Herrbach (Photographer) - [None]&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;Big data analytics visualization technology with scientist analyzing information structure on screen with machine learning to extract strategical prediction for business, finance, internet of things&quot;,&quot;orientation&quot;:&quot;1&quot;}\" data-image-title=\"\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/05\/artificial-intelligence-peer-review.jpg?fit=300%2C200&amp;ssl=1\" data-large-file=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/05\/artificial-intelligence-peer-review.jpg?fit=724%2C483&amp;ssl=1\" class=\"size-full wp-image-8809 aligncenter\" src=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/05\/artificial-intelligence-peer-review.jpg?resize=724%2C483&#038;ssl=1\" alt=\"\" width=\"724\" height=\"483\" srcset=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/05\/artificial-intelligence-peer-review.jpg?w=724&amp;ssl=1 724w, https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/05\/artificial-intelligence-peer-review.jpg?resize=300%2C200&amp;ssl=1 300w\" sizes=\"auto, (max-width: 724px) 100vw, 724px\" \/><\/p>\n<p>Artificial intelligence (AI) is quickly becoming integrated into our daily lives, whether through virtual assistants on mobile devices, online shopping algorithms, or safety mechanisms in cars. It has been <a href=\"https:\/\/www.editage.com\/insights\/this-is-how-ai-will-speed-up-peer-reviews\" target=\"_blank\" rel=\"noopener\">suggested<\/a> that AI could be used to address lengthy peer review times, with some <a href=\"https:\/\/thepublicationplan.com\/2017\/10\/19\/is-artificial-intelligence-the-key-to-speedier-peer-review\/\" target=\"_blank\" rel=\"noopener\">research<\/a> indicating that these could be shortened by 30% through the use of algorithms. A recent <a href=\"https:\/\/www.nature.com\/articles\/s41599-020-00703-8#Abs1\" target=\"_blank\" rel=\"noopener\">article<\/a> in <em><a href=\"https:\/\/www.nature.com\/palcomms\/\" target=\"_blank\" rel=\"noopener\">Humanities and Social Sciences Communications<\/a><\/em> considers the potential benefits and pitfalls of increasing use of AI in peer review.<\/p>\n<p>Dr Alessandro Checco and co-authors designed an AI tool and trained it on 3,300 peer reviewed conference proceedings where the reviewer\u2019s recommendations were known. They then tested the tool to assess its ability to determine whether papers would be accepted and how they might be scored by reviewers. They found that the AI tool was often successful in predicting peer review outcomes, demonstrating strong correlations between peer review scores and superficial characteristics such as readability and formatting.<\/p>\n<blockquote>\n<p style=\"text-align: center;\">The AI tool was often successful in predicting peer review outcomes, demonstrating strong correlations between peer review scores and superficial characteristics such as readability and formatting.<\/p>\n<\/blockquote>\n<p>The authors suggest that, if such proxy measures are typically indicative of the overall quality of a paper, the AI tool could successfully reduce the burden on peer reviewers by performing initial screening checks (and \u2018desk rejecting\u2019 as needed). However, there is also a risk that the AI tool itself could replicate the biases that human peer reviewers are susceptible to. For instance, language patterns in papers written by non-native English speakers may receive low scores from an AI tool regardless of research quality, reducing the likelihood of acceptance for publication. This type of systematic bias could disproportionately impact authors from lower- and middle-income countries, who may already face <a href=\"https:\/\/thepublicationplan.com\/2021\/02\/09\/the-impact-of-expensive-article-processing-charges-on-researchers-from-lower-income-african-countries\/\" target=\"_blank\" rel=\"noopener\">financial barriers<\/a> to getting their research published. On the other hand, the authors are optimistic that such AI tools could make it easier for peer reviewers to spot their own biases, providing them with an opportunity to make their reviews more equitable.<\/p>\n<blockquote>\n<p style=\"text-align: center;\">AI tools could make it easier for peer reviewers to spot their own biases.<\/p>\n<\/blockquote>\n<p>Given the <a href=\"https:\/\/thepublicationplan.com\/2021\/04\/13\/combatting-research-integrity-breaches-insights-from-suzanne-farley-director-of-the-springer-nature-research-integrity-group\/\" target=\"_blank\" rel=\"noopener\">ever increasing number of manuscript submissions<\/a>, there is a need to critically assess the traditional peer review process and identify ways it can be streamlined. Peer review is a central mechanism in maintaining high quality research and outcomes can play a role in career progression. While the authors are not looking to a future where AI tools completely replace human peer reviewers, they could be a promising way to address the evolving needs in scientific publishing. However, further research is needed to carefully consider any ethical pitfalls.<\/p>\n<div data-opinionstage-embed-url=\"https:\/\/www.opinionstage.com\/api\/v1\/polls\/2749370\/code.json?width=\" style=\"display: none; visibility: hidden;\"><\/div>\n<p>\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2013<\/p>\n<p><a href=\"https:\/\/www.aspire-scientific.com\/\" target=\"_blank\" rel=\"noopener\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" data-attachment-id=\"8793\" data-permalink=\"https:\/\/thepublicationplan.com\/2021\/05\/12\/open-science-is-accelerated-as-a-result-of-the-covid-19-pandemic\/byline_kristian-clausen\/\" data-orig-file=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/05\/Byline_Kristian-Clausen.png?fit=618%2C75&amp;ssl=1\" data-orig-size=\"618,75\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Byline_Kristian Clausen\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/05\/Byline_Kristian-Clausen.png?fit=300%2C36&amp;ssl=1\" data-large-file=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/05\/Byline_Kristian-Clausen.png?fit=618%2C75&amp;ssl=1\" class=\"alignnone size-full wp-image-8793\" src=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/05\/Byline_Kristian-Clausen.png?resize=618%2C75&#038;ssl=1\" alt=\"\" width=\"618\" height=\"75\" srcset=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/05\/Byline_Kristian-Clausen.png?w=618&amp;ssl=1 618w, https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/05\/Byline_Kristian-Clausen.png?resize=300%2C36&amp;ssl=1 300w\" sizes=\"auto, (max-width: 618px) 100vw, 618px\" \/><\/a><\/p>\n<hr \/>\n","protected":false},"excerpt":{"rendered":"<p>Machine learning could help tackle an increase in manuscript submissions and speed up peer review, but the ethical implications must be considered.<\/p>\n","protected":false},"author":1,"featured_media":8809,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"advanced_seo_description":"Machine learning could help tackle an increase in manuscript submissions and speed up peer review, but the ethical implications must be considered.","jetpack_seo_html_title":"","jetpack_seo_noindex":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"Will machines replace peer reviewers? The role of #ArtificialIntelligence in scientific publishing @alex_checco #PeerReview #PubPlan","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_publicize_connection_overrides":[],"_wpas_customize_per_network":false},"categories":[343163074,131850,115816],"tags":[343162408,343162457,343162515],"class_list":["post-8802","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","category-medical-writing","category-peer-review","tag-artificial-intelligence","tag-bias","tag-peer-review-publication","post-has-thumbnail"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/05\/artificial-intelligence-peer-review.jpg?fit=724%2C483&ssl=1","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p5Yk5l-2hY","jetpack_likes_enabled":true,"jetpack-related-posts":[],"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/posts\/8802","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/comments?post=8802"}],"version-history":[{"count":8,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/posts\/8802\/revisions"}],"predecessor-version":[{"id":9988,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/posts\/8802\/revisions\/9988"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/media\/8809"}],"wp:attachment":[{"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/media?parent=8802"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/categories?post=8802"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/tags?post=8802"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}