{"id":14078,"date":"2023-06-23T14:52:38","date_gmt":"2023-06-23T14:52:38","guid":{"rendered":"https:\/\/thepublicationplan.com\/?p=14078"},"modified":"2023-06-23T14:52:40","modified_gmt":"2023-06-23T14:52:40","slug":"how-does-failure-to-falsify-influence-the-reliability-of-scientific-research","status":"publish","type":"post","link":"https:\/\/thepublicationplan.com\/2023\/06\/23\/how-does-failure-to-falsify-influence-the-reliability-of-scientific-research\/","title":{"rendered":"How does failure to falsify influence the reliability of scientific research?"},"content":{"rendered":"<hr \/>\n<p><strong>KEY TAKEAWAYS<\/strong><\/p>\n<ul>\n<li>Failure to test and refute prominent hypotheses reduces confidence in the reliability of scientific results and hinders scientific progress.<\/li>\n<\/ul>\n<hr \/>\n<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" data-attachment-id=\"14080\" data-permalink=\"https:\/\/thepublicationplan.com\/2023\/06\/23\/how-does-failure-to-falsify-influence-the-reliability-of-scientific-research\/hypothesis\/\" data-orig-file=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2023\/06\/Hypothesis.jpeg?fit=5184%2C3456&amp;ssl=1\" data-orig-size=\"5184,3456\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;magele-picture - stock.adobe.com&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;1514720517&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;Hypothesis&quot;,&quot;orientation&quot;:&quot;1&quot;}\" data-image-title=\"\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2023\/06\/Hypothesis.jpeg?fit=300%2C200&amp;ssl=1\" data-large-file=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2023\/06\/Hypothesis.jpeg?fit=1024%2C683&amp;ssl=1\" class=\"size-large wp-image-14080 aligncenter\" src=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2023\/06\/Hypothesis.jpeg?resize=1024%2C683&#038;ssl=1\" alt=\"\" width=\"1024\" height=\"683\" srcset=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2023\/06\/Hypothesis.jpeg?resize=1024%2C683&amp;ssl=1 1024w, https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2023\/06\/Hypothesis.jpeg?resize=300%2C200&amp;ssl=1 300w, https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2023\/06\/Hypothesis.jpeg?resize=768%2C512&amp;ssl=1 768w, https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2023\/06\/Hypothesis.jpeg?resize=1536%2C1024&amp;ssl=1 1536w, https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2023\/06\/Hypothesis.jpeg?resize=2048%2C1365&amp;ssl=1 2048w, https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2023\/06\/Hypothesis.jpeg?resize=1800%2C1200&amp;ssl=1 1800w, https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2023\/06\/Hypothesis.jpeg?resize=1320%2C880&amp;ssl=1 1320w, https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2023\/06\/Hypothesis.jpeg?w=2720&amp;ssl=1 2720w, https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2023\/06\/Hypothesis.jpeg?w=4080&amp;ssl=1 4080w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/p>\n<p>Across many scientific fields there is a well-documented <a href=\"https:\/\/thepublicationplan.com\/2022\/05\/12\/nih-bid-to-tackle-reproducibility-crisis-is-data-sharing-the-answer\/\" target=\"_blank\" rel=\"noopener\">reproducibility crisis<\/a> that is damaging trust in the reliability of research data. In a recent <a href=\"https:\/\/elifesciences.org\/articles\/78830\" target=\"_blank\" rel=\"noopener\">article <\/a>published in <em><a href=\"https:\/\/elifesciences.org\/\" target=\"_blank\" rel=\"noopener\">eLife<\/a><\/em>, <a href=\"https:\/\/www.linkedin.com\/in\/sarah-rajtmajer-ab80234\/\" target=\"_blank\" rel=\"noopener\">Dr Sarah Rajtmajer<\/a> and co-authors discuss how failure to falsify (refute) strong hypotheses through direct testing has contributed to the problem.<\/p>\n<p>As a case study, the authors highlight two prominent and seemingly contradictory hypotheses in the field of connectomics:<\/p>\n<ul>\n<li><strong>Hyperconnectivity hypothesis<\/strong>: brain injury results in an enhanced functional network response.<\/li>\n<li><strong>Disconnection hypothesis<\/strong>: brain injury results in reduced functional connectivity.<\/li>\n<\/ul>\n<p>Instead of deliberate attempts to challenge either of these positions, the research area has seen the publication of a large number of small studies examining under-specified hypotheses, which has done little to bring clarity to the existing body of literature. The authors argue that the \u2018science-by-volume\u2019 culture, coupled with the overuse of inappropriate statistical tests and lack of falsification attempts, fosters a research environment in which the quantity of scientific findings continues to grow, but the depth of understanding remains stagnant.<\/p>\n<p>The article calls out the <a href=\"https:\/\/thepublicationplan.com\/2018\/04\/03\/focusing-on-big-data-is-seeing-believing\/\" target=\"_blank\" rel=\"noopener\">big data<\/a> revolution as a factor adding to these concerns. The ability to analyse large datasets in different ways can produce false or coincidental correlations, particularly if the statistical methodologies used are not robust.<\/p>\n<blockquote>\n<p style=\"text-align: center;\">The strongest hypotheses are specific, easily testable, and clearly indicate the evidence needed to disprove their predictions.<\/p>\n<\/blockquote>\n<p>According to Rajtmajer et al., the strongest hypotheses are specific, easily testable, and clearly indicate the evidence needed to disprove their predictions. The authors suggest embracing a \u2018team science\u2019 approach, where groups of scientists work together to form opposing hypotheses, design experiments to test them, and agree on the outcomes that would support or refute them.<\/p>\n<p>Implementing a falsification approach, whereby every observation confirms or refutes a hypothesis, would be challenging in everyday research practice. However, the authors believe that regular attempts to falsify a hypothesis could guide the direction of scientific research and enhance the reliability of published science, particularly if combined with other processes aimed at improving data transparency.<\/p>\n<blockquote>\n<p style=\"text-align: center;\">Regular attempts to falsify a hypothesis could guide the direction of scientific research and enhance the reliability of published science.<\/p>\n<\/blockquote>\n<p>\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2013<\/p>\n<p><a href=\"https:\/\/www.aspire-scientific.com\/\" target=\"_blank\" rel=\"noopener\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" data-attachment-id=\"10023\" data-permalink=\"https:\/\/thepublicationplan.com\/2021\/09\/23\/is-abstract-peer-review-affected-by-institutional-and-geographical-bias\/byline_iain-haslam\/\" data-orig-file=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/09\/Byline_Iain-Haslam.png?fit=618%2C75&amp;ssl=1\" data-orig-size=\"618,75\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/09\/Byline_Iain-Haslam.png?fit=300%2C36&amp;ssl=1\" data-large-file=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/09\/Byline_Iain-Haslam.png?fit=618%2C75&amp;ssl=1\" class=\"alignnone size-full wp-image-10023\" src=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/09\/Byline_Iain-Haslam.png?resize=618%2C75&#038;ssl=1\" alt=\"\" width=\"618\" height=\"75\" srcset=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/09\/Byline_Iain-Haslam.png?w=618&amp;ssl=1 618w, https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/09\/Byline_Iain-Haslam.png?resize=300%2C36&amp;ssl=1 300w\" sizes=\"auto, (max-width: 618px) 100vw, 618px\" \/><\/a><\/p>\n<div id=\"totalpoll\" class=\"totalpoll-wrapper totalpoll-uid-2e21fe0b6d537996d47c3d4b16d0e3cc is-ltr is-screen-vote\" totalpoll=\"14091\" totalpoll-uid=\"2e21fe0b6d537996d47c3d4b16d0e3cc\" totalpoll-screen=\"vote\" totalpoll-ajax-url=\"https:\/\/thepublicationplan.com\/wp-admin\/admin-ajax.php?action=totalpoll&totalpoll%5BpollId%5D=14091&totalpoll%5Baction%5D=view&totalpoll%5Bscreen%5D=vote\"><script type=\"text\/totalpoll-config\" totalpoll-config=\"14091\">{\"ajaxEndpoint\":\"https:\\\/\\\/thepublicationplan.com\\\/wp-admin\\\/admin-ajax.php?action=totalpoll\",\"behaviours\":{\"ajax\":true,\"scrollUp\":true,\"async\":false},\"effects\":{\"transition\":\"fade\",\"duration\":\"500\"},\"i18n\":{\"Previous\":\"Previous\",\"Next\":\"Next\",\"of\":\"of\",\"Something went wrong! Please try again.\":\"Something went wrong! Please try again.\"}}<\/script><link rel=\"stylesheet\" id=\"totalpoll-poll-2e21fe0b6d537996d47c3d4b16d0e3cc-css\"  href=\"https:\/\/thepublicationplan.com\/wp-content\/cache\/totalpoll\/css\/2e21fe0b6d537996d47c3d4b16d0e3cc.css\" type=\"text\/css\" media=\"all\" \/><div id=\"totalpoll-poll-14091\" class=\"totalpoll-container\"><form action=\"\" enctype=\"multipart\/form-data\" class=\"totalpoll-form\" method=\"POST\" novalidate=\"novalidate\"><div style=\"visibility: hidden; position: absolute; width: 0px; height: 0px;\">\r\n    <svg id=\"totalpoll-check-icon\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"24\" height=\"24\" viewBox=\"0 0 24 24\">\r\n        <path d=\"M0,0H24V24H0Z\" fill=\"none\"\/>\r\n        <path d=\"M9,15.1999l-4.2-4.2L2.3999,13.4,9,20.0001,22.0001,7,19.6,4.5999Z\"\/>\r\n    <\/svg>\r\n<\/div>\r\n    <div class=\"totalpoll-questions\">\r\n\t\t<div class=\"totalpoll-question\"\r\n     totalpoll-min-selection=\"1\"\r\n     totalpoll-max-selection=\"1\" >\r\n    <div class=\"totalpoll-question-container\">\r\n        <div class=\"totalpoll-question-content\" >\r\n\t\t\t<p>Could placing a greater emphasis on hypothesis testing and falsification help solve the reproducibility crisis in scientific research?<\/p>\n        <\/div>\r\n\r\n        <div class=\"totalpoll-question-choices\">\r\n\t\t\t\t\t\t\t\t\t\t\t\t<label for=\"choice-57bcbd37-f8a3-414a-b593-341dcb2d604d-selector\" tabindex=\"0\"\r\n       class=\"totalpoll-question-choices-item totalpoll-question-choices-item-type-text \" >\r\n    <div class=\"totalpoll-question-choices-item-container\">\r\n        \r\n\t\t        \r\n        <div class=\"totalpoll-question-choices-item-control\">\r\n            <div class=\"totalpoll-question-choices-item-selector totalpoll-question-choices-item-selector-single\">\r\n\t\t\t\t<input type=\"radio\" id=\"choice-57bcbd37-f8a3-414a-b593-341dcb2d604d-selector\" name=\"totalpoll[choices][75e55f81-909a-4210-bc01-c7c5f81bf391][]\" value=\"57bcbd37-f8a3-414a-b593-341dcb2d604d\">                <div class=\"totalpoll-question-choices-item-selector-box\">\r\n                    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"24\" height=\"24\" viewBox=\"0 0 24 24\">\r\n                        <use xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"#totalpoll-check-icon\"><\/use>\r\n                    <\/svg>\r\n                <\/div>\r\n            <\/div>\r\n            <div class=\"totalpoll-question-choices-item-label\">\r\n                <span >Yes<\/span>\r\n            <\/div>\r\n        <\/div>\r\n    <\/div>\r\n<\/label>\r\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<label for=\"choice-637a28ee-df9a-4cb8-b5cf-5e36f854faf0-selector\" tabindex=\"0\"\r\n       class=\"totalpoll-question-choices-item totalpoll-question-choices-item-type-text \" >\r\n    <div class=\"totalpoll-question-choices-item-container\">\r\n        \r\n\t\t        \r\n        <div class=\"totalpoll-question-choices-item-control\">\r\n            <div class=\"totalpoll-question-choices-item-selector totalpoll-question-choices-item-selector-single\">\r\n\t\t\t\t<input type=\"radio\" id=\"choice-637a28ee-df9a-4cb8-b5cf-5e36f854faf0-selector\" name=\"totalpoll[choices][75e55f81-909a-4210-bc01-c7c5f81bf391][]\" value=\"637a28ee-df9a-4cb8-b5cf-5e36f854faf0\">                <div class=\"totalpoll-question-choices-item-selector-box\">\r\n                    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"24\" height=\"24\" viewBox=\"0 0 24 24\">\r\n                        <use xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"#totalpoll-check-icon\"><\/use>\r\n                    <\/svg>\r\n                <\/div>\r\n            <\/div>\r\n            <div class=\"totalpoll-question-choices-item-label\">\r\n                <span >No<\/span>\r\n            <\/div>\r\n        <\/div>\r\n    <\/div>\r\n<\/label>\r\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<label for=\"choice-6f66bd8d-149c-43bf-9c08-844c4c875935-selector\" tabindex=\"0\"\r\n       class=\"totalpoll-question-choices-item totalpoll-question-choices-item-type-text \" >\r\n    <div class=\"totalpoll-question-choices-item-container\">\r\n        \r\n\t\t        \r\n        <div class=\"totalpoll-question-choices-item-control\">\r\n            <div class=\"totalpoll-question-choices-item-selector totalpoll-question-choices-item-selector-single\">\r\n\t\t\t\t<input type=\"radio\" id=\"choice-6f66bd8d-149c-43bf-9c08-844c4c875935-selector\" name=\"totalpoll[choices][75e55f81-909a-4210-bc01-c7c5f81bf391][]\" value=\"6f66bd8d-149c-43bf-9c08-844c4c875935\">                <div class=\"totalpoll-question-choices-item-selector-box\">\r\n                    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"24\" height=\"24\" viewBox=\"0 0 24 24\">\r\n                        <use xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"#totalpoll-check-icon\"><\/use>\r\n                    <\/svg>\r\n                <\/div>\r\n            <\/div>\r\n            <div class=\"totalpoll-question-choices-item-label\">\r\n                <span >Not sure<\/span>\r\n            <\/div>\r\n        <\/div>\r\n    <\/div>\r\n<\/label>\r\n\t\t\t\t\t\t\t            \r\n\t\t\t            \r\n        <\/div>\r\n    <\/div>\r\n<\/div>\r\n    <\/div>\r\n<div class=\"totalpoll-form-hidden-fields\">\r\n\t<div class=\"totalpoll-form-page\"><div class=\"totalpoll-form-field-hidden\"><div class=\"totalpoll-form-field totalpoll-form-field-type-hidden totalpoll-column-full\"><div class=\"totalpoll-form-field-wrapper\"><input type=\"hidden\" name=\"totalpoll[screen]\" value=\"vote\" class=\"totalpoll-form-field-input\"><div class=\"totalpoll-form-field-errors\"><\/div><\/div><\/div><\/div><div class=\"totalpoll-form-field-hidden\"><div class=\"totalpoll-form-field totalpoll-form-field-type-hidden totalpoll-column-full\"><div class=\"totalpoll-form-field-wrapper\"><input type=\"hidden\" name=\"totalpoll[pollId]\" value=\"14091\" class=\"totalpoll-form-field-input\"><div class=\"totalpoll-form-field-errors\"><\/div><\/div><\/div><\/div><div class=\"totalpoll-form-field-hidden\"><div class=\"totalpoll-form-field totalpoll-form-field-type-hidden totalpoll-column-full\"><div class=\"totalpoll-form-field-wrapper\"><input type=\"hidden\" name=\"totalpoll[action]\" value=\"\" class=\"totalpoll-form-field-input\"><div class=\"totalpoll-form-field-errors\"><\/div><\/div><\/div><\/div><\/div><\/div>\r\n<div class=\"totalpoll-buttons\">\r\n\t<button type=\"submit\" name=\"totalpoll[action]\" value=\"results\" class=\"totalpoll-button totalpoll-buttons-results\">Results<\/button><button type=\"submit\" name=\"totalpoll[action]\" value=\"vote\" class=\"totalpoll-button totalpoll-button-primary totalpoll-buttons-vote\">Vote<\/button><\/div>\r\n<\/form><\/div><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Read about a proposed way to tackle the reproducibility crisis in research and accelerate scientific progress.<\/p>\n","protected":false},"author":2,"featured_media":14082,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"advanced_seo_description":"","jetpack_seo_html_title":"","jetpack_seo_noindex":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"How does failure to falsify influence the reliability of scientific research? @rajtmajer_sarah @eLife #reproducibility #MedComms #PubPlan","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_publicize_connection_overrides":[],"_wpas_customize_per_network":false},"categories":[3267153,343162575,16950752],"tags":[343162444,343162556],"class_list":["post-14078","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-reproducibility","category-research-integrity","category-data-transparency","tag-big-data","tag-reproducibility","post-has-thumbnail"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2023\/06\/Hypothesis-1.jpeg?fit=5184%2C3456&ssl=1","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p5Yk5l-3F4","jetpack_likes_enabled":true,"jetpack-related-posts":[],"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/posts\/14078","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/comments?post=14078"}],"version-history":[{"count":12,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/posts\/14078\/revisions"}],"predecessor-version":[{"id":14099,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/posts\/14078\/revisions\/14099"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/media\/14082"}],"wp:attachment":[{"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/media?parent=14078"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/categories?post=14078"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/tags?post=14078"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}