{"id":5449,"date":"2018-11-20T09:21:24","date_gmt":"2018-11-20T09:21:24","guid":{"rendered":"https:\/\/thepublicationplan.com\/?p=5449"},"modified":"2018-11-20T09:21:24","modified_gmt":"2018-11-20T09:21:24","slug":"are-meta-analyses-producing-more-controversy-than-answers","status":"publish","type":"post","link":"https:\/\/thepublicationplan.com\/2018\/11\/20\/are-meta-analyses-producing-more-controversy-than-answers\/","title":{"rendered":"Are meta-analyses producing more controversy than answers?"},"content":{"rendered":"<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" data-attachment-id=\"5450\" data-permalink=\"https:\/\/thepublicationplan.com\/2018\/11\/20\/are-meta-analyses-producing-more-controversy-than-answers\/data-monitoring-and-analysis\/\" data-orig-file=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2018\/11\/Meta-analyses.jpg?fit=706%2C494&amp;ssl=1\" data-orig-size=\"706,494\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;Getty Images\/iStockphoto&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;Data monitoring and analysis&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;Data monitoring and analysis&quot;,&quot;orientation&quot;:&quot;1&quot;}\" data-image-title=\"Data monitoring and analysis\" data-image-description=\"\" data-image-caption=\"&lt;p&gt;Data monitoring and analysis&lt;\/p&gt;\n\" data-medium-file=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2018\/11\/Meta-analyses.jpg?fit=300%2C210&amp;ssl=1\" data-large-file=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2018\/11\/Meta-analyses.jpg?fit=706%2C494&amp;ssl=1\" class=\"alignnone size-full wp-image-5450\" src=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2018\/11\/Meta-analyses.jpg?resize=706%2C494&#038;ssl=1\" alt=\"Meta analyses.jpg\" width=\"706\" height=\"494\" srcset=\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2018\/11\/Meta-analyses.jpg?w=706&amp;ssl=1 706w, https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2018\/11\/Meta-analyses.jpg?resize=300%2C210&amp;ssl=1 300w\" sizes=\"auto, (max-width: 706px) 100vw, 706px\" \/><\/p>\n<p>A <a href=\"https:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC3049418\/\" target=\"_blank\" rel=\"noopener\">meta-analysis<\/a> systematically assesses multiple scientific studies to derive conclusions on a specific research topic that may not be clear from individual studies alone. Meta-analyses are used to drive evidence-based decisions in medicine and are often considered to top the <a href=\"https:\/\/en.wikipedia.org\/wiki\/Hierarchy_of_evidence\" target=\"_blank\" rel=\"noopener\">hierarchy of evidence<\/a> for biomedical research. However, a recent <a href=\"http:\/\/www.sciencemag.org\/news\/2018\/09\/meta-analyses-were-supposed-end-scientific-debates-often-they-only-cause-more\" target=\"_blank\" rel=\"noopener\">article<\/a> by Jop de Vrieze published in <em><a href=\"http:\/\/science.sciencemag.org\/\" target=\"_blank\" rel=\"noopener\">Science<\/a><\/em> questions whether we should always trust the outcomes of these studies.<\/p>\n<p>Using the example of conflicting analyses reporting on the link between media violence and aggression, de Vrieze explores how meta-analyses may produce differing results due to the \u201cmany researcher degrees of freedom\u201d. For example, authors may opt to exclude certain study types or apply strict or loose quality criteria to their analyses. Furthermore, de Vrieze considers that author choices may be influenced by biases including financial or \u2018intellectual conflicts of interest\u2019, such as a preference to confirm what their own studies have previously shown or to align with certain policies.<\/p>\n<p>As the number of meta-analyses grows, from less than 1000 published in 2000 to 11,000 published in 2017, it may be time to think more carefully about how we conduct and interpret these studies. As described by de Vrieze, some believe that \u2018scientists shouldn\u2019t be involved in meta-analyses that include their own work\u2019, while others note that \u2018finding suitable authors for a meta-analysis is hard when the people with the most expertise in an area are excluded.\u2019 In controversial cases it may be helpful for research groups with opposing views to set up new analyses together. Overall, transparency is of the utmost importance, so that other researchers can fully understand how a particular outcome has been reached and duplicate the analysis if they wish. In this regard, guidelines such as <a href=\"http:\/\/www.prisma-statement.org\/\" target=\"_blank\" rel=\"noopener\">PRISMA<\/a>, which aim to improve the reporting of systematic reviews and meta-analyses, are key. Others argue it\u2019s time to go a step further and publish protocols before analyses are conducted and the results known.<\/p>\n<div data-opinionstage-embed-url=\"https:\/\/www.opinionstage.com\/api\/v1\/polls\/2527744\/code.json?width=\" style=\"display: none; visibility: hidden;\"><\/div>\n<p>\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2013<\/p>\n<p>Summary by\u00a0<a href=\"http:\/\/www.aspire-scientific.com\/#team_\" target=\"_blank\" rel=\"noopener\">Louise Niven, DPhil<\/a>\u00a0from\u00a0<a href=\"http:\/\/www.aspire-scientific.com\/\" target=\"_blank\" rel=\"noopener\">Aspire Scientific<\/a><\/p>\n<p>\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2014\u2013<\/p>\n<p>With thanks to our sponsors, <a href=\"http:\/\/www.aspire-scientific.com\/\">Aspire Scientific Ltd<\/a> and <a href=\"http:\/\/www.networkpharma.com\/\">NetworkPharma Ltd<\/a><\/p>\n<hr \/>\n","protected":false},"excerpt":{"rendered":"<p>A recent article from Science explores how meta-analyses may be less authoritative than they seem. <\/p>\n","protected":false},"author":1,"featured_media":5450,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"advanced_seo_description":"","jetpack_seo_html_title":"","jetpack_seo_noindex":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"Are meta-analyses producing more controversy than answers? @Jopdevrieze \u200f @sciencemagazine #PubPlan #medcomms #ISMPP #EMWA","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_publicize_connection_overrides":[],"_wpas_customize_per_network":false},"categories":[31272877,3267153,16950752],"tags":[343162457,343162527,343162526],"class_list":["post-5449","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-publication-planning","category-reproducibility","category-data-transparency","tag-bias","tag-meta-analysis","tag-prisma","post-has-thumbnail"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2018\/11\/Meta-analyses.jpg?fit=706%2C494&ssl=1","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p5Yk5l-1pT","jetpack_likes_enabled":true,"jetpack-related-posts":[],"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/posts\/5449","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/comments?post=5449"}],"version-history":[{"count":2,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/posts\/5449\/revisions"}],"predecessor-version":[{"id":5452,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/posts\/5449\/revisions\/5452"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/media\/5450"}],"wp:attachment":[{"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/media?parent=5449"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/categories?post=5449"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/thepublicationplan.com\/wp-json\/wp\/v2\/tags?post=5449"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}