{"id":9688,"date":"2023-01-04T21:46:28","date_gmt":"2023-01-04T21:46:28","guid":{"rendered":"http:\/\/lonecandle.com\/?p=9688"},"modified":"2023-01-04T21:46:28","modified_gmt":"2023-01-04T21:46:28","slug":"lots-of-bad-science-still-gets-published-heres-how-we-can-change-that","status":"publish","type":"post","link":"https:\/\/lonecandle.com\/?p=9688","title":{"rendered":"Lots of bad science still gets published. Here\u2019s how we can change that."},"content":{"rendered":"\n<p>\n\n&#8220;For over a decade, scientists have been grappling with the alarming realization that many published findings \u2014 in fields ranging from psychology to cancer biology \u2014 may actually be wrong. Or at least, we don\u2019t know if they\u2019re right,because they just don\u2019t hold up when other scientists repeat the same experiments, a process known as replication.<\/p>\n\n\n\n<p>In a 2015&nbsp;<a href=\"https:\/\/science.sciencemag.org\/content\/349\/6251\/aac4716\" target=\"_blank\" rel=\"noreferrer noopener\">attempt<\/a>&nbsp;to reproduce 100 psychology studies from high-ranking journals, only 39 of them replicated. And in 2018,&nbsp;<a href=\"https:\/\/osf.io\/ux3eh\/\" target=\"_blank\" rel=\"noreferrer noopener\">one effort<\/a>&nbsp;to repeat influential studies found that 14 out of 28 \u2014 just half \u2014 replicated. Another&nbsp;<a href=\"https:\/\/www.nature.com\/articles\/s41562-018-0399-z.epdf?sharing_token=uY-7XXSwrYqjnTaF4k_LwdRgN0jAjWel9jnR3ZoTv0ODPoD_DniKOJV85YbvYREV4WYg3rUMkw4Dn3xQpiS36ewTQMztGsmzwDVhiD6qsOTincMm_6MNx3iVweaC-Br4IKcK_J1FMyo7gekrMG0IwJjMkUbPoOOsXV_plU0uyaUh7wihjHJ-UQu1bguEiZfqnqN7NTFPQt3C_0QoV-oKp432nRQ5ffc2UA5BY90g4iK0ZBBYY3dUcr_5QiA4dJ4hgldAHBXR-Z59rVmKtU6W1S9mmQWSK2UkVcSsp-mF6XUa0m236lCGYzIleP_2BSiM77pjx_WrxRWf5SrVCGJ5L535khtcNZ8XtAIl7bwr98I%3D&amp;tracking_referrer=www.theatlantic.com\" target=\"_blank\" rel=\"noreferrer noopener\">attempt<\/a>&nbsp;found that only 13 out of 21 social scienceresults picked from the journals&nbsp;<em>Science<\/em>&nbsp;and&nbsp;<em>Nature<\/em>&nbsp;could be reproduced.<\/p>\n\n\n\n<p>This is known as the \u201c<a href=\"https:\/\/www.vox.com\/2016\/3\/14\/11219446\/psychology-replication-crisis\" target=\"_blank\" rel=\"noreferrer noopener\">replication crisis<\/a>,\u201d and it\u2019s devastating. The ability to repeat an experiment and get consistent results is the bedrock of science.&#8221;<\/p>\n\n\n\n<p>&#8230;<\/p>\n\n\n\n<p>&#8220;This is where the&nbsp;<a href=\"https:\/\/replications.clearerthinking.org\/\" target=\"_blank\" rel=\"noreferrer noopener\">Transparent Replications project<\/a>&nbsp;comes in.<\/p>\n\n\n\n<p>The project, launched..by the nonprofit Clearer Thinking, has a simple goal: to replicate any psychology study published in&nbsp;<em>Science<\/em>&nbsp;or&nbsp;<em>Nature<\/em>&nbsp;(as long as it\u2019s not way too expensive or technically hard). The idea is that, from now on, before researchers submit their papers to a prestigious journal, they\u2019ll know that their work will be subjected to replication attempts, and they\u2019ll have to worry about whether their findings hold up. Ideally, this will shift their incentives toward producing more robust research in the first place, as opposed to just racking up another publication in hopes of getting tenure.&#8221;&nbsp;<\/p>\n\n\n\n<p><a href=\"https:\/\/www.vox.com\/future-perfect\/23489211\/replication-crisis-project-meta-science-psychology\">https:\/\/www.vox.com\/future-perfect\/23489211\/replication-crisis-project-meta-science-psychology<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;For over a decade, scientists have been grappling with the alarming realization that many published findings \u2014 in fields ranging from psychology to cancer biology \u2014 may actually be wrong. Or at least, we don\u2019t know if they\u2019re right, because they just don\u2019t hold up when other scientists repeat the same experiments, a process known as replication.<br \/>\nIn a 2015 attempt to reproduce 100 psychology studies from high-ranking journals, only 39 of them replicated. And in 2018, one effort to repeat influential studies found that 14 out of 28 \u2014 just half \u2014 replicated. Another attempt found that only 13 out of 21 social science results picked from the journals Science and Nature could be reproduced.<\/p>\n<p>This is known as the \u201creplication crisis,\u201d and it\u2019s devastating. The ability to repeat an experiment and get consistent results is the bedrock of science.&#8221;<\/p>\n<p>&#8230;<\/p>\n<p>&#8220;This is where the Transparent Replications project comes in.<\/p>\n<p>The project, launched..by the nonprofit Clearer Thinking, has a simple goal: to replicate any psychology study published in Science or Nature (as long as it\u2019s not way too expensive or technically hard). The idea is that, from now on, before researchers submit their papers to a prestigious journal, they\u2019ll know that their work will be subjected to replication attempts, and they\u2019ll have to worry about whether their findings hold up. Ideally, this will shift their incentives toward producing more robust research in the first place, as opposed to just racking up another publication in hopes of getting tenure.&#8221;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[13],"tags":[811,48],"class_list":["post-9688","post","type-post","status-publish","format-standard","hentry","category-article-share","tag-science","tag-studies"],"_links":{"self":[{"href":"https:\/\/lonecandle.com\/index.php?rest_route=\/wp\/v2\/posts\/9688","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lonecandle.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lonecandle.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lonecandle.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/lonecandle.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=9688"}],"version-history":[{"count":1,"href":"https:\/\/lonecandle.com\/index.php?rest_route=\/wp\/v2\/posts\/9688\/revisions"}],"predecessor-version":[{"id":9689,"href":"https:\/\/lonecandle.com\/index.php?rest_route=\/wp\/v2\/posts\/9688\/revisions\/9689"}],"wp:attachment":[{"href":"https:\/\/lonecandle.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=9688"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lonecandle.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=9688"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lonecandle.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=9688"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}