{"id":11348,"date":"2023-08-02T18:03:45","date_gmt":"2023-08-02T18:03:45","guid":{"rendered":"http:\/\/lonecandle.com\/?p=11348"},"modified":"2023-08-02T18:03:45","modified_gmt":"2023-08-02T18:03:45","slug":"even-the-scientists-who-build-ai-cant-tell-you-how-it-works","status":"publish","type":"post","link":"https:\/\/lonecandle.com\/?p=11348","title":{"rendered":"Even the scientists who build AI can\u2019t tell you how it works"},"content":{"rendered":"\n<p>\n\n&#8220;there\u2019s two connected big concerning unknowns. The first is that we don\u2019t really know what they\u2019re doing in any deep sense. If we open up ChatGPT or a system like it and look inside, you just see millions of numbers flipping around a few hundred times a second, and we just have no idea what any of it means. With only the tiniest of exceptions, we can\u2019t look inside these things and say, \u201cOh, here\u2019s what concepts it\u2019s using, here\u2019s what kind of rules of reasoning it\u2019s using. Here\u2019s what it does and doesn\u2019t know in any deep way.\u201d We just don\u2019t understand what\u2019s going on here. We built it, we trained it, but we don\u2019t know what it\u2019s doing.&#8221;<br>&#8230;<br>&#8220;The other big unknown that\u2019s connected to this is we don\u2019t know how to steer these things or control them in any reliable way. We can kind of nudge them to do more of what we want, but the only way we can tell if our nudges worked is by just putting these systems out in the world and seeing what they do. We\u2019re really just kind of steering these things almost completely through trial and error.&#8221;<br><a href=\"https:\/\/www.vox.com\/unexplainable\/2023\/7\/15\/23793840\/chat-gpt-ai-science-mystery-unexplainable-podcast\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/www.vox.com\/unexplainable\/2023\/7\/15\/23793840\/chat-gpt-ai-science-mystery-unexplainable-podcast<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;there\u2019s two connected big concerning unknowns. The first is that we don\u2019t really know what they\u2019re doing in any deep sense. If we open up ChatGPT or a system like it and look inside, you just see millions of numbers flipping around a few hundred times a second, and we just have no idea what any of it means. With only the tiniest of exceptions, we can\u2019t look inside these things and say, \u201cOh, here\u2019s what concepts it\u2019s using, here\u2019s what kind of rules of reasoning it\u2019s using. Here\u2019s what it does and doesn\u2019t know in any deep way.\u201d We just don\u2019t understand what\u2019s going on here. We built it, we trained it, but we don\u2019t know what it\u2019s doing.&#8221;<\/p>\n<p>&#8230;<\/p>\n<p>&#8220;The other big unknown that\u2019s connected to this is we don\u2019t know how to steer these things or control them in any reliable way. We can kind of nudge them to do more of what we want, but the only way we can tell if our nudges worked is by just putting these systems out in the world and seeing what they do. We\u2019re really just kind of steering these things almost completely through trial and error.&#8221;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[13],"tags":[1130,811],"class_list":["post-11348","post","type-post","status-publish","format-standard","hentry","category-article-share","tag-artificial-intelligence","tag-science"],"_links":{"self":[{"href":"https:\/\/lonecandle.com\/index.php?rest_route=\/wp\/v2\/posts\/11348","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lonecandle.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lonecandle.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lonecandle.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/lonecandle.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=11348"}],"version-history":[{"count":1,"href":"https:\/\/lonecandle.com\/index.php?rest_route=\/wp\/v2\/posts\/11348\/revisions"}],"predecessor-version":[{"id":11349,"href":"https:\/\/lonecandle.com\/index.php?rest_route=\/wp\/v2\/posts\/11348\/revisions\/11349"}],"wp:attachment":[{"href":"https:\/\/lonecandle.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=11348"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lonecandle.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=11348"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lonecandle.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=11348"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}