NOTES: ChatGPT4's Current Ability to "Reason", & What Follows from That...

Time to actually try to create for myself an informed view on what the likely econo-societal effects of MAMLM—Modern Advanced Machine-Learning Models—will be. Wish me luck!…

Suppose I ask ChatGPT4 for a Chicago Manual of Style citation to one of my weblog posts <https://braddelong.substack.com/p/hoisted-from-the-archives-information>: what does it produce? This:

How is it doing? Well, the weblog post is this:

So, on the one hand, ChatGPT4 did very good. The word is that the format is supposed to be:

Pai, Tanya. 2017. “The Squishy, Sugary History of Peeps.” Vox, April 11, 2017. www.vox.com/culture/2……<https://www.chicagomanualofstyle.org/tools_citationguide/citation-guide-2.html>

ChatGPT4 “identifies” and slots lastname, firstname, title, website, and URL into the format. It does all of these correctly.

On the other hand, the date on the post is March 26, 2024 (or possibly September 3, 2001).

The date on the post is not March 14, 2023.

Where does the “March 14, 2023” that ChatGPT4 thinks is the date of the post come from?

Is the piece somehow very closely related to something I published on March 14, 2023? That was my first thought. But, looking back, I do not see how it could “think” so:


So what, then, is going on? Why did it do so well on the bulk of the problem. And, given that it had the computational and syntactic capability to do so well on the problem, from where did “2023” arise to overwrite the correct “2024”? And from where did “March 14” arise to overwrite the correct “March 26”?

The answer seems to be: We do not know. Nobody has much of an idea at all.

Read more