My weekly read-around…
Share
ONE VIDEO: The Key Technology of the Commercial-Imperial Age & of the Columbian Exchange:
Share Brad DeLong’s Grasping Reality
ONE AUDIO: Simn Willison, Brian McCullough, & Sean Wang on the State of the GPT LLM Union:
The great Simon Willison joins SWYX and I to talk about everything we learned about LLMs in 2024, and what the state of AI is generally, as we go into 2025…
<https://www.ridehome.info/show/techmeme-ride-home/bns-simon-willison-and-swyx-tell-us-where-ai-is-in-2025/> <https://simonwillison.net/2024/Dec/31/>
Leave a comment
ONE IMAGE: A Very Much Non-Laissez Faire Economy:
Market, state, & regulation in the Roman Empire…
Refer a friend
Very Briefly Noted:
(1) Public Reason: One way of looking at the Neoliberal Order is that it was the era in which people thought that the skeleton key to understanding societal reality was contained in Seven Pillars of Economic Wisdom: (1) opportunity costs, (2) incentives, (3) alignment of private profit with public societal well-being, (4) then prices carry all the information you need, (5) think systemically and about equilibrium, (6) light demand-management planning by central banks, & (7) A.C. Pigou will save us by teaching us how to use taxes & subsidies to compensate for externalities. And things went so wrong during the Neoliberal Order/Globalized Value-Chain Economy Era because (6) and (7) were casually, callously, & catastrophically thrown over the side by a sinister alliance of plutocrats, predatory grifters, & partisans of right-neoliberalism.
I tend to think that way when the Moon is in the 9th House of Sagittarius.
But Dan Davies thinks different—he thinks the problem was not throwing concern over aggregate demand externalities & Pigovian externalities (& wealth-distribution externalities) over the side. He thinks that the problem is with Economics as a discipline: that it assumes that the market system is capable of transmitting enough bandwidth for homeostatic societal regulation, and that that is false. Instead, he thinks, society needs to be managed by people steeped not in Economics but in Cybernetics:
Dan Davies: Taming the unaccountability machine: ‘“Public choice cybernetics” for the 21st century…. Before… Thatcher and Reagan years, people used to complain that government bureaucracy was monolithic, inefficient, and unaccountable. Today… a strange network of bureaucrats, agencies, and private sector providers… fragmented, dysfunctional, and unaccountable…. Outsourcing and delegation… brought neither cost savings nor improvements in delivery…. Lacking are… “accountability” and “capacity” – the ability of the state to respond to feedback and make changes in response to it…. There is no very complicated or intractable problem of the state’s ability to command real resources or physical objects. The problems we keep facing relate to its ability to process information – to reliably make good decisions based on the state of the world in which it finds itself….
Twentieth-century… public choice is based on… (1) Incentives matter and must be made compatible…. (2) Opportunity cost must be used for measuring success or failure…. (3) Outcomes are to be judged systemically and in equilibrium… [taking account of] second-order and longer-term consequences….
Public sector agencies… outsourcing… have a nest of information problems. They are required to buy an underspecified non-commodity…. Information about the true nature of their needs and what they have purchased is revealed… outside their organizational boundaries… an ongoing problem of “not learning by not doing”… [as] public sector… understanding degrades, which affects its ability to successfully manage the consultancy relationship, never mind the actual service….
The true problem of public services is… the difficulty of establishing accountability and control in a system where the people who are meant to be managed have more information than you do. Methods… change; what they all have in common… [is] reducing the… information to… the bandwidth available to process it… “make things manageable”, while preserving a sufficiently accurate representation of the system so… control decisions… correspond to workable solutions…. Considering the relationship between the state and the consulting/outsourcing nexus as a “cybernetic” problem – one of information and control – gives us a way to understand and think about the tradeoffs in the design of contractual arrangements….
Customers and users have one huge cognitive advantage… which is that they live in the real world, rather than a representation or model of that world made out of standardised reports and collated data points…. [In] governance systems which are viable… there… [must] ways for their perspective to be communicated. Otherwise, we are destined to gradually drift away from reality without noticing it, until catastrophe results… <hypertext.niskanencente…>
But what, then, when the rubber hits the road, are the Seven Pillars of Wisdom of Cybernetics?
<https://substack.com/@delongonsubstack/note/c-85988439>
(2) Neofascism: Literally, not figuratively: Rudi Giuliani is, in the minds of the Free Press, a successful politician not because he actually did anything or made any difference on 911 but just because he “stayed on the scene”, “leading”. The first job of the government is not to keep people safe: it is to work for the people to make them powerful—able to do what they want to do—which may involve obsessing about their safety, and may not. The second job of the government is not to pretend that “someone is in charge when crisis erupts”: it is to actually deal with the crisis and solve the problem. It is not Gavin Newsome’s job to tell lies about currently unclear aspects of the current Santa Ana wind catastrophe in Los Angeles. Yet the editors of “The Free Press” think that that is his job.
You want a definition of a fascist mindset? The idea that the government should above all “keep people safe” and “pretend to be in charge and have the situation under control” is a good one:
The Editors of “The Free Press”:’The first job of the government is to keep people safe. Failing that, its job is to show that someone is in charge when crisis erupts. On 9/11, there was nothing then–Mayor Rudy Giuliani could do to keep the World Trade Center from falling. Yet he became, in that long-ago era, the most popular person in America by staying on the scene and leading at his city’s moment of greatest danger.
That brings us to the fires in Los Angeles…. Aauthorities have failed not only at protecting its residents but at inspiring confidence that they had the situation in hand…. This is a story about the failure of California to prevent, or capably mitigate, a long-predicted catastrophe, and how a state that was once a model of good governance came to prioritize the boutique concerns of ambitious politicians over the basics of what government must do….
California loves to spend, increasingly moving toward a model of governance where good money constantly chases after bad…. Newsom also made California the first state to have its Medicaid program cover illegal immigrants. This blatant sop to progressive activists is now expected to cost Californians $6.5 billion a year.
Los Angeles has the same problem with nonessential spending, albeit at a smaller scale, The city allocated $1.3 billion to combat homelessness last year, although the city comptroller found that half of that money has gone unspent. The Los Angeles Fire Department got a good deal less than that—$837 million—a budget that has since been cut by $17 million. Would that $17 million have made a difference? Who knows. Answers are increasingly hard to come by in California. When asked by Anderson Cooper why the fire hydrants in the Pacific Palisades had run dry, Newsom responded that “the local folks are trying to figure that out.” The buck always stops somewhere else in the Golden State….
California seemingly always has money for expensive Band-Aids and pricey, ineffective NGO grants. But they’ve neglected the basics: crime (the murder rate is up more than 15 percent since Newsom took office); public education (per-pupil spending has gone up under Newsom even as test scores have plummeted); and now firefighting… <thefp.com/p/paradise-lo…>
And the claim that Newsome has “neglected the basics” by increasing school funding?
<https://substack.com/@delongonsubstack/note/c-85977771>
(3) CyberGrifters: I won’t even say that Mark Zuckerberg is talking his book here. I will say that this seems to be someone whose adrenaline-rage emotional cycles have taken over his brain, and that there is no longer a system in place inside Facebook that can use the communications staff and the ability to think long-term about how a boss and figurehead of a large production-network should behave. Jon Gruber is scornful, I think appropriately:
Jon Gruber: Zuckerberg Disses Apple With Joe Rogan: ‘They Haven’t Invented Anything Great in a While’: ‘
Chance Miller <9to5mac.com/2025/01/10/… listened so we don’t have to: “Zuckerberg also took issue with AirPods and the fact that Apple wouldn’t give Meta the same access to the iPhone for its Meta Ray-Ban glasses: ‘They build stuff like AirPods, which are cool, but they’ve just thoroughly hamstrung the ability for anyone else to build something that can connect to the iPhone in the same way. There were a lot of other companies in the world that would be able to build like a very good earbud, but Apple has a specific protocol…. They don’t let anyone else use the protocol. If they did, there would probably be much better competitors to AirPods out there…’”
If only there existed other phone platforms than the iPhone, we could see how cool these other earbuds would be. And Meta Ray-Bans could integrate with those phones in super cool ways that would make iPhone users realize what dopes they’ve been. What’s really rich about… Zuckerberg’s incessant complaining… is that Meta doesn’t allow third parties any sort of acces…. It is very hard to get any information out of them let alone integrate….
Miller concludes: “Let us also not forget that Meta has never ‘invented anything great.’ Oculus was an acquisition, WhatsApp was an acquisition, Instagram was an acquisition, and intermixed with those acquisitions are features copied and pasted from other platforms.” Yeah but other than that they invented a lot… <daringfireball.net/link…>
I frequently say that Silicon Valley firms and networks are important for society first as technology-forcers, second as stakeholder-production-networks, and third as savings vehicles. And I frequently say that one of Silicon Valley’s big problems is that it is and firm management in it is increasingly focused on firms and networks as different things: bouncing balls in casino roulette wheels and pledges of allegiance to culturo-technoid-bro movements and leaders. Facebook, however, is somewhat different: I have seen it as a zero as a technology-forcer, and as a negative—well, that is not fair, as a likely negative in a VAR sense—as a stakeholder-production-network. As best as I can see, its business model is to make as much money as it can be degrading user experience to the point where the network effects that drive its dominance almost but do not quite collapse. We’ve seen this for Facebook and Instagram, I don’t know WhatsApp, and it seems that we are about to see it with Threads.
<https://substack.com/@delongonsubstack/note/c-85639670>
(4) Fiction: In Jane Austen’s novel Pride & Prejudice, heroine Lizzy Bennet contemplates or is forced to contemplate marriage with three men—Messers. Fitzwilliam Darcy, George Wickham, & William Collins. As A. Natasha Joukovsky puts it <joukovsky.substack.com/…>, Darcy is a king, Wickham is a dog, and Collins is a jester.
But who is the jest really on?
William Collen points out a defense of Mr. Collins:
Joy Marie Clarkson: Why We Should (gasp) Envy Mr. Collins: ‘There is a simplicity to Mr. Collins that I admire and enjoy. He lives in a small and imperturbable world where all that matters is Fordyce’s sermons, the securement of a wife for the increase of his happiness, and the distinguished patronage of Lady Catherine de Bourgh. And while we’re all laughing at him, Mr. Collins lives in a state of domestic felicity, blessed with a stable life, a meaningful job, and excellent in-laws, satisfied with the choices he has made in life…. Mr. Collins has a lucky life, and many things to be thankful for. Not everyone is so fortunate as to secure the venerable patronage of a person like Lady Catherine de Bourgh, or to inherit such a fine estate as Longbourn….
Mr. Collins is a lucky fellow, but he also has the constitution to enjoy it. Through either personality or practice, he has developed a habit of regarding life in a way that enables him to enjoy it. He makes it a point to notice the things in his life about which he is pleased. And there is no joy too small to celebrate. Be it boiled potatoes, the windowpanes at Rosings, or the momentous advent of shelves in a closet, Mr. Collins gives himself over to delight. To put it simply: he has cultivated thankfulness….
The closest I come to despising Mr. Collins… is… his sloppy and conceited proposal… [to] Elizabeth [Bennet]…. [But] he was doing right by his cousins. Because he stood to inherit the estate, finding a wife amongst the Bennets would have ensured that none of Lizzy’s four siblings or mother would have to be turned out upon Mr. Bennet’s death. So, he simply surveyed the sisters and picked the best one….
Though Lizzy [Bennet]’s initial rejection [of his marriage proposal] may have stung, Mr. Collins should count his blessings, for they are plenteous. And you know what’s great? I know he will count his blessings! Perhaps even after all this you will still insist that Mr. Collins is laughable, and I would say that there is one more lesson that we have to learn from him: do not care too much of what other people think of you. Do not care even if they think your life is silly. While we all laugh and chortle about how weird he is, Mr. Collins is living his best life now. Mr. Collins has the last laugh… <plough.com/en/topics/cu…>
This is, I think, one of the places of extraördinary depth in Pride & Prejudice. The novel—both the authorial voice and the heroine viewpoint—mocks and scorns both Mr. Collins and Mrs. Bennet as irretrievably and painfully gauche, annoying, and foolish. And certainly there is no way in hell that Elizabeth Bennet could have had a happy marriage with William Collins.
But there is a level at which it is Lizzy Bennet who is the fool, and Mr. and Mrs. Collins who do indeed manage to achieve their goals and truly live their best life. He is indeed very fortunate indeed to win the hand of Charlotte Lucas, the venerable patronage of Lady Catherine de Bourgh, and the inheritance of Longbourn, he knows it, and he is deeply grateful and satisfied. And as for Mrs. Bennet, she attains the height of human felicity (save for unfortunate son-in-law Wickham):
“Good gracious! Lord bless me! only think! dear me! Mr. Darcy! Who would have thought it? And is it really true? Oh, my sweetest Lizzy! how rich and how great you will be! What pin-money, what jewels, what carriages you will have! Jane’s is nothing to it—nothing at all. I am so pleased—so happy. Such a charming man! so handsome! so tall! Oh, my dear Lizzy! pray apologize for my having disliked him so much before. I hope he will overlook it. Dear, dear Lizzy. A house in town! Everything that is charming! Three daughters married! Ten thousand a year! Oh, Lord! what will become of me? I shall go distracted…. My dearest child! I can think of nothing else. Ten thousand a year, and very likely more! ’Tis as good as a lord! And a special licence—you must and shall be married by a special licence…”
<https://substack.com/@delongonsubstack/note/c-85433628>
(5) Global Warming: The LA Times has satellite photos of the aftermath of the LA fires. Yes, this—global warming—is going to be very expensive. And distributing the costs and keeping insurers in the building as right-wing politicians try to make political hay about the rootless cosmopolites located in Bermuda—that is going to be very fraught:
Terry Castleman: “Shocking before-and-after satellite images show destruction of Malibu and Altadena neighborhoods”: ‘The image below shows a famous strip of Malibu homes <latimes.com/california/…> sandwiched between Pacific Coast Highway and the ocean just west of Topanga Beach.
And the kid—the family insurance expert—is in the picture:
“The first step for affected homeowners is to focus on personal safety, as well as the safety of family and any pets, according to Michael DeLong, a research and advocacy associate at the Consumer Federation of America, a consumer advocacy group. After that, homeowners should contact their insurer as soon as possible. When it’s safe to return home, take photos and videos and start a journal to document the damage. Policyholders should also document every interaction with their insurance company and track their expenses. DeLong suggests keeping receipts for temporary housing, food costs and any initial repairs. If a homeowner does decide to take on immediate repairs, they should vet any adjustors or contractors before hiring and make sure they are licensed. “Unfortunately, post-disaster scams are pretty common <consumerfed.org/press_r…> DeLong said. If a homeowner believes their insurance company is mishandling their claim, DeLong said they should contact the California Department of Insurance. The agency’s website <consumerfed.org/press_r…> where homeowners can file complaints. Looking forward, DeLong suggests homeowners take measures to mitigate future wildfire risks. Steps like installing a roof with noncombustible coverings or clearing away flammable vegetation near a home can limit the damage. “That may cost money in the short run, but it will save you money in the long run. In fact, it could actually save your home and even your life,” DeLong said. “The problem is that doing all these measures takes time and money and effort. And for people living paycheck to paycheck, that’s really hard to do”… <usatoday.com/story/mone…>
And:
Michael DeLong, research and advocacy associate at the Consumer Federation of America, told Common Dreams Wednesday that while climate-driven extreme weather has “made many areas riskier to insure,” insurance companies are also canceling policies because “they’re trying to take advantage of the situation of rising risks and rising costs to weaken consumer protections.” “They’ve been waging a campaign against Proposition 103 <consumerwatchdog.org/pr…> a ballot initiative that got passed in the late 1980s that, among other things, puts in place a lot of consumer protections about insurance,” he added. “This has been a big deal for consumers and it’s helped keep rates down. But insurance companies really hate these consumer protections and have been trying to weaken them.”… California Insurance Commissioner Ricardo Lara… DeLong said Lara is “allowing the net cost of reinsurance to be passed on to consumers…. Until a few weeks ago, California’s regulations didn’t allow the cost of reinsurance to be passed on to consumers, and now they do,” DeLong explained. “So that’s probably going to drive up costs for consumers. The commissioner and the department say it’s going to make the insurance industry more stable—we’re kind of skeptical of that.” “Another reform that he’s done is allowing the use of catastrophe models in insurance,” DeLong added, referring to a risk management tool that helps insurers assess potential financial impacts of disasters. “Every other state allows insurance companies to use them; California did not until recently. Catastrophe models can be helpful and useful; the problem is that many catastrophe models aren’t that good; they’re based on inaccurate or incomplete information and they don’t have any transparency.”… As coverage becomes more difficult to obtain, hundreds of thousands of California homeowners have turned to the state’s FAIR Plan an insurer of last resort…. “If the FAIR Plan is the only thing you can do, take that,” DeLong said. “In the meantime, you can reach out to the Department of Insurance and let them know that you want them to protect consumers and reject excessive rate increases. You can also try mitigation measures <consumerwatchdog.org/pr…> to reduce risk, like clearing brush around your home, improving your roof so it’s a Class A roof, which means it’s very difficult to catch on fire, you can take measures to prevent embers from starting fires on your property,” he added. “The problem is that all of that costs money, and not everyone may be able to afford that… California has recently started some proposals to provide grants to consumers to undertake these measures, and these should be expanded even more…. There is some good news,” DeLong said. “The California Department of Insurance is working on a public catastrophe model, one that would have opportunities for input from consumers, that would be based on data that’s fair and open…. However, that’s going to take at least a couple of years to get off the ground,” he added… <commondreams.org/news/c…>
<https://substack.com/@delongonsubstack/note/c-85315531>
(6) Epiphany: Why tell a story about Iranian fire-priests (or even astrologers)? What place do they have in a story of the birth of the Anointed One of the Storm God of the Semites? Yes, the parallel with Balaam. Yes, the point that the magi give homage while the priests and the scribes do not, while the reigning king of Judah tries to kill him. But still… It comes out of left field, and then vanishes back into left field again. What did Matthew think he was doing as a matter of book-writing?
Ἐλθόντες δὲ Ἰησοῦ γεννηθέντος ἐν Βηθλεὲμ τῆς Ἰουδαίας ἐν ἡμέραις Ἡρῴδου τοῦ βασιλέως, ἰδοὺ μάγοι ἀπὸ ἀνατολῶν παρεγένοντο εἰς Ἱεροσόλυμα…
Elthontes de Iēsou gennēthentos en Bēthleem tēs Ioudaias en hēmerais Hērōdou tou basileōs, idou magoi apo anatolōn paregenonto eis Hierosolyma…
It having came about that Iesus was born in Bethlehem of Judea in the days of Herod the king, behold, magi from the east came to Jerusalem…
<https://substack.com/@delongonsubstack/note/c-85149379>
(7) History & Cognition: Is there a more un-Confederate book in the 1800s than Victor Hugo’s Les Misérables? And yet we are told that Confederate prisoners in Union prison camps gave themselves nicknames like “Gavroche” and “Cosette”. We are told that Confederate soldiers in Robert E. Lee’s Army of Northern Virginia—the same soldiers who rounded up free Blacks in Pennsylvania during the Gettysburg campaign and sold them south as slaves—called themselves “Lee’s Miserables”:
Victor Hugo: “Preface to Les Misérables”: ‘So long as there shall exist, by virtue of law and custom, decrees of damnation pronounced by society, artificially creating hells amid the civilization of earth, and adding the element of human fate to divine destiny; so long as the three great problems of the century—the degradation of man through pauperism, the corruption of woman through hunger, the crippling of children through lack of light—are unsolved; so long as social asphyxia is possible in any part of the world;—in other words, and with a still wider significance, so long as ignorance and poverty exist on earth, books of the nature of Les Misérables cannot fail to be of use… -Victor Hugo, HAUTEVILLE HOUSE, 1862… <archive.org/details/les…>
And:
W.B. Houghton & M.B. Houghton: Two Boys in the Civil War & After: ‘After Lee’s army had recoiled from the rock-bound heights of Gettysburg, and, cumbered with its wounded, had slowly made its way… we went into camp behind the Rappahannock, near Chancellorsville… where we remained… resting and recruiting…. Camp duties were light, and especial pains were taken to feed us well. I remember well that we took special pride in a dinner our mess gave one day, in which the principal dish was a pot of forty-two apple dumplings, served with sauce made of butter, sugar, and apple brandy. It was a red letter day for us, and the fortunate guests were looked upon as pampered epicures. The sutler’s stores supplied playing cards, books of all kinds began to circulate, and we took our ease under the shade of the forest, played whist and euchre or read Macaria, Les Miserables, or Scott’s novels, or slept, or dreamed away existence, not knowing what hour might call us to face danger again… <antietaminstitute.org/h…>
And:
David T. Dixon: “Les Misérables, the American Civil War, & Violent Revolution”: ‘Most Confederate soldiers were reading editions of Les Misérables published in the South that conveniently excised passages lionizing John Brown or promoting abolition and purposely mistranslated the French word esclavage for “slavery” as “degeneracy.”Thus, rebel soldiers could imagine themselves taking the moral high ground as real-life heroes, fighting for independence against the cruel despot Lincoln… <emergingcivilwar.com/20…>
====
References:
Dixon, David T. 2023. “Les Misérables, the American Civil War, & Violent Revolution”. Emerging Civil War, August 20. <emergingcivilwar.com/20…>.
Houghton, W. R., & M. B. Houghton. 1912. Two Boys in the Civil War & After. Montgomery, AL: Paragon Press. <archive.org/details/two…
Hugo, Victor. 1862. Les Misérables. Brussels: A. Lacroix, Verboeckhoven. <archive.org/details/les…>.
<https://substack.com/@delongonsubstack/note/c-85144560>
(8) Cognition: “Active reading” has long been THE way that those super-skilled in utilizing the technologies of writing and printing we have had for 5000 and 500 years, respectively, to supercharge the intellectual powers these technologies enable. It is in sharp contrast to passive readings, in which the words wash over you—as in listening to a speech, but with your eyes rather than your ears. This form of passive reading has all the flaws Platon’s Sokrates puts in the mouth of King Thamos in his response to the God Theuth in the “Phaidros”—that it creates the trompe l’oeil appearance of thinking, but not the reality. (Not said in the Phaidros, but a subtext in much of Platon, is that the speechifyin’ rhetoric of the sophist suffers from much the same problem: rather than helping you think, the speeches of the demagogue drive you like cattle to his desired conclusion).
In active reading, however, you are the master of the book. You dogear pages to return to them. You flip back and you flip forward. You write in the margins. And so, in fact, the good active reader will argue with the book: will take the codex, spend maybe three or four hours interacting with it, and from the black marks on the page spin up a sub-Turing instantiation of the author’s mind, run it on their own wetware, and have in their mind’s eye—and who is to say that is not as real as the actual eye—a Sokrates on the other end of the log, answering questions. As Machiavelli wrote in 1513, when he goes into his library: “I step inside the venerable courts of the ancients… where I am unashamed to converse with them and to question them about the motives for their actions, and they, out of their human kindness, answer me…”.
But for only a small slice of society, only for the truly hyperliterate, is it the case that they—we—have managed to train our brains to make active reading second nature. The rest of humanity cannot do it.
The right use of GPT LLM technology is to provide a route-around: rather than having to train yourself for years to become a hyperliterate active reader and spinner-up of sub-Turing instantiations of authors’ minds, you can have a dialogue with Sub-TuringAuthorBot™:
Alex Tolley: ‘There is a perfectly profitable market for bespoke information - books, textbooks, taught courses. The relevant intelligences behind these artifacts are authors, teachers, etc. Publishers are already adding media interfaces to these works - CD inserts, eTextbook links to online tests, etc. Publishers should find it easy to add value by grafting on AIs to summarize material and arguments for both individual books and aggregate books (e.g. for a subject)., as well as teachers doing the same for the aggregate materials for a course. This strikes me as the better way to go, and then the many competing domain-specific AIs can be rated, just like authors.
As for the current high market cap values and well-paid “leaders”, I couldn’t care less about their fortunes. Their hubris went for huge sums to achieve the AGI and superintelligent AI goals. It looks like that was a bridge too far, and that a bust will happen. Nemesis. We will be better off without AIs with the possible existential threat of the fictional “Colossus” computer. Bespoke AI assistants will better meet humanity’s needs, by becoming “bicycles for the mind” for each domain. Consider the recent doorstop econ books, including yours. It is large, yet you admit you had to pare it down. An AI trained on the totality of material could become a tutor, both summarizing the arguments and fleshing them out where desired. Even better would be an AI that could answer questions beyond the material, explaining why certain approaches were taken rather than others. The result might be a richer experience for the interested reader. It’s more like a multi-track video game than a linear movie. [Also movies are now sold with director voiceover tracks to explain the director’s thoughts as the movie unfolds. Multiple voices are preferable to one overarching voice in most subjects, whether science or arts. Domain-specific AIs could be a useful interface for books and other media, and their competing voices would allow for variety and potential progress. [Competing AIs in a political debate might shed more light than rhetorical heat in these debates, with facts rather than misinformation and slogans in a good debate.]
Let’s not forget that LLMs, however hooked up to RAGs, are just the current AI technology. They are unlikely to be the last. Ideally, they should be as flexible as a human mind, with infinitely better recall, low resource use, and preferably better logical analysis of the data before responding. Less like the drunk at the bar mouthing off an opinion, and more like an expert with lower latency deliberation. IOW, intelligent experts on tap. [I appreciate this can all be gamed, but I prefer that the technology is accessible to the many, rather than the few, or the one]…
“Back up, and train a GPT LLM as a summarization engine on an authoritative set of information both through pre-training and RAG, and so produce true natural-language interfaces to structured and unstructured knowledge databases. That would be wonderful. But it is best provided not by building a bigger, more expensive model but rather by slimming down to keep linguistic fluency while reducing costs. Moreover, that would be profitable to provide: it would essentially be performing the service of creating a bespoke intellectual Jeeves for each use case. Doing that would produce profitable businesses. But it would not validate $3 trillion corporate market cap expectations…”
<https://substack.com/@delongonsubstack/note/c-84960634>
(9) MAMLMs: I take your point to be that much smaller LLMs than we already have are more than sufficient as natural-language front-ends to structured and unstructured data, and that the Royal Road is then applying those as queries to well-curated databases. That would imply that spending more money on LLMs is simply a waste of time. That is a very intriguing and, I think, quite possibly correct conclusion. A bigger and more complicated LLM would then just get us a slightly refined interpolation function from the space of training data prompts to the space of answers. And to the extent that those corpori are unreliable, you have not gotten anything extra:
Marcelo Rinesi: ‘“Keep building bigger and more expensive models, but then thwack them to behave by confining them to domains—Tim Lee says coding, and mathing—where you can automate the generation of near-infinite amounts of questions with correct answers for reinforcement learning. That would be a tremendous boon for programmers and mathematical modelers. But expensive…”
I don’t understand this claim. I.e. what DeepMind did for math Olympiads [ deepmind.google/discove… ] used the purely linguistic skills of a LLM to formalize problems and then applied (comparatively very lean, pun not intended) specialized engines to work on them.
To my eyes that shows that coding and maths are areas where we can/should/will get advantages from AI by using LLMs to bridge between informal language and specialized tooling (which I think we can do with much smaller specialized models than what we already have) and then leveraging existing hardware and software tools to build non-LLM models for those domains; basically LLMs as parsers and things like AlphaZero-for-maths/-quantum chemistry/-etc as domain-specific compilers.
I’m not saying the intellectual Jeeves isn’t a good idea or business model, but that’s like using electrical power only to use a conveyor belt to move pieces from manual workstation to manual workstation.
<https://substack.com/@delongonsubstack/note/c-84785604>
(10) Financial Overexuberance: A S&P 500 price-to-book ratio greater than at the start of 2000 is certainly something. Perhaps it is time for Kevin Hassett to repeat his prediction back then that the required real rate of return on equities is about to drop to 1%/year and so (getting even the math of that wrong) equities are going to quintuple in the next half-decade?:
Torsten Slok: “Price-to-Book Ratio for the S&P 500 at All-Time Highs”: ‘This is another piece of evidence that stocks are expensive at the moment… <apolloacademy.com/price…>
And:
Alexandra Scaggs: “Stocks are expensive, and nobody cares”: ‘We’ve reached an alarming, albeit entertaining, stage of any stock market rally: Motivated reasoning and justification. Not only are well-known bears capitulating, but banks are publishing research notes about how this time is really really different, which we’ve heard is always a good sign. Like this note from UBS’s equity strategists this week: “While it is easy to portray lofty multiples as a bearish harbinger, we believe investors would be better served by exploring the reasons for these elevated levels…”. The bank argues the S&P 500 should be trading at a price that’s 22 times next year’s earnings, well above the long-term average of 17. And it lists four reasons that this state of denial bullishness should continue…. Tech [is]… better ad growthier…. Compare… to free cash flows [rather than earnings]…. Narrow spreads to Treasuries… keeping… cost of borrowing low… No recession in sight… <ft.com/content/3ef45d04…>
And:
John Hussman: “New eras, same bubbles: the forgotten lessons of history”: ‘With US equities at record valuation peaks, investors should re-examine their risk appetite…. Similar to its predecessors, this speculative episode has been accompanied by exuberant sentiment about innovation-led growth, perpetual expansion in profits, and a tendency among investors to root expectations about economic and investment prospects in optimism. As The Business Week observed in 1929: “This illusion is summed up in the phrase ‘the new era’. The phrase itself is not new. Every period of speculation rediscovers it…” <ft.com/content/abec3526…>
And:
Edward Harrison: “U.S. Equities Are Euphoric Despite Inflation to Come”: ‘Consumer price inflation… exclud[ing] food and energy… 3.3% through November. After Trump takes office next month, tariff and deportation plans may push levels higher…. Yet market sentiment is euphoric…. [Jim] Reid says “US consumers have never felt so optimistic about gains in the stock market over the next 12 months, eclipsing anything we saw around 2000” when the Internet Bubble was raging. What are we to make of this in a world of still mean-reverting returns <bloomberg.com/news/news…? I think it suggests caution…. The 1995 soft landing…. If you bought the S&P 500 at its March 2000 peak and just held on, because of the big drops caused by the next two recession, by early 2013, you’d have had no return at all…<bloomberg.com/news/news…>
It’s going to be hard for Scott Bessent to maintain Donald Trump’s trust, dependent as it is on the stock market repeatedly reaching new highs in the future, isn’t it?
Yes, simpleminded Shiller CAPE earnings fundamentals suggest a ten-year warranted real return on the S&P 500 of 2.8%/year (if reïnvested earnings are neither dissipated nor directed to private-information excess return opportunities), above the real ten-year Treasury yield of 2.2%/year. But right now the equity return premium is rather thin…
<https://substack.com/@delongonsubstack/note/c-84783258>
(11) Public Reason: Alexander Hamilton talks his book. George Washington had thrown his authority behind the constitutional convention of 1787, and Hamilton was 100% Washington’s lieutenant:
Alexander Hamilton (1788): The Federalist 9: ‘It is impossible to read the history of… [ancient and mediæval] petty Republics… without… horror and disgust at… [their] perpetual vibration between… tyranny and anarchy…. From the[se] disorders… advocates of despotism have drawn arguments… against… republican government… [and] the very principles of civil liberty… as inconsistent with the order of society…. It is not to be denied that the portraits they have sketched… were too just copies of the originals…. The science of politics, however… has received great improvement…. Distribution of power into distinct departments… legislative ballances and checks… courts composed of judges, holding their offices during good behaviour… representation… in the legislature… are either wholly new… or have made… principal progress… [and] are means, and powerful means, by which the excellencies of republican government may be retained and its imperfections lessened or avoided… <founders.archives.gov/d…>
Did Hamilton believe it? Or did he believe America likely destined—even with the Fantastickal Eighteenth-Century Orrerry of Constitutional Machinery that was the work of the Men of 1787—for perpetual vibration between tyranny and anarchy, until something put the American Republic out of its misery?
There is, I think, very good reason to think that Hamilton was less optimistic about the American Republic than Washington. And Jefferson believed that Washington was not optimistic:
Thomas Jefferson (1814): “Letter to Walter Jones, 2 January”: ‘I do believe that Gen[era]l Washington had not a firm confidence in the durability of our government. he was naturally distrustful of men, and inclined to gloomy apprehensions; and I was ever persuaded that a belief that we must at length end in something like a British constitution had some weight in his adoption of the ceremonies of levees, birth-days, pompous meetings with Congress, and other forms of the same character, calculated to prepare us gradually for a change which he believed possible, and to let it come on with as little shock as might be to the public mind… <founders.archives.gov/d…>
====
References:
Hamilton, Alexander. 1788. “The Federalist No. 9.” In The Federalist: A Collection of Essays, Written in Favour of the New Constitution, as Agreed upon by the Federal Convention, September 17, 1787, vol. 1, ed. by John and Archibald McLean, 72–80. New York: J. & A. McLean. <archive.org/details/fed…
Jefferson, Thomas. 1904 [1814]. The Writings of Thomas Jefferson. Ed. Andrew A. Lipscomb & Albert E. Bergh. Washington, D.C.: Thomas Jefferson Memorial Association. <https://archive.org/details/writingsofthomas14jeff>
<https://substack.com/@delongonsubstack/note/c-84773503>
Give a gift subscription
SubStack Posts:
Get 33% off a group subscription
Leave a comment
Subscribe now
If reading this gets you Value Above Replacement, then become a free subscriber to this newsletter. And forward it! And if your VAR from this newsletter is in the three digits or more each year, please become a paid subscriber! I am trying to make you readers—and myself—smarter. Please tell me if I succeed, or how I fail…