Discussion about this post

User's avatar
Bob Woolley's avatar

Right after the recent Supreme Court decision on tariffs, I was listening to a legal podcast to learn about the case in more detail. It's a show tailored to lawyers, which I am not, so they don't always define the technical terms they're using. It quickly became clear that "the non-delegation doctrine" was a key concept in the case. I knew that I had heard the term before, but I didn't know what it was well enough to follow the conversation. So I paused the podcast, opened Gemini, tapped the microphone button, and said, "Give me a one-paragraph explanation of the non-delegation doctrine." One minute later, I understood it well enough to resume the podcast and learn how that doctrine influenced the conflicting opinions in the tariffs case.

The idea that the *right* way to approach that situation was to stop the podcast, stop the house cleaning that I was doing while I listened, get in my car, drive to the library 4 miles away, and either ask the reference librarian or try to figure out which book to look in for an explanation--well, that's just delusional. Mine was a kind of question on which there is virtually no chance that the answer will be hallucinated or fundamentally wrong. (I also use LLMs for deep research in technical questions, and there the risk of hallucinations is non-trivial; where they cannot find a clear answer, they're prone to inventing one. But when something is widely discussed in hundreds of reliable, easily accessible sources, like judicial doctrines, LLMs are very unlikely to give wrong information.)

As Jesse says, LLM are just supremely *useful* in a way that can only be denied by those who haven't tried them--or who, metaphorically, cover their ears and yell "I CAN'T HEAR YOU! I CAN'T HEAR YOU!"

sroooooo's avatar

Two more things:

1) for the AI water use and in general resource use, here: https://andymasley.substack.com/p/the-ai-water-issue-is-fake

the guy breaks down in extreme detail and with a lot of reliable sources the supposed problem of resource usage in AI, showing that is basically a bs.

2) when she says "No, no, there’s no expert there, and you’re not getting a sense of the landscape" you know that either she is wrong because she didn't even try the chatbots (weird for a person like her), or she's wrong because she has already decided that they are a con because this fits her ideology (anti-capitalist, de-growther, intersectional-some-bs-like-that). I work in ML, if you ask a chatbot about that particular ML topic, he will answer perfectly, even without searching the internet. A friend of mine that works in genetics could say the same, as well as other people knowledgeable about various subjects. In general, if the question and the argument are not extremely obscure, a modern LLM will get the answer 100% right, more so if it's a general question on a topic that is famous and interesting for the larger public (that is, what 99% of open-ended questions to ChatGPT will be). These chatbots were trained on like 85 billion books about the Roman Empire so yes, they will give a general answer that is absolutely correct, even without searching on the internet.

It's much more likely the librarian will give you more wrong answers about a certain list of topics compared to a chatbot.

153 more comments...

Ready for more?