Here is another example of AI just being 100% confident in itself for no reason.

Claude gave me this answer to a question that I asked:

Sounds like a really good answer. But I wanted to read the details.

So I followed up with this:

Then it said this:

So the two assertions it was making, it couldn’t support either one when challenged.

This is my big concern with AI is the unfounded confidence. If you aren’t an expert in a field, it’s going to sound very convincing. AI is incredible, but holy shit it’s wrong constantly. And it doesn’t seem to have a shred of humility in its answers. Almost like a tech bro billionaire who never for a second ever considers that they might be wrong. Society just needs to be more careful with this stuff, but I don’t see that happening. #verynervous

Cheers.