This is something that I think should be studied more. I think a large reason chatbots are so popular, is that they are just used as a sounding board for people who either have no inner monologue, or no one else to talk to, or they’ve never kept a notebook/journal of any kind. The bots help them get their thoughts out, and while stroking their ego, it helps them think through problems. The llm isn’t actually solving anything. It’s just helping those people think through it.
It’s interesting to me. I think a lot of people addicted to LLM’s probably aren’t good at critical thinking, and that’s why they enjoy using it, because it guides them along (and can reinforce their preconceived beliefs, which is the dangerous part).
It’s definitely a bad thing for human brains. It will be an interesting field of study in the future for sure.
the things you are describing is mentioned a lot when people treat agi as a friend.
when I have used it, it does use that comforting language a lot, aggreeing with your points to stroke your ego. if I were to describe it’s persona with a character, it would have to be Mr Jelly Bean from Rick and Morty.
I can see the appeal, but holy shit I’m getting pervert vibes from it.