I write for a living, which means people ask me about AI daily.
"Are you worried about AI?" is the most common question.
My answer is yes and no. My ears and eyes are open, and things that are very unlikely happen happen all the time but, for now, I'm leaning towards no.
For starters, Google doesn't like AI-written content. Or actually, more accurately, AI doesn't like 'low-effort' content, which AI-written content is.
In other words, you can write with or without AI, but Google wants EEAT - Experience, Expertise, Authority, and Trustworthiness. And you need human writers to achieve that, even if you're starting from AI-produced content.
My main concern about AI is that people trust it blindly, but it hallucinates all the time. Not only that, it completely makes stuff up.
Earlier today, I used to do some research and then I asked it "turn all of the above into a 200-word paragraph."
AI is a bad writer, so I was prepared to make editorial and stylistic changes, but in addition to getting stuff wrong. It made words up. In some cases, it misspelled stuff. In other cases, the word simply didn't exist.
Another huge problem with AI is that it's designed to appease you.
If you ask any random person "is Paris really the capital of France?", they'll look at you like you're an idiot. Rightly so.
If you ask AI, it'll go: "Well, that's actually a good question! Because you see, initially..." and it'll go on a long-winded rant before confirming yes, it is Paris.
I don't know what's going to happen or if the bubble will burst. Either way, I'm not a fan.