For example, these systems can generate poetry and write code because they’ve been trained on existing content. But they cannot perform abstract tasks, like understanding humor or feeling empathy.
“There are some people that treat the term ‘AI’ like it [just means] ‘amazing innovation.’ So whenever something is amazing, it’s called AI,” said Kaufmann. “But when you are looking at the scientific and perspective, you can actually measure and define intelligence. Intelligence would be measured as your capability of dealing with unseen problems, unencounted problems. Can you solve something that’s completely novel? And the large language models like ChatGPT are not able to tackle anything that it hasn’t encountered before. Therefore, its [intelligence] is zero.”
Also a related link
Is AI as smart as it seems? Exploring the “brain” behind machine learning, neural networker Alona Fyshe delves into the language processing abilities of talkative tech (like the groundbreaking chatbot and internet obsession ChatGPT) and explains how different it is from your own brain — even though it can sound convincingly human.
Alona Fyshe: Does AI actually understand us? | TED Talk