Yes, it's good to be cautious about this technology. I think what it's missing is the intuition that humans have (and don't really understand). Science is starting to hint at the fact that many of our thoughts don't originate inside of us but come from elsewhere and we're just "quantum receivers" of the information. If this theory turns out to be true these AI platforms will need to be able to replicate this talent as well as just "thinking" and computing.