The Bullshit Machine
People will develop relationships with their narrative reflections, almost despite any failures in simulation, but that isn’t what concerns me. It may strike some as sad, but ELIZA is a good example of how even the most elementary chatbots can have real therapeutic value. I am not here making a moral claim, particularly not about engaging with the technology. If anything, it would do us good to do so with a critical enough eye to look at what it is doing, rather than what it seems like.
It is when I look at the present rate of development of AI Chat, look at the public response both pro and con, and project it even just several years into the future, that it begins to look like a potential backdoor for hacking the “human biocomputer” at scale, on the one hand, and a fertile ground for Butlerian Jihad on the other.
