Why ChatGPT doesn’t think: an argument from rationality

Can AI systems such as ChatGPT think? We present an argument from rationality for the negative answer to this question. The argument is founded on two central ideas. The first is that if ChatGPT thinks, it is not rational, in the sense that it does not respond correctly to its evidence. The second idea, which appears in several different forms in philosophical literature, is that thinkers are by their nature rational. Putting the two ideas together yields the result that ChatGPT is not a thinker. The paper sets out the argument in detail and shows how it can withstand numerous objections. We end the paper by contrasting the argument from rationality with a more well-known argument often taken to show that ChatGPT doesn't think, due to Bender and Koller.