Australia’s leading universities say redesign of how students are assessed is ‘critical’ in the face of a revolution in computer-generated text.

If you watched the debate live, you know that, at the very end, I wanted to reply to a point made by Susan but couldn’t, since we ran out of time. The goal of this essay is to put my reply on the record in writing, so to take it out of my system. Before I do that, however, I need to give some context to those who didn’t watch the debate live and don’t have a subscription to the IAI to watch it before reading this essay. If you did watch the debate, you can skip ahead to the section ‘My missing reply.

Context

In a nutshell, my position is that we have no reason to believe that silicon computers will ever become conscious. I cannot refute the hypothesis categorically, but then again, I cannot categorically refute the hypothesis of the Flying Spaghetti Monster either, as the latter is logically coherent. Appeals to logical coherence mean as little in the conscious AI debate as they do in the Flying Spaghetti Monster context. The important point is not what is logically coherent or what can be categorically refuted, but what hypothesis we have good reasons to entertain.

The pursuit of artificial awareness may be humankind’s next moonshot. But it comes with a host of difficult questions.