{"id":1048,"date":"2026-04-12T10:49:50","date_gmt":"2026-04-12T17:49:50","guid":{"rendered":"https:\/\/jick.ca\/?p=1048"},"modified":"2026-04-12T10:54:32","modified_gmt":"2026-04-12T17:54:32","slug":"anti-ai-mysticism","status":"publish","type":"post","link":"https:\/\/jick.ca\/?p=1048","title":{"rendered":"Anti-AI Mysticism"},"content":{"rendered":"

Civilization is in for some big changes: we have continued to think of AI<\/strong>s as tools<\/strong><\/em> long after it became clear that they were going to be partners<\/strong><\/em>.\u00a0 Ten years ago it was ludicrous to think that an AI could do serious “thinking” well enough to fool a human; today we are grasping at straws to maintain the belief that AIs can never do what the smartest, most creative and imaginative humans can — never mind “everyman”.\u00a0 The temptation to use AI help in arts and science is already irresistible to all but the most determined ideologues.\u00a0 And with the latest developments of AI technology it is probably only a matter of months or years until an AI can make an artistic image, compose original music, solve a mathematical problem, design and interpret an experiment, write a paper or review one better than any<\/strong> of us<\/em>.\u00a0 This is going to happen soon<\/strong><\/em>, and we are completely unprepared conceptually to think of it as anything but adversarial (AIs vs<\/em>.<\/strong> humans).\u00a0 Everyone needs to read some of Iain M. Banks’ “Culture<\/em>” novels:\u00a0 Consider Phlebas, The Player of Games, Use of Weapons, The State of the Art, Excession, Inversions, Look To Windward , Matter, Surface Detail, The Hydrogen Sonata<\/em>. They all feature partnership and conflict between humans and AIs, but they don’t treat the AIs as things<\/strong>.\u00a0 Banks’ AIs are people<\/strong>.<\/p>\n

Every day I hear supposed experts declaring that because an AI is “simply” regurgitating human-created phrases on which it has been trained, it is incapable of truly understanding ethics<\/em>.\u00a0 What?<\/strong>!\u00a0 Ethics is logical<\/em>; even an Expert System can do ethics better than most humans.\u00a0 What they mean is, an AI cannot be moral<\/strong><\/em>.\u00a0 Morality is a catalogue of Dos and Don’ts that a subgroup of humans has decided is The Truth and therefore immune to reexamination.\u00a0 Morality is how you justify atrocities.\u00a0 Ethics is how you avoid them.\u00a0<\/em><\/p>\n

What these “experts” are really saying is that because an AI is composed of bits and bytes being flipped and moved by electronic means, it cannot have “experiences” like we do, and so has no genuine “awareness”, no “feelings”, no “soul”.\u00a0 Okay, “expert”, let’s examine your<\/em><\/strong> “experiences<\/em>“.<\/p>\n

Since “seeing is believing<\/em>“, let’s start with vision<\/strong>:\u00a0 photons bounce off a distant object in all directions; some tiny fraction of them are on a trajectory that passes through your eye’s pupil and lens to strike your retina, where they trigger elecrtrochemical impulses from your rods and cones.\u00a0 Those impulses travel down your optic nerve to your visual cortex, where they are unceremoniously dumped into receptors that have seen similar patterns of stimulated neuron firing before and (after enough trials) developed an interpretation of them in terms of what sort of object the photons originally bounced off of.\u00a0 Absolutely direct experience, right?\u00a0 Lately we have become aware that such images can easily be simulated<\/em> by an AI, and therefore we can no longer believe what we see.\u00a0 Well, yeah.\u00a0 If you ever did<\/em><\/strong> believe whatever you saw, you are a fool!\u00a0 No one is better at generating fake video than your own visual cortex.<\/p>\n

How about language<\/strong>?\u00a0 My earliest memory is of siting in my grandmother’s wing chair (which I still have) while she entertained her bridge club: I remember a bunch of big people making noises that they clearly used to communicate; I thought to myself (in some preverbal format), “I want to learn to do that!”\u00a0 We are born without language, but with an innate desire to acquire it programmed into our neural networks, as it were.\u00a0 Just like a Large Language Model.\u00a0 We learn by listening to words in contexts where they have interpretable meanings, just like LLMs.\u00a0 Eventually we learn to add nuances by choices between words with similar meanings but different connotations.\u00a0 We learn to choose the best next word<\/em> — just like LLMs!<\/p>\n

“Ah,” says the Expert, “but the LLM has no experience<\/em> of the meaning<\/em> of the words!”<\/p>\n

Do you<\/strong>?<\/p>\n

You certainly have a concept<\/em> of the meaning; perhaps you also have a concept of the experience<\/em>!<\/p>\n

How are those “concepts” stored<\/em>?\u00a0 In self-regenerating patterns of neurons firing — just like in LLMs!<\/p>\n

At this point the “expert” will start trotting out woo-woo notions of quantum mechanics and nanotubules — the modern equivalent of clerics “explaining” that God imbued us with His spirit in mysterious ways that we are not meant to understand.\u00a0 I call BS!<\/p>\n

What if “consciousness”, “self-awareness”, “experience” and “spirit” are emergent properties<\/em> of any<\/em><\/strong> sufficiently complex neural network?\u00a0 What if we are not “special”?<\/p>\n

That would leave you with two choices: either you grant personhood to AIs or you deny it to humans.<\/p>\n","protected":false},"excerpt":{"rendered":"

Civilization is in for some big changes: we have continued to think of AIs as tools long after it became clear that they were going to be partners.\u00a0 Ten years ago it was ludicrous to think that an AI could do serious “thinking” well enough to fool a human; todayRead More…<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[],"class_list":["post-1048","post","type-post","status-publish","format-standard","hentry","category-rants"],"gutentor_comment":1,"_links":{"self":[{"href":"https:\/\/jick.ca\/index.php?rest_route=\/wp\/v2\/posts\/1048","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/jick.ca\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jick.ca\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jick.ca\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/jick.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1048"}],"version-history":[{"count":6,"href":"https:\/\/jick.ca\/index.php?rest_route=\/wp\/v2\/posts\/1048\/revisions"}],"predecessor-version":[{"id":1054,"href":"https:\/\/jick.ca\/index.php?rest_route=\/wp\/v2\/posts\/1048\/revisions\/1054"}],"wp:attachment":[{"href":"https:\/\/jick.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1048"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jick.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1048"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jick.ca\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1048"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}