Discussion about this post

User's avatar
Andrew Evans's avatar

Can we just quit saying that woo-woo marketing phrase "AI" and just say "automation" or "education technology," please? None of this is particularly new or transformational. It's all an exercise in settling, and every plea that we automate education is a demand that we settle for less.

Re: "Bainbridge concluded her 1983 paper with a characteristically dry observation that has become I think, even sharper since it was written. The final irony of automation, she wrote, is that the most successful automated systems, those with the rarest need for human intervention, are precisely the systems that require the greatest investment in human skill. The longer the machine runs without incident, the more degraded the human backup; and yet it is in those rare, high-stakes moments of failure that the human is most needed and least prepared."

This calls to mind Cory Doctorow's explanation of a centaur versus a reverse centaur. A person who figures out how to use technology to increase the quality or efficiency of their work is a centaur; a person who is told to supervise one or more machines is a reverse centaur. A reverse centaur does not exist to ensure quality, efficiency, or even safety; a reverse centaur exists as a moral accountability sink, someone to blame when the automation all goes sideways. And the automation is there because the bosses don't really give a crap about the product (in this case, educating poor people).

https://pluralistic.net/2026/03/11/modal-dialog-a-palooza/#autoplay-videos

It's also addressed in the book Data Driven: Truckers, Technology, and the New Workplace Surveillance (2023), by Karen Levy. She uses it to explain how long-haul truckers can't just supervise a "self-driving" truck.

Re: "In my experience, assessment in most schools operates like a kind of faulty compass: it produces readings, generates confidence, and often points consistently in the wrong direction. The granular, timely, diagnostic information that would actually improve instruction is precisely what our current systems cannot supply. Instead we have built vast administrative infrastructures around measurements that tell us remarkably little about what students actually know or can do."

This is the standardized test in a nutshell. And it's why we need to quit micromanaging teachers and overemphasizing test scores. You CAN get granular, timely diagnostic information in teacher-created formative assessment, but you can't measure anything of value with a multiple choice standardized test. What standardized test scores do correlate well with, though, is the socioeconomic status of the students being tested.

Re: "AI’s most under-appreciated contribution to education may not be instruction at all but measurement: the possibility of replacing these crude, lagging, heavily interpreted signals with something finer-grained, more timely, and more honest about what it does and does not know about the learner in front of it."

So surveillance? More data collection? Or more multiple-choice questions, which we already know doesn't tell us much?

Re: "For most of human history that kind of individualised instructional support has been available only to the privileged few, a luxury of wealth and social capital that no amount of pedagogical goodwill could redistribute at scale. AI tutoring systems powered by the science of learning, even with their real limitations and the well-documented voltage drop between controlled trials and classroom deployment, represent a genuine attempt to offer something approaching that experience to every learner regardless of background. The equity argument for well-designed AI in education, cautiously and precisely stated, is genuine; and it is, for those who care about educational justice, a powerful one. To dismiss the technology entirely is to dismiss the possibility it carries for the children who have historically been most failed by the systems we already have."

This is bunk. You don't automate a system you care about. The wealthy have NEVER cared about educating and elevating "the poors." We have always been asked to do education on the cheap, despite the fact that we have had the resources to fully fund public education. And if the wealthy were somehow forced to send their progeny to public schools, public education would soon have all the resources it needs. Wealthy people hate paying taxes for public schools, and they hate uppity workers (teachers unions), and automation is just another excuse to do away with both.

John Gear's avatar

As a nuclear technician and then later a nuclear engineer and Navy submarine officer, I resonated with this piece very strongly -- I can say from long experience that it is incredibly difficult to maintain the mental sharpness necessary to evaluate quickly and then respond properly when things go suddenly awry after weeks or months of incredibly boring steady state operations which are, of course, the most desirable kind! Andrew Evans' comment about truckers is on point as well. If you're along for the ride, there just to respond in those moments when "the system" failed, your ability to respond effectively is really degraded. Great post.

34 more comments...

No posts

Ready for more?