You call it the “AI Nexus”, we call it the “Torment Pin”

There’s a class of nerd who, when looking at a potential concept, can’t tell the difference between “actually cool” and “only seemed cool because it was in something I read/saw when I was 14.”

Fundamentally, this is where the Torment Nexus joke comes from. This is why Zuckerberg burned zillions of dollars trying to build “The Metaverse” from Snow Crash, having never noticed that 1) the main character of the book is one of the architects of the metaverse and it left him broke, and 2) the metaverse gets hijacked to deliver a deadly mind virus to everyone in in, both of which are just a little too close to home here.

Normally, this is where I would say this is what you git after two or three decades of emphasizing STEM education over the humanites, but it’s not just that. When you’re fourteen, you're supposed to only engage on the surfaces aesthetic level. The problem is when those teenagers grow up and never think about why those things seemed cool. Not just about what the authors were trying to say, but a failure to consider that maybe consider that it seemed so cool because it was a narrative accelerant, a shortcut to get the story to the next dramatic point.

Anyway, Humane announced their AI Pin.

And, look, it’s the TNG com-badge + the Enterprise computer. And that’s cool, I guess, but totally fails to engage (pun intended) with the reason that the com-badge seems so cool is that it’s a storytelling device, a piece of narrative accelerant.

My initial reaction, giving the number of former Apple employees at the company, is that this whole product is blatantly something that Tim Apple rejected, so they took their pitch deck and started their own damn company, you’ll be sorry, etc.

I don’t understand who this product is for. And it’s not that I don’t get it, it’s just that it seems to start from a premise I don’t buy. There’s a core worldview here that isn’t totally expressed, but that seems to extend from a position that people like to talk more than they like to look at things, and I disagree. Sure, there’s a privacy angle to needing to talk out loud to get things done, but I think that’s a sideshow. Like the Apple Cyber Goggles, it’s a new way to be alone. As far as I’m concerned, any device that you can’t use to look at menu together , or show other people memes, or pictures of your kids is a non-starter. There’s a weird moral angle to the design, where Humane seems to think that all the things I just listed are things we shouldn’t be doing, that they’re here to rescue us from our terrible fate of being able to read articles saved for later while in the hospital waiting room. The marketing got right up to the line of saying that reading text messages from your kids on the go was going to give you hairy palms, and I don’t think thats going to go over as well as they think. More than anything, it reminded me of those weird Reagan-era anti-drug campaigns that totally failed to engage or notice why people were doing drugs? Just Say No to… sending pictures of the kids to my mom?

It also suffers the guessing when you can ask fallacy. It has a camera, and can take pictures of things you ask it to, but doesn’t have a viewfinder? Instead of letting you take the picture, it tries to figure it out on its own? Again, the reason that the images they look at in Star Trek are so nice to look at is they were built by an entire professional art department, and not by a stack of if-statements running in the com-badge.

And speaking of that “AI” “agent”, we’re at a weird phase of the current AI grift carnival, where the people who are bought in to the concept have rebuilt their personality around being a true believer, and are still so taken with the fact that “my com-badge talked to me!” that they ship a marketing video full of AI hallucinations & errors and don’t notice. This has been a constant thing since LLMs burst into the scene last year; why do the people showing them off ask questions they don’t know the answers to, and then don’t fact-check? Because they’re AI True Believers, and getting Any Answer from the robot is more important than whether it’s true.

I don’t know if voice agents and “VUIs” are going to emerge as a significant new interaction paradigm or not, but I know a successful one won’t come from a company that builds their marketing around an incorrect series of AI answers they don’t bother to fact check. You can’t build a successful anything if you’re too blinded by what you want to build to see what you actually built.

I’d keep going, but Charlie Stross already made all these points better than I did, about why using science fiction as a source of ideas is a bad idea, and why tech bros keep doing it anyway: We're sorry we created the Torment Nexus

Did you ever wonder why the 21st century feels like we're living in a bad cyberpunk novel from the 1980s?

It's because these guys read those cyberpunk novels and mistook a dystopia for a road map. They're rich enough to bend reality to reflect their desires. But we're not futurists, we're entertainers! We like to spin yarns about the Torment Nexus because it's a cool setting for a noir detective story, not because we think Mark Zuckerberg or Andreesen Horowitz should actually pump several billion dollars into creating it.

It’s really good! You should go read it, I’ll meet you under the horizontal line:

—

And this is something of a topic shift, but in a stray zing Stross manges to nail why I can’t stand WIRED magazine:

American SF from the 1950s to the 1990s contains all the raw ingredients of what has been identified as the Californian ideology (evangelized through the de-facto house magazine, WIRED). It's rooted in uncritical technological boosterism and the desire to get rich quick. Libertarianism and it's even more obnoxious sibling Objectivism provide a fig-leaf of philosophical legitimacy for cutting social programs and advocating the most ruthless variety of dog-eat-dog politics. Longtermism advocates overlooking the homeless person on the sidewalk in front of you in favour of maximizing good outcomes from charitable giving in the far future. And it gels neatly with the Extropian and Transhumanist agendas of colonizing space, achieving immortality, abolishing death, and bringing about the resurrection (without reference to god). These are all far more fun to contemplate than near-term environmental collapse and starving poor people. Finally, there's accelerationism: the right wing's version of Trotskyism, the idea that we need to bring on a cultural crisis as fast as possible in order to tear down the old and build a new post-apocalyptic future. (Tommasso Marinetti and Nick Land are separated by a century and a paradigm shift in the definition of technological progress they're obsessed with, but hold the existing world in a similar degree of contempt.)

And yeah, that’s what always turned me off from WIRED, the attitude that any technology was axiomatically a Good Thing, and any “short term” social disruption, injustice, climate disasters, or general inequality were uncouth to mention because the future where the sorts of people who read WIRED were all going to become fabulously wealthy and go to space was so inevitable that they were absolved of any responsibility for the consequences of their creations. Anyone asking questions, or objecting to being laid off, or suggesting regulations, or bringing up social obligations, or even just asking for benefits as a gig worker, were all just standing in the way of Progress! Progress towards the glorious future on the Martian colonies! Where they’ll get to leave “those people” behind.

While wearing “AI Pins”.