You say you "100% agree" with the essay, and then say that LLMs are "like any technology it's neither inherently good nor evil."

Did you read the essay? It says:

"Instead of being merely “agnostic” as many argue, digital technology has amplified the ability of the princes of this world to feed the fallen man, to make him more docile and distracted while installing beliefs, morals, and feelings that are acceptable to the secular spirit of this age. AI may be the final technology that is weaponized to create this new man before the Antichrist arrives, who will be the human manifestation of AI---an ever-helpful problem-solver who people mistakenly feel they cannot live without."

Your position is diametrically opposed to this one.

People of limited technical ability can understand the checks and balances of a paper voting system, which legitimizes outcomes. No digital voting system I'm aware of has this characteristic.

They can't understand the cybersecurity of a banking app either yet they use those.

In 20th century civil wars (e.g. the Spanish Civil war), telegraph and phone exchanges were strategically important targets. In a hypothetical U.S. civil war, one wonders how successful the belligerents would be in seizing, controlling, or destroying means of communication (data centers, undersea cable termination points, cell towers, microwave towers).

Tech workers, like all workers, would have to make difficult decisions about their allegiances. Let's hope this can be avoided.

What does it do?

It's like learning to factor polynomials even thought a computer algebra system on a graphic calculator can do that.

"A man with a watch knows what time it is. A man with two watches is never sure."

I believe the author of gas town is very informed, having been a professional software developer for some time. And the premise of the above comment is that he did, despite this, go down the wrong path.

The informed and uninformed are not mutually exclusive groups. Everyone is one and then the other depending on the time. To varying degrees of course.

Great example. Do you know what sorts of input they're using to drive this custom messaging?

Not really.

I know the original email was something like "Alert: you have a new thing: X Thing"

And the new emails are a prompt something like "we know all of this about the user and all of this about the X thing, write an email alerting them to the new thing with these particular goals".

I really don't know much about it so I'm being pretty vague and generic.

Can you tell us more about your product?

Out of curiosity, what is your product?