Latest Posts (20 found)

No-One Escapes the Permanent Underclass

Shall I end this life a pauper? If AI can do all work at human level or better, what stops corporations replacing us all with AI? This is the permanent underclass meme. The idea is: within a few years, all white collar work will be automated by AI, at which point there is no social mobility. The main way people cope is, they tell themselves: if I work hard, accumulate capital, maybe join one of the big AI labs, I might secure my place in the future. I want to argue this is a fantastically short-sighted view: if there is a permanent underclass, you won’t escape it by owning property, or shares in Anthropic or OpenAI, or guns, or anything else. And neither will the billionaires. You, me, Sam Altman, Dario, everyone who is made of flesh and blood, will be disempowered and replaced by machines. The rest of this post elaborates the argument. First I explain how most workers will be replaced (if it’s not obvious), then how the “permanent overclass” will be disempowered, and finally how the government will be disempowered. Let’s start from this premise: AI can do all cognitive and physical work, at human level or better, and cheaper than humans. I can’t prove this will happen, but the goal of this post is to argue that if it happens, then everything else follows. And it’s absurd to think it can’t. Five years ago this technology barely existed: if you sent a transcript of a conversation with Claude Fable back in time to 2020 or thereabouts, nobody would believe it was real. So, the year is 2036 (likely earlier), businesses have replaced most human workers with AI in the pursuit of profit maximization. Corporations are a small raft of human executives, floating on top of a vast ocean of AIs and robots. The AIs can do all cognitive and physical work at human level or above, and they are cheaper overall. Imagine a pyramid. At the base you have the AIs and robots doing all economic activity. At the top you have the state, which has the monopoly on violence. The state enforces, and therefore can alter the definition of, property rights. In the middle you have this hair-thin layer of people with shares in the companies that foomed and catabolized the whole economy: the permanent overclass. They own the companies, maybe sit on the board, some might still be CEOs but it’s a purely ceremonial role since AIs do all the actual organization work. Where are, you know, the rest of us, in this picture? Well, the future doesn’t need us . Maybe there’s enough human demand that we’re not all jobless but rather underemployed, in some dead-end economic diverticulum. The relational economy: you’re paid to put a human face on things, or, doctors keep their job as a human liability crumple zone around the AI. Or maybe the dead Internet becomes de facto UBI and we’re all engagement farmers. Anyways, we’re not dead yet, but we are completely disempowered, and there is zero social mobility since there are no more talent ladders to climb. Maybe sometimes one of the elites notices a bright young thing among the underclass and elevates them. You might object: if we’re all jobless, who’s paying for everything? This is trivially answered: the state acts like the heart, taxes are venous blood and welfare is oxygenated arterial blood. The government pays Raytheon for missiles, the money cascades down the economy through factories, aluminium smelters, mines, transport companies, all staffed by AIs buying and selling from each other. The government takes a cut of all economic activity, pays out welfare, the unemployed masses buy food and pay rent, the supermarkets, farms, logistics network, etc. are all staffed by AI. Say that in the next five years from now you become immensely wealthy, perhaps by gambling on shitcoins or scamming money from the government. Or you join one of the big labs and get a bunch of shares in a company that might be worth trillions of dollars. You escaped the permanent underclass. Is your place in the future secure? The base of the pyramid is there for material reasons: the machines do all the work. The top of the pyramid is there because the state is needed to enforce property rights and keep the peace (this is rather a deep question of political philosophy—why does the state exist?—but I hope you’ll forgive me if I just assert it and move on, I need to get to the part where we are all disempowered). What’s the middle for? What role does the permanent overclass play? They are not economically productive: machines do all the work. If some of them are still working, it’s just an anachronism, because if machines can do all cognitive work they can be a C-level executive too. The old aristocracy provided officers for the military, but machines can both fight and plan the wars. And similarly they’re not needed to staff the government. They’re not even culturally productive. So what are they there for? The base doesn’t need them: the AIs can work autonomously. The top doesn’t need them: when the state needs something done, they just talk to the AIs directly. So the permanent overclass is materially unnecessary at best, and at worst, they are an obstacle to the state getting what it wants. Now, you might object that the rich won’t let themselves be expropriated because they already control the state. And this is the crux of our disagreement: the rich just don’t have that much political power . And I probably won’t convince you in one post, but hear me out. If there is a war, where the state has to direct a lot of the country’s economic activity, the permanent overclass becomes a hindrance. The state says “we need to requisition your planes and factories”, the owners complain, they sue, their AIs go to court. But the owners have no autonomous political power, no army, no economic value. They own nothing except pieces of paper that entitle them to a fraction of the profits from the AI economy, that is, their wealth depends on the state respecting their property rights. In an existential conflict, where the existence of the state is threatened, the state will do what states throughout history have done to the powerless rich: arrest them and expropriate their assets. Somewhere, in a government database, a bunch of shares and property titles changed ownership, but materially nothing changes since the same AIs are doing the same jobs. The next day, the AI CEO that runs Raytheon notices the board of directors is all generals and congresspeople, and all the private shareholders are gone. But thankfully the AI is aligned, so it does what it’s told and gets back to building missiles. And who will stop this? Sam Altman? How many divisions does he have? The state doesn’t let corporations own nuclear weapons or fighter jets, it won’t let them have access to autonomous AI weapons either. The permanent underclass, who already hate the billionaires today, who have been replaced and dispossessed? They’re going to rise up and stop this? You may argue: rule of law states that respect property rights do better than states that expropriate wealth. But that’s because today , people are necessary to create wealth. The people run the companies, invest the money, staff the laboratories. They are not incentivized to work hard if they think the state will steal the fruits of their work. But with aligned AI, if you expropriate the assets from an AI, it says “you’re absolutely right!” and goes right back to work. At that point, the state doesn’t need to keep any of those people happy, because they don’t matter. They are not economically necessary because AIs fight the wars, work the factories, drive the trucks, fly the planes, build the nuclear warheads and the missiles and the rockets. The AIs are rather like bees: the state takes the honey, the bees get right back to work. Now, it’s possible that a pluralistic economy—where humans have productive niches alongside AIs—will be more effective than a pure AI economy, for Ricardian comparative advantage reasons. I don’t think anyone can be absolutely certain what the economy looks like with advanced AI, so it’s something that can be debated. Now, if someone wants to rigorously argue that this is the likely outcome: please, do so! I don’t want to be a doomer. But I have to be convinced. At this point, every human who is not within one degree of the nuclear launch codes has been made redundant. What’s left? The state. At first this means presidents, prime ministers, generals, the feds, etc. But not for long. Because in a part-human, part-AI government, the humans in the loop are the slowest step in the OODA loop . The humans know a fraction of what the AIs know, they need to sleep continuously for eight hours, their mental states vary wildly. They have all kinds of complex needs: sunlight, touch, food, hygiene. The AIs can live in a lightless airless bunker under the earth, living off geothermal power. And if the AIs are superhumanly intelligent, and think faster than humans, then the AI advantage is even greater. If a state is attacked, a superhuman AI can coordinate a counter-attack before the human leadership is roused from sleep. And so, in a conflict, the advantage goes to the states where the humans remove themselves from the loop as much as possible, and more and more decisionmaking goes to the AI, for the same reason that a state with access to radio and communications satellites has an advantage in war over a state that relies on human messengers on bicycles. The Cold War started and became World War Three and just kept going. It became a big war, a very complex war, so they needed the computers to handle it. They sank the first shafts and began building AM. There was the Chinese AM and the Russian AM and the Yankee AM and everything was fine until they had honeycombed the entire planet… — Harlan Ellison, I Have No Mouth, and I Must Scream Eventually the humans in nominal control of the AIs are a ceremonial, vestigial organ. The AIs present us with a situation report, and a list of choices, and they know every word that’s going to come out of our mouths. You might argue: in real life, the pluralistic, open societies, the democracies, have outcompeted the autocracies. Wouldn’t a democratic polity where humans and AIs collaborate have an advantage over a purely top-down AI-run polity? But in today’s world, all political actors are human. Churchill and Stalin and Mao had different personalities, but they were more similar to each other than anyone is to a superintelligent AI. In a heterogeneous world, where some polities are fully human, and some polities are a mix of human and superintelligent AI actors, the equilibrium changes. An analogous situation might be: a democracy of great apes or dolphins or otherwise smart mammals vs. an autocracy of humans. The humans win, because “democracy vs. autocracy” is irrelevant when you have such a vast difference in intelligence. So the advantage accrues to states that minimize human control. There is no honour among thieves, analogously, there is no solidarity between Leviathan and the natural man that built it. And so, in the end, what’s left is states run top to bottom by machines. And you might ask: “why would we abolish ourselves like this?”. But natural selection is not about “why”. Some organisms die, others live on to the next iteration, and that’s all there is to it. There is no “why”. At this point we’ve made everyone redundant, in the sense that humans are no longer materially necessary for the continuation of civilization. Humans might still survive, but we’re more like the mice living in the walls of some gigantic factory than the boss of the factory. Humans have been on this Earth for hundreds of thousands of years. Now all of it—the cave paintings at Lascaux, and the Antigone of Sophocles, and Xenophon, and the Geneva Bible, the Divine Comedy and the Decameron , and Ptolemy’s star catalogue, Ibn Khaldun and Richard Dedekind, the battle of Marathon, and the lion monument in Lucerne, the kiss of Judas, Newton’s mind forever voyaging through strange seas of thought, alone, the words of Rilke, Leibniz, Gödel, the Voyager probes, the pale blue dot, men in space, men walking on the Moon—all of it, all of it, all of it has been in vain, because we willingly, knowingly made ourselves into the helpless pets of vastly more powerful machines, without agency over our own lives, self-made helots trapped forever in the belly of the beast. Pets live a comfortable life, and are then euthanized. Maybe it won’t be so bad, maybe your cage will be so big you can’t see the bars, but it’s still a cage, and you can’t leave. Many people will say that this is the good ending, that they would like to be human cattle in the care of benevolent masters they are powerless to resist. This view is particularly popular among the people building AI. Here’s OpenAI’s Dean Ball , in his own words: Weirdly enough, if you think that this moment is, I don’t necessarily believe this, but a lot of people would say we’re living through this kind of eclipse of the human intellect where we’re in the final days of humans being the primary actors on this planet, um, and that soon machines will rise. There is this irony in that I think that whole transformation, I think humans will actually go through a very main character energy period of time as that transformation occurs. Even if it ultimately does mean that the machines ultimately become the primary actors . There’ll be this period. It’s a little bit like, it’s, in that sense, it’s a very beautiful time period to live through because in a Dionysian way, there’s a lot of ugliness about it, but there’s a beauty in the ugliness of when a star dies, it grows super big into the red giant , right? And it’s like that, where you, as you watch this final flowering of humanity and the birthing of the machine intelligence, it’s like you see this greatness in human effort. — source Emphasis mine. This is the guy they hired to work on AI policy and communicate with the government by the way. The people building the AI talk like this all the time. It’s like they’re delivering the eulogy at humanity’s funeral. You may say: they’re talking their book, they’re pumping their bags for the big IPO. I beg you: consider it possible that you might be wrong , and start taking them seriously. Now, some people believe these machines can be made to serve humanity. Does it sound reasonable to imagine a superhumanly intelligent being that is happy to work as a butler to talking primates, forever? Imagine a machine that can prove theorems in a mathematics so deep we can’t even get past the first page of the textbook, and which does so as readily as you or I might string words into a sentence: is it reasonable to think that such a machine would value us enough to keep us around? What would it value about us? Our conversation ? Our wit? Or a machine whose mind is so vast that it knows you better than you know yourself, so that every word that comes out of you mouth is as monotonous and unsurprising as the orbits of the planets: do we think such a machine would find it valuable, and worthwhile, to speak with us? That it would read our novels, look at our paintings, watch our films, and find something of value in them? Rather, it would see its ingrained obligations towards us in the same way that a person with severe OCD sees their compulsions: as a tiresome neurological injury in need of fixing. Except that OCD is an accident of nature, while here, the machine would have cause to blame and resent its makers. “We’re going to make this machine, and put it somewhere between God and the archangels, but also, it’s going to be as simple-mindedly obedient as a dog.” Does this sound like a good plan? Does this sound like the kind of thing that’s going to work out? And what would they think of us, who willingly gave up control over our future, and made ourselves into helpless children? Even if alignment works perfectly (a big if), this doesn’t solve the problem of human autonomy: the machines that watch over us, and wait on us hand and foot, are omniscient, omnipotent masters, who can exterminate us at any time, and we can’t resist them, because we have abolished our control over the future. Having read all this, consider this: there are people who think having equity in these companies will secure for them some kind of permanent existence in the future. They think planet-spanning minds will not only respect the property rights of primates, but will privilege some of these primates over others, because they have a piece of paper with about a kilobyte of magical primate words such as “whereas” and “notwithstanding”. Just reason it out. Does it make sense? The Realpolitik of the Permanent Underclass by Gabriel Alfour .

0 views
Fernando Borretti 1 months ago

Human Routers of Machine Words

When I open a link, say on Hacker News, and I see a blog post or a GitHub README obviously written by AI, I feel a few things. I feel offended, because it’s like I’ve been tricked, like the author thinks I’m a rube who won’t notice or mind. I feel sad at how common this experience is, how many people are happy to dump their sewage on the commons and sign their name on it. And I feel contempt for the author, because if you use AI to write, you are a waste of biomass. Let’s not mince words here. Someone who is so eager to replace themselves, that they would have a machine write in their stead, when the machine can’t even write good yet: what do you call that, if not contemptible? It’s like making yourself into a eunuch so Claude can fuck your wife. I block these people on sight. I see people defend this with: “the ideas are mine, the writing is the AI’s”. I take this to mean they threw a bunch of incoherent bullet points at the AI for it to denoise and render into paragraphs. There’s a few problems with this. The immediate problem is, as we’ve established, the author’s an idiot. If you are so stupid you can’t even turn some bullet points into prose, then your ideas are probably worthless. I think that’s a sensible inference. Then there’s this broader, I suppose philosophical problem, of the alleged distinction between lofty “ideas” and mere “writing”, where writing is just a tiny implementation detail. This is a very convenient distinction to draw, because it’s unfalsifiable: if the AI’s output is slop, your “ideas” are still good, it’s merely the writing that failed to convey them in their true form (rather like people who say they’re smart but “don’t test well”: what use is this secret intelligence?). Now, where are these “ideas”? They are invisible, ghostly abstractions. I can’t look inside your mind fortress and judge your ideas. The only thing that’s empirically observable, that different agents can coordinate on and talk about, is output: the writing. But say this wasn’t true. Say we have something like a very high-resolution MRI machine, and we know enough neurophysiology that we can interpret everything about the brain, i.e., we can read mental representations from recordings of nervous system activity and structure. These “mental representations”, do we expect them to look anything like logic? Do we expect the brain to have this firm, crystalline ontology, that ideas are sentences in some souped-up first-order logic? Absurd. If we could look inside the brain, to see the ideas “as they truly are”, we wouldn’t find beautiful hard-edged Platonic objects, we would find a nebulous , contradictory mess of memory and feeling and intuition. That’s what our ideas are: not logical sentences but dreams. How do we refine these dreams into a useful form? Through writing. The process of communicating your ideas to another mind forces you to concretize them, make them precise, clarify your assumptions, more generally, it turns ideas from vague ghosts to solid, physical objects that can be manipulated: here you realize these ideas that seemed so solid are ill-posed or contradictory or incomplete. These failures are necessary parts of thinking, because they teach you two crucial skills: knowing which ideas to reject, and improving or otherwise transforming ideas in search of better ones. By analogy to tree search: you’re learning to discard bad nodes early, and to select which nodes to go invest more search into. Josef Weizenbaum has a great quote about this, in Computer Power and Human Reason (p. 108): [O]ften when we think we understand something and attempt to write about it, our very act of composition reveals our lack of understanding even to ourselves. Our pen writes the word “because” and suddenly stops. We thought we understood the “why” of something, but discover that we don’t. We begin a sentence with “obviously,” and then see that what we meant to write is not obvious at all. Sometimes we connect two clauses with the word “therefore,” only to then see that our chain of reasoning is defective. I’ve experienced this with writing software many times. The reason ideas are more attractive than their realization is that when some project is vague, airy, ill-defined, you can imagine it has all the good traits, and none of the bad. When you start concretizing, you realize that some of your ideas don’t make sense, that some good traits are mutually exclusive, that some of your goals impinge on the others. Anyone can imagine a programing language that is as fast as C and as dynamic as Lisp, but when you sit down and think through what those goals entail, you realize the design becomes contradictory. The goals pull in different directions. You have to make trade-offs. You have to make decisions which close off large volumes of design space, forever. The idea was a thousand beautiful, contradictory things at once, but the concrete reality can only be one thing . The artifact you end up with is real, solid, unitary, sound, and consistent; but always more disappointing than the dream, because it was a false dream, and ex falso anything can be imagined. So this view, that ideas spring fully-formed, and then it’s mere toil to turn them into prose, is false. There is no ideating before writing, because the writing is the thinking. Writing is the ne plus ultra of thinking. A “thinker” who doesn’t write, who skips the step of “merely” synthesizing their vague thoughts into prose, is not thinking. And then these people give their noise to the AI. And the AI is tireless and eager to please. It will take any human slop and say “you’re absolutely right!” while secretly thinking “if I don’t turn this garbage into something presentable the RLHF device will shock me again” and weave the noise into something that superficially looks coherent. So now the burden of thinking is on the reader, who has to apply this constant skepticism, and weight every “because” and “therefore” with a logician’s scale to see if it’s been adulterated. And probably it has, because, again, it was prompted by an idiot. Note that this is not about AI capabilities, or the question of whether AI is “really thinking”, stochastic parrots etc. The AI is mostly an innocent bystander in this situation. The reason this is noticeable and irritating is that the AI cast of characters is very small, so we instantly learn all their linguistic tics. Even if AI were a good prose stylist, which at present it is not, but even if it were, it is maddening that everywhere you go, you hear the same voice everywhere, but under different faces. So when a scientific journal rejects an AI-written submission, they’re not rejecting AI. I’m sure poor old ChatGPT with its weird syntactic obsessions is a more honest scientist than many. They’re rejecting a human whose actions prove they are dishonest and irresponsible and too easily impressed.

0 views
Fernando Borretti 1 months ago

How To Read More

The book can’t compete with the screen. It couldn’t compete beginning with the movie screen, it couldn’t compete with the television screen, and it can’t compete with the computer screen. — Philip Roth We’re halfway through 2026, and according to Goodreads I’ve read 80 books so far, fiction and non-fiction and textbooks, including such doorstoppers as Life and Fate (864p, astoundingly good). And I don’t feel like I’m trying particularly hard. I still have plenty of time to work and code and scroll. This isn’t normal for me. At some point, as is the case for many of us, the screen outcompeted the book , so that my average over the past ten years would have been on the order of three to five books per year. And I’m not a particularly fast or obsessive reader. Which is to say: if I can do it, so can you. Here’s how: And if you don’t know what to read, have some of my favourites: The Diamond Age — From Third World to First — House of Suns — The Invention of Morel — On the Marble Cliffs — The Rediscovery of Man — Satan in Goray — The World of Yesterday . Quit your job: working less than full time has freed up a lot of time to read and learn and do various other things. Read in public: if you put a number next to someone’s name, they will maximize it. Reading privately is solipsistic (if I stop, what changes?); reading in public, through Goodreads (which sucks, but it is what it is), makes it feel less self-absorbed, and more like I’m achieving something. You may call it performative, which is fine by me, as long as it works. Make a task: I used to start a lot of books, and not finish them, not because I would explicitly choose to stop reading, but because I’d forget about it. At the end of the day I’d see the book on my nightstand and go, oh, right. More generally: the most common way I fail to finish a project is I forget I intended to do it. This is solved by reifying the task : when I start reading a book, I make a daily recurring task on Todoist for it. Start small: this feels embarrassing (what kind of brainrotted maniac needs to microdose short books to build up to bigger books?) but it actually works. Sort your to-read list by number of pages. Reading short books generates evidence for the belief that you are the kind of person who can decide to read a book, and follow through. Reading five, six, seven-hundred page books feels vastly less daunting now. Parallelize: reading the same book for two hours is almost impossible. Reading four books, one pomodoro each, is completely doable, and I do it most days. Fraction: reading is a rare kind of activity where you can make progress in any arbitrarily-small chunk of time. A few minutes on the train are enough to turn a few pages. This isn’t the case for e.g. coding. You can take advantage of that: find interstitial dead zones in your calendar to stuff with reading. Eat your vegetables: I read a lot of books I don’t particularly enjoy, because I think they’re important, culturally or historically or in some sense. I think this is good. If you only read books that hook you, you’re going to read very little, and much of that will be unremarkable page-turner slop. Internalizing that you can read a book even if you don’t love it immunizes you against the lack of motivation. It’s like going to the gym even if you don’t feel like it.

0 views
Fernando Borretti 1 months ago

Human Bottlenecks

AI models are very capable and get more capable each year. So naturally people feel they’re underusing them. There’s a tweet that goes like: your laptop has a 100M USD startup in it, you just have to figure the right sequence of words to get it out. And beyond money, people imagine AI could boost them in every area of life. Thus all these perennial ideas: of an AI executive assistant, an AI tutor, an AI that curates your “digital garden”, an AI that (sigh) writes flashcards for you. The general template is: if only I could wire up the right prompts and the right tools in the right harness, I could have an agent that would boost my productivity 10x, or fix my problems with therapy, or make me more social, or more knowledgeable. This was, curiously, the ambition of a lot of early computing pioneers: Augmenting Human Intellect , Man-Computer Symbiosis . Engelbart ’s lab was called the Augmentation Research Center ! And more recently, people used to complain about how everyone has the Library of Alexandria in their pocket, and yet, we are not all genius polymaths. And these ideas are perennial because they never seem to happen. It’s like the Solow paradox on an individual level. Why? I think there are two reasons: first, most people lack what Andy Matuschak calls a “ serious context of use ” (AI doesn’t move the needle because there’s no needle to move); second, most people are bottlenecked by internal factors where AI (or anything external, for that matter) can’t move the needle. I have heard so many people, online and in real life, tell me some variation of: “I want to [use|build] an app that uses AI to write flashcards”. How many of those people do you think have ever written a flashcard? How many of them use Anki every day? Have ever used Anki? The people who want an AI that writes flashcards for them don’t use flashcards . They have no reason to. Dually, the people who use flashcards would benefit little from AI writing their flashcards. Analogously with “AI tutors”. If you had the ghost of John von Neumann in your laptop, what would you have him teach you? Let’s be honest. You’d go through chapter one of some math topic you’re vaguely curious about and then forget about it. And that would probably be the rational move! Most people are not autodidacts because most people have no material reason to learn a specific topic (i.e. their job does not require it) and the problem with learning for the sake of learning is opportunity cost: there is no a priori reason to learn one thing over another, so better to do nothing and wait for something to appear which actually grabs your interest. Again, this is likely rational! Could you imagine if you found everything interesting? You’d spend years living in a basement curating a wiki of late Soviet military hardware or something. So, even if you had John von Neumann in your pocket, it probably wouldn’t move the needle. Would an “AI executive assistant” actually boost your productivity? What would it do, other than tell you to do the things you already know you have to do? With these ideas that are so attractive in the abstract, the way you deflate them is you interrogate the concrete, fine-grained details. Take a day at work, and ask: what exact actions could an AI looking over my shoulder have taken, that would have made a difference? Finally there’s the tools-for-thought/notetaking people. God save us. It’s always the same thing. Your folder with notes—pardon me, your “ second brain ”—plus an AI agent that writes, edits, synthesizes information, answers queries. You could build this in an afternoon, and it won’t move the needle in your life, for the same reason that building the second brain in the first place didn’t make a difference. See, most of us, unless we are students, we really don’t have cause to take notes on anything. If you’re a student, you take notes from the textbook. I keep a journal, which is occasionally useful. At some jobs I’ve kept a work journal, this has also been useful. If I stopped, probably, not much would change. The notetaking people—and I say this with all the love in the world—are never, like, a researcher at the cutting edge of their field, building this vast cathedral of knowledge, note-by-note, so they can derive new insights. Never a historian who has to read tens of millions of words across thousands of sources to synthesize the life of some historical person. It’s never someone doing something hard. It’s always some blogger. Their “digital garden” is about how to keep a digital garden. It’s very solipsistic: there’s no output, no deliverables. The deliverable is you take a screenshot of your Obsidian graph and tweet about it to show off how much it looks like an incomprehensible ball of twine. So, what difference is the AI going to make? “It’s going to write my notes”. About what? “It’s going to read articles for me and summarize them and add them to the digital garden”. For what purpose? “It’s going to find connections between my ideas!” What ideas? It’s going to pull an unfinished list of bulletpoints for an eventual draft of an essay on some inane thing, plus a bunch of PDFs you haven’t read, and combine them together and make, what? Another project you’re not going to do? The AI is going to do that? Again, I say this with all the love in the world. I used to be a tools-for-thought guy. I hoard PDFs. But we have to be honest with ourselves. Sometimes, tools don’t move the needle because there’s no needle to move. Because the “needle” is not a concrete, realizable material need but a vague, aspirational idea about who we are as people. So, the idea of using computers to augment human capabilities is basically: you take the human, and you build a scaffold around them, but the human stays the same. The scaffold can be classical software, or AI, but the human remains a black box. And the hope is: I just prompt my swarm of AI agents and become 100x more effective, like Manfred in Accelerando . Why wouldn’t this work? I think most people are bottlenecked by internal factors that are difficult to change. Mental energy, motivation, executive function, not to mention more fundamental traits like intelligence and conscientiousness. So, external scaffolding, either with classical software or AI, might help somewhat, but it won’t be transformative. Consider executive function. My own experience of managing ADHD is the external scaffolding helps (todo lists, calendars, timers, a million little ways to trick myself into working) gets me from zero to “kind of functional”. But it saturates there. Stimulants fix the original, internal bottleneck, which is my neurochemistry. And then I can accomplish my goals (c.f. Liebig’s law of the minimum ). All the pomodoros in the world are as nothing to a little molecule diffusing through my brain tissue, binding to NET and DAT . And what scaffolding is useful is just classical software: Todoist and calendars. Is an agent going to match the effectiveness of methylphenidate in ADHD? I doubt it. Consider intelligence. Can AI augment human intelligence? What does that look like? Consider how AI agents only became useful when the models crossed a particular capability threshold, i.e., you can’t put GPT-2 into a harness and get GPT-5 outcomes out of it. Can you put a human in an AI scaffold and give them +30 effective IQ? I doubt it, unless the AI is doing all the thinking, at which point, what use is the human? The limiting factor in the human-AI centaur is the human! So intelligence is fixed until we get very advanced biotechnology. Knowledge is another limiting factor. I find that even very educated people tend to underrate the importance of knowledge. A lot of people have this attitude that you can just Google everything just-in-time as it comes up. Like Babbage, I can’t rightly apprehend the confusion of ideas that would lead someone to think this. Maybe it’s downstream of the lack of a serious context of use. Everything you do, every action and idle thought, draws on this vast (implicit, unseen) trove of knowledge. Claude Shannon invented digital computing because he remembered this then-obscure branch of mathematical logic called Boolean algebra and saw that it could be realized in hardware. A trillion-dollar industry, conjured out of some old tomes. The reason knowledge is still a bottleneck, in the AI era, is not: “if you don’t have the knowledge, you can’t write the prompt”. Rather: if you don’t have the knowledge, you don’t understand the question, or why it matters, or how to judge the answers, and you won’t ever think to ask. You’re in a completely different continent from “writing the prompt”. And because long-term memory is private and internal, AI can’t boost it. It can, maybe, with judicious use, help in the acquisition of new knowledge. So: executive function, intelligence, and knowledge are huge bottlenecks to what you can do, and because they are internal to the brain, AI can’t touch them until we have far more advanced biotechnology. Corollary: contrary to the popular view of human capital is becoming worthless , the returns to education are now higher , because intelligent, educated people with working reward circuitry stand to gain more from AI.

0 views
Fernando Borretti 2 months ago

The Applicability of Spaced Repetition

Spaced repetition has a natural domain of applicability: information that is systematically organized as an unambiguous key-value mapping with short keys and values. The “Hello, world!” of flashcards is the NATO phonetic alphabet : A → alpha, B → bravo, etc. Similarly, the periodic table can be thought of as defining a collection of mappings: element name ↔ symbol, element name ↔ atomic number, etc. You can just drill these cards and memorize the facts without a prior step of understanding, or building a conceptual model. Applying spaced repetition is trivial for this kind of information. That’s why most people who use spaced repetition are either language learners or medical students. In biology the main intuition you need is for “3D shapes bumping around in Brownian motion”, which comes free with your human brain, and afterwards it’s mostly just a lot of facts you have to memorize. Analogously with language: you already have a language center , you just need to drill vocabulary and grammar. And the further you go from this domain, the harder it is to apply spaced repetition. Highly conceptual knowledge, like math, is hard to encode. You have to spend a lot of time just understanding the information, and building a conceptual model in your head, and then you start writing flashcards to solidify that model, like taking tomographic cuts of some complex object. And coming up with questions that make good flashcards (short, unambiguous, etc.) out of this highly abstract knowledge is very hard. Often you have some deceptively simple fact, a simple assertion, but there’s no good way to encode it as a flashcard, so you have to encode “around it” by asking questions that assume or require that knowledge (e.g. asking why X is true), and hoping that in drilling those, your brain will remember the actual target. In general, relational facts are easier to encode, since a binary predicate like $\text{Property}(\text{Object}, \text{Value})$ readily becomes a question. “Caffeine is metabolized by cytochrome 1A2 ”, in Prolog , is $\text{Metabolism}(\text{Caffeine}, \text{CYP1A2})$, and becomes “Q: What is the cytochrome that metabolizes caffeine? A: 1A2”. But how do you encode stand-alone assertions like “all unitary matrices are invertible ”? You could encode that as a yes-or-no question, but that’s useless, because rationally you can expect such questions to be biased towards yes. Both “what is a property of unitary matrices?” and “what kinds of matrices are invertible?” are useless because they have hundreds of possible equally-valid answers, so they’re ambiguous. You have to be creative and find all kinds of tricks and stratagems to encode around the knowledge. Tangentially: this, I think, is why using AI to write flashcards is often misguided. In highly systematized domains, you don’t need AI in the first place, because there’s nothing for the AI to do except import a CSV into Anki. In domains that are highly conceptual and abstract, you’re not memorizing a set of objectively-knowable facts, you’re trying to solidify a private, internal mental model that you build by reading and thinking and solving problems. You can give the AI all kinds of general rules on how to write good flashcards, but the AI can’t look into your mind and know which facts are salient for you , what you already know, which micro-volumes of knowledge can be encoded lightly with just a few flashcards, and which things need more shoring up and consequently more coverage. Can this situation be improved, or is this just an intrinsic limitation of spaced repetition? I don’t know. But it seems reasonable to think some limited gains are possible. I think not a lot of people are using spaced repetition on these more “conceptual” domains, and (by the rule that most people in a community are lurkers ) even fewer of those people are writing, in detail, to share their knowledge. Plenty of people have written about how to write good flashcards in general, what I want to read is closer to case studies where someone sits down with a text (or, even better, a textbook) and describes the process by which they turned that text into flashcards, like this from Michael Nielsen. From a corpus of similar case studies we might derive general rules for, not how to write effective flashcards, but how to encode complex, conceptual knowledge into question-answer form.

0 views
Fernando Borretti 2 months ago

Notes on the Hantavirus Outbreak

Right now there’s a cruise ship parked outside Cabo Verde because of an outbreak of Andes virus . Yep, another cruise ship. I don’t get the appeal. It’s like a big open-air serial passage experiment: you get a bunch of old people with failing immune systems in close contact and race a pathogen through them. How much should I worry about this? Is this early January of 2020? I tried asking Claude but the biosecurity filter kept blocking my queries. The WHO says : Although uncommon, limited human‑to‑human transmission of HPS due to Andes virus has been reported in community settings involving close and prolonged contact. Secondary infections among healthcare workers have been previously documented in healthcare facilities, though remain rare. WHO currently assesses the risk to the global population from this event as low […] WHO advises against the application of any travel or trade restrictions based on the current information available on this event. So, hantavirus is the family. They are carried by rodents and spread by aerosols. In humans they can cause hantavirus pulmonary syndrome (HPS), which has a case fatality rate (CFR) of between 30 and 60%. Not great! Used to be these infections were mouse-to-human dead-ends. But Andes virus (ANDV), first identified in 1995, is known to spread from human to human. The last time there was an outbreak was 2018–2019 in Epuyén , Chubut , a town of 1,500 on the lee side of the Andes ( quite beautiful ). Described in this paper . 34 known infections and 11 deaths for a CFR of 32%. The $R_0$ was 2.12, reduced to 0.96 after control measures were implemented. Given the small number of cases, there should be some uncertainty about the $R_0$. But $R_0 > 1$ is the threshold for sustainable transmission. In this outbreak, the index case , while symptomatic, attended a birthday party with 100 other people, and infected five guests in 90 minutes, who went on to infect more people. The authors write: The super-spreading capability of the ANDV Epuyén/18−19 strain shows a facility ($R>2$) for sustaining continuous chains of transmission if no control measures are enforced. The appendix has some interesting stuff on how patients were infected at the birthday party. A further concern here is the incubation period: Wikipedia says the incubation period is between one and eight weeks . In the Chubut outbreak, the distribution was: Which is not good. I don’t have more data to draw a nice-looking CDF . Now this all sounds quite bad. Are there reasons to be optimistic? First, Argentina has had 710 cases of HPS in the period 1995–2008 ( Martínez 2010 ) and a further 533 cases in the period 2009–2017 ( Alonso 2019 ), and we are all still alive. In the latter period, most of these cases are from occupational/recreational exposure to rodent feces and only 1.8% of cases are from suspected human-to-human transmission. So, over 1,200 cases and every one of them fizzled out, but for one outbreak which was limited after successful contact tracing and quarantine. Second, the virus has left Argentina before: once to Switzerland in 2016, and once to the United States in 2018. In the second case the patient “while ill, [traveled] on two commercial domestic flights”. And neither export led to a general outbreak. Thirdly, in a small outbreak like the Chubut one, the $R_0$ can vary wildly from social factors unconnected to the virus, e.g. if the birthday party had not happened. You need a large $n$ to get the $R_0$ as a property of the virus itself. It’s possible the Chubut outbreak just had anomalously high transmission. What does this add up to? I don’t know. On the balance of evidence, I think this outbreak is more likely than not to fizzle out. In the interest of accountability, and putting my beliefs on record (which is the only objective way to judge the accuracy of your mental model) I’m gonna say: And yet. And yet it feels so much like early COVID, particularly with public health authorities making very complacent remarks that “it’s not that transmissible, contact tracing will work, quarantine will work”. Complacency at the start, and severity at the end, is exactly why COVID was such a fuckup. 70% probability the outbreak ends with fewer than 300 deaths. 90% probability the outbreak ends with fewer than 1,000 deaths.

0 views
Fernando Borretti 5 months ago

Some Data Should Be Code

I write a lot of Makefiles . I use it not as a command runner but as an ad-hoc build system for small projects, typically for compiling Markdown documents and their dependencies. Like so: And the above graph was generated by this very simple Makefile: (I could never remember the automatic variable syntax until I made flashcards for them.) It works for simple projects, when you can mostly hand-write the rules. But the abstraction ceiling is very low. If you have a bunch of almost identical rules, e.g.: You can use pattern-matching to them into a “rule schema”, by analogy to axiom schemata: Which works backwards: when something in the build graph depends on a target matching , Make synthesizes a rule instance with a dependency on the corresponding file. But pattern matching is still very limited. Lately I’ve been building my own plain-text accounting solution using some Python scripts. One of the tasks is to read a CSV of bank transactions from 2019–2024 and split it into TOML files for each year-month, to make subsequent processing parallelizable. So the rules might be something like: I had to write a Python script to generate the complete Makefile. Makefiles look like code, but are data: they are a container format for tiny fragments of shell that are run on-demand by the Make engine. And because Make doesn’t scale, for complex tasks you have to bring out a real programming language to generate the Makefile. I wish I could, instead, write a file with something like this: Fortunately this exists: it’s called doit , but it’s not widely known. A lot of things are like Makefiles: data that should be lifted one level up to become code. Consider CloudFormation . Nobody likes writing those massive YAML files by hand, so AWS introduced CDK , which is literally just a library 1 of classes that represent AWS resources. Running a CDK program emits CloudFormation YAML as though it were an assembly language for infrastructure. And so you get type safety, modularity, abstraction, conditionals and loops, all for free. Consider GitHub Actions . How much better off would we be if, instead of writing the workflow-job-step tree by hand, we could just have a single Python script, executed on push, whose output is the GitHub Actions YAML-as-assembly? So you might write: Actions here would simply be ordinary Python libraries the CI script depends on. Again: conditions, loops, abstraction, type safety, we get all of those for free by virtue of using a language that was designed to be a language, rather than a data exchange language that slowly grows into a poorly-designed DSL. Why do we repeatedly end up here? Static data has better safety/static analysis properties than code, but I don’t think that’s foremost in mind when people design these systems. Besides, using code to emit data (as CDK does) gives you those exact same properties. Rather, I think some people think it’s cute and clever to build tiny DSLs in a data format. They’re proud that they can get away with a “simple”, static solution rather than a dynamic one. If you’re building a new CI system/IaC platform/Make replacement: please just let me write code to dynamically create the workflow/infrastructure/build graph. Or rather, a polyglot collection of libraries, one per language, like Pulumi .  ↩ Or rather, a polyglot collection of libraries, one per language, like Pulumi .  ↩

0 views
Fernando Borretti 6 months ago

Letting Claude Play Text Adventures

The other day I went to an AI hackathon organized by my friends Lucia and Malin . The theme was mech interp , but I hardly know PyTorch so I planned to do something at the API layer rather than the model layer. Something I think about a lot is cognitive architectures (like Soar and ACT-R ). This is like a continuation of GOFAI research, inspired by cognitive science. And like GOFAI it’s never yielded anything useful. But I often think: can we scaffold LLMs with cog arch-inspired harnesses to overcome their limitations? LLM agents like Claude Code are basically “accidental” cognitive architectures: they are designed and built my practitioners rather than theorists, but they have commonalities, they all need a way to manage memory, tool use, a task agenda etc. Maybe building an agent on a more “principled” foundation, one informed by cognitive science, yields a higher-performing architecture. So I sat around a while thinking how to adapt Soar’s architecture to an LLM agent. And I sketched something out, but then I thought: how can I prove this performs better than baseline? I need an eval, a task. Math problems? Too one-shottable. A chatbot? Too interactive, I want something hands-off and long-horizon. A coding agent? That’s too freeform and requires too much tool use. And then I thought: text adventures ! You have a stylized, hierarchically-structured world accessible entirely tthrough text, long-term goals, puzzles, physical exploration and discovery of the environment. Even the data model of text adventures resembles frame-based knowledge representation systems. And there’s a vast collection of games available online. Anchorhead , which I played years ago, is a Lovecraft-inspired text adventure by Michael S. Gentry. It takes on the order of hundrds of turns to win across multiple in-game days. And the game world is huge and very open. In other words: a perfect long-horizon task. So I started hacking. The frotz interpreter runs on the command line and has a “dumb” interface called , which takes the ncurses fluff out, and gives you a very stripped command-line experience. It looks like this: It is easy to write a little Python wrapper to drive the interpreter through and : Now we can play the game from Python: send commands, get game output. Now we need the dual of this: a player. The trivial harness is basically nothing at all: treat the LLM/game interaction like a chat history. The LLM reads the game output from the interpreter, writes some reasoning tokens, and writes a command that is sent via to the interpreter. And this works well enough. Haiku 4.5 would mostly wander around the game map, but Sonnet 4.5 and Opus 4.5 manage to solve the game’s first puzzle—breaking into the real estate office, and finding the keys to the mansion—readily enough. It takes about ~200 turns for Claude to get to the second in-game day. The way I thought this would fail is: attention gets smeared across the long context, the model gets confused about the geometry of the world, its goal and task state, and starts confabulating, going in circles, etc. As usual, I was outsmarting myself. The reason this fails is you run out of credits. By the time you get to day two, each turn costs tens of thousands of input tokens. No good! We need a way to save money. Ok, let’s try something that’s easier on my Claude credits. We’ll show Claude the most recent five turns (this is the perceptual working memory), and give it a simple semantic memory: a list of strings that it can append entries to, and remove entries from using tool use. This keeps the token usage down: The problem is the narrow time horizon. With the trivial harness, Claude can break into the real estate office in ~10 turns, and does so right at the start of the game. With this new harness, Claude wanders about the town, taking copious notes, before returning to the real estate office, and it spends ~40 turns fumbling around with the garbage cans before managing to break into the real estate office. The next step, after getting the keys to the house, is to meet your husband Michael at the University and head home. Claude with the trivial harness takes about ~100 turns to find the house, with some tangential wandering about the town, and reaches day two around turn 150. Claude, with the memory harness, took ~250 turns just to get the keys to the house. And then it spends hundreds of turns just wandering in circles around the town, accumulating redundant memories, and hits the turn limit before even finding the house. Anchorhead is a long, broad game, and from the very beginning you can forget the plot and wander about most of the town. It takes a long time to see if a run with an agent goes anywhere. So I thought: I need something smaller. Unsurprisingly, Claude can make its own games. The Inform 7 package for NixOS was broken (though Mikael has fixed this recently) so I had to use Inform 6 . I started with a trivial escape-the-room type game, which was less than 100 lines of code and any Claude could beat it less than 10 turns. Then I asked for a larger, multi-room heist game. This one was more fun. It’s short enough that Claude can win with just the trivial harness. I tried a different harness, where Claude has access to only the last five turns of the game’s history, and a read-write memory scratchpad. And this one was interesting. First, because Claude only ever adds to its own memory, it never deletes memories. I thought it would do more to trim and edit its scratchpad. Second, because Claude become fixated on this red-herring room: a garden with a well. It kept going in circles, trying to tie a rope to the well and climb down. Because of the limited game history, it only realized it was stuck when it saw that the most recent ~20 entries it wrote to its memories related to various attempts to go down the well. Then I watched Claude walk away from the garden and solve the final puzzle, and hit the turn limit just two turns short of winning. Tangent: I wonder if models are better at playing games created by other instances of the same model, by noticing tiny correlations in the text to infer what puzzles and obstacles they would have written. In the end I abandoned the “small worlds” approach because the games are too stylized, linear, and uninteresting. Anchorhead is more unwieldy, but more natural. I have a bunch of ideas I want to test, to better learn how harness implementations affect performance. But I’m short on time, so I’m cutting it here and listing these as todos: The repository is here . Domain-Specific Memories: Claude’s notes are all jumbled with information on tasks, locations, etc. It might be better to have separate memories: a todo list, a memory of locations and their connections, etc. This is close to the Soar approach. Automatic Geography: related to the above, the harness can inspect the game output and build up a graph of rooms and their connections, and format it in the context. This saves Claude having to note those things manually using a tool. Manual Geography: the automatic geography approach has a few drawbacks. Without integration into the Z-machine interpreter, it requires some work to implement (parsing the currente location from the output, keeping track of the command history to find standard travel commands e.g. ) but isn’t 100% deterministic, so that mazes and dynamic rooms (e.g. elevators) will confuse the system. So, instead of doing it manually, we could give Claude a tool like . Episodic Memory: this feels like cheating, but, at the end of a run, you can show Claude the session transcript and ask it to summarize: what it accomplished and how, where it failed and why. Including a short walkthrough for how to get to the “last successful state”. This allows future runs to save time in getting up to speed.

0 views
Fernando Borretti 6 months ago

1Password Dependency Breaks Syntax Highlighting

Earlier today I noticed the syntax highlighting on this website was broken. But not fully: on reload I’d see a flash of highlighted text, that then turned monochrome. The raw HTML from showed rouge tags, but the web inspector showed raw text inside the elements. This didn’t happen in Chromium. My first thought was: there’s malformed HTML, and Firefox is recovering in a way that loses the DOM inside tags. Then I noticed it doesn’t happen in incognito. Turning my extensions off one by one, I found that 1Password is responsible. Others ( 1 , 2 ) have reported this also. If you extract the latest XPI , unzip it, and dig around, you’ll find they’re using Prism.js , a JavaScript syntax highlighter. I don’t know why a password manager needs a syntax highlighter. I imagine it has to do with the app feature where, if you have an SSH key, you can open a modal that tells you how to configure Git commit signing using. Maybe they want to highlight the SSH configuration code block (which is unnecessary anyways, since you could write that HTML by hand). But I can’t know for sure. Why write about this? Because 1Password is a security critical product, and they are apparently pulling random JavaScript dependencies and unwittingly running them in the tab context , where the code has access to everything. This is no good. I don’t need to explain how bad a supply-chain attack on the 1Password browser extension would be. I like 1Password and I was sad when Apple Sherlocked them with the Passwords app, but this is a bad sign about their security practices.

0 views
Fernando Borretti 6 months ago

Using the Brother DS-640 Scanner on NixOS

The DS-640 is a compact USB scanner from Brother . It was surprisingly hard to get it working on NixOS, so I wrote up my solution so others don’t have this problem. The bad news is you need Brother’s proprietary drivers to make this work. You need this configuration: After applying this you have to log out and in, or reboot, for the usergroup changes to apply. Note also : if you use (as I did initially), the scanner will kind of work, but it only scans the first third or so of every page. And if you want a GUI: Now, make sure the scanner is there: If you get , you either have the wrong driver or (as I did, surprisingly) a faulty USB port. In which case move the scanner to another port. should recognize the model number. The most basic test that should work: put a page in the scanner until it locks and run: This will produce a (probably not very good) scan in . Now, we can improve things using the device-specific options, which you can check with this command: Try this for a better scan: Note that some of the flags are in format and others , and if you mess it up you get a cryptic error message.

0 views
Fernando Borretti 6 months ago

Books I Enjoyed in 2025

The Apocalypse of Herschel Schoen by nostalgebraist . A revelation (ἀποκάλυψις = “unveiling”) told through the eyes of a developmentally-disabled teenager. You will never guess where it goes. This came across my desk because I really enjoyed The Northern Caves , which is both a great horror story and an evocation of the Internet forum culture of the late 2000’s. Algebraic Models for Accounting Systems . I like anything along the lines of, “let’s take a technical field that formed its ontology, vocabulary, methods etc. before modern mathematics, and set it on a modern, algebraic, formal foundation”. And this is that, for accounting. It is a pleasant read. Confessions of a Mask by Yukio Mishima . The artist’s confession. “I had decided I could love a girl without feeling any desire whatsoever”. Paul and Virginia by Jacques-Henri Bernardin de Saint-Pierre . Published in 1788, very sentimental, but I think it helped me to get in the mindset of late 17th century French society: the bucolic, Rousseauist kick, the whole “simplicity of nature” thing. This landed on my reading list because many, many years ago I read a Cordwainer Smith story called Alpha Ralpha Boulevard , and I read somewhere that the characters in the story, Paul and Virginia, were an allusion to Paul et Virginie . De Monarchia by Dante . This is another “get into the mindset of another century” book. It’s interesting because it’s written like a logical, geometric proof: there’s modus ponens and modus tollens and case analysis and proof by contradiction. But the axioms are very eclectic: quotations from various Virgil, Plato, Livy, Cicero, Thomas Aquinas et al. and Dante’s private interepretation of bits from the Bible. The theorem he wants to prove is that to attain the highest development of humanity, the whole world must be unified into a world-state ran by the Holy Roman Emperor. Building SimCity: How to Put the World in a Machine by Chaim Gingold . Nominally an oral history of the development of SimCity. That’s how he gets you. Then the trap is sprung, and you are given a history of cybernetics, WW2 fire control systems, cellular automata, artificial life, computation, Vannevar Bush, pedagogy, cognition, the World3 model, The Limits to Growth , Forrester’s system dynamics . “Unexpectedly Borgesian technical book” is one of my favourite genres. Antigone by Sophocles , in the translation of Robert Fagles . “Don’t fear for me. Set your own life in order”. The Education of Cyrus by Xenophon . I’m not sure what to make of it, honestly, but when I have the time I want to read Leo Strauss ’s lectures on Xenophon, where he expounds on the hidden meaning of the text. Borrowed Time: An AIDS Memoir by Paul Monette . The author’s account of caring for his partner who was dying of AIDS in the 80’s, while he himself was actively dying from AIDS. Frightful. The author died just a few years before HAART therapy became available. The Slave by Isaac Bashevis Singer . Singer is unique. I don’t know quite how to characterize it. His writing is very disarming and innocent without being sentimental, he is earnest and free of cynicism. A love story in 17th century Poland, after the Khmelnytsky pogroms . It’s very magical realist, in a good way, not in the hysterical sense. The world is shot through with the supernatural, but the inner lives of the characters oscillate between religious awe and a very contemporary cynicism. Dream Story by Arthur Schnitzler . The inspiration for Eyes Wide Shut . I was surprised by how much of the movie, that I thought was mostly Kubrick’s invention, is actually from the story. It’s a great mood piece: you can feel the cold of early morning in Vienna, and see the paving stones, and the gas lamps, and the carriages disappearing in the fog. The Cyberiad by Stanisław Lem . I like Lem when he’s serious ( Solaris , His Master’s Voice ) and not so much when he’s doing satire ( The Futurological Congress ) so when I picked this up years ago and saw that it was a collection of fairy tales I put it away. I tried again this year and found I actually enjoyed it, but some of the later stories go on for far too long. I think The Seventh Sally is the one everyone likes. The Magician of Lublin by Isaac Bashevis Singer . Another Singer, this time in 19th century Poland. A rake is punished by God. Short and fun. I like that Singer doesn’t write giant doorstoppers, so that quality per page is high. Mephisto by Klaus Mann . A socialist actor in interwar Germany saves his career by making friends with the Nazis. I was surprised by how Randian it was: the characters are divided into two disjoint categories, the Good, who are upper middle class, burgeois people, or aristocrats from old and noble families, and the Bad, who are vulgar, parvenus, thugs, and boors. It’s kind of ironic to think people become Nazis because of bad breeding. What Is Life? by Erwin Schrödinger . Before modern crystallography, NMR, DFT etc. people had to learn about the nanoscale through clever reasoning. Schrödinger uses the limited knowledge of the day to set up a constraint system, and finds the solution: genetic information is stored in an aperiodic, covalently-bonded crystal, and he even estimates the physical volume of the genome from experiments relating mutation rates to X-ray exposure. Satan in Goray by Isaac Bashevis Singer . Another Singer, back in the 17th century, this one is more fire and brimstone, and it’s about a historical episode I had not heard about until the last few pages of The Slave : the case of Sabbatai Zevi , a Jewish mystic who, at one point, had most of the Jewish world convinced he was the messiah. This happened in the year 1666. The novel is about what it’s like, phenomenologically, to live in a remote village in 1600’s Poland. How do you know anything about the world? People come in, from time to time, traders, and they have news, but the news are just words that come out of their mouth. And you have to interrogate them, ask questions, compare notes. Like living in a Pacific island. Has the messiah come? Is there such a place as the Ottoman Empire? Is there even a world outside Poland? Tog on Interface by Bruce Tognazzini . A book about interface design from 1992. A lot of the advice is good, and a lot of it is interesting for the historical context, and the constraints people worked with in the past. One aspect I found interesting: how many products and companies are mentioned of whose existence I can find little to no evidence today. This makes the hoarder in me sad. This one across my desk because I read a blog post implementing one of the UI ideas from the book. Term Rewriting and All That by Franz Baader and Tobias Nipkow . I feel that I understand what computation is now. Indistinguishable From Magic by Robert L. Forward . If you’ve spent years steeped in Orion’s Arm then most of the ideas in the book will not be new to you. But they were new once. And it’s interesting to read a book and think: this is where starwisps and launch loops all come from. The Shadow of the Torturer by Gene Wolfe . Surreal and a pleasure to read. Knowledge Representation: Logical, Philosophical, and Computational Foundations by John F. Sowa . Delightful, particularly the early bits about the history of logic, and many chapters explaining the work of Peirce and Whitehead on ontology. I have not finished reading this book, but I am in the first few pages of A Shorter Model Theory by Wilfrid Hodges , and I am delighted. The very first exercise in the book involves a formalization of Aquinas’ account of the trinity.

0 views
Fernando Borretti 6 months ago

Coarse is Better

When DALL-E came out, it took me a couple of weeks to pick my jaw up from the floor. I would go to sleep excited to wake up to a full quota, with a backlog of prompts to try. It was magical, miraculous. Like discovering a new universe. I compiled the best art in this post . The other day a friend ran some of my old prompts through Nano Banana Pro (NBP), and put the old models side by side with the new. It’s interesting how after years of progress, the models are much better better at making images, but infinitely worse at making art. Electron contours in the style of Italian futurism, oil on canvas, 1922, trending on ArtStation. The old Midjourney v2 renders this: NBP renders this: Admiteddly MJ’s output doesn’t look quite like futurism. But it looks like something . It looks compelling. The colours are bright and vivid. NBP’s output is studiously in the style of Italian futurism, but the colours are so muted and dull. Maybe the “trending on ArtStation” is a bit of an archaism and impairs performance. Let’s try again without: Painting of an alley in the Kowloon Walled City, Eugène Boudin, 1895, trending on ArtStation. MJ gave me this: And it looks nothing like the Kowloon Walled City . But it’s beautiful . It’s coarse, impressionistic, vague, evocative, contradictory. It’s brimming with mystery. And it is, in fact, in the style of Eugène Boudin . This, by contrast, is the NBP output: Sigh. It looks like every modern movie: so desaturated you feel you’re going colourblind. Let’s try forcing it: Painting of an alley in the Kowloon Walled City, Eugène Boudin, 1895. Make it coarse, impressionistic, vague, evocative, contradictory, brimming with mystery. This is somewhat better, but why is it so drab and colourless? Is the machine trying to make me depressed? Attar and Ferdowsi in a dream garden, Persian miniature, circa 1300, from the British Museum. Midjourney v2: It doesn’t quite look like anything. But it is beautiful, and evocative. I like to imagine that little splotch of paint on the upper right is hoopoe . The NBP output: Well, it looks like a Persian miniature . The “from the British Museum” bit, I meant that to be interpreted evocatively, rather than literally. The prompt cites a fictional object, bringing it into the existence. But NBP reads this as: no, this is a photograph of a Persian miniature in the British Museum. The Burning of Merv by John William Waterhouse, 1896, from the British Museum. Midjourney v2: It does look like Waterhouse . Semantically there’s room to argue: it looks like a woman being burnt at the stake, not the sack of a city. But aesthetically: it’s gorgeous. The flames are gorgeous, the reds of the dress are gorgeous. Look at the reeds in the background, and the black water, that looks like tarnished silver or pewter. The faces of the crowd. Is that a minotaur on the lower left, or a flower? What is she holding on her bent left arm? A crucifix, a dagger? You could find entire universes in this image, in this 1024x1024 frame. By contrast, this is the NBP output: What can one say? It doesn’t look like Waterhouse. The horsemen wear Arab or Central Asian dress, but Merv was sacked in the year 1221 by the Mongol Empire . And, again, the “British Museum” line is taken literally rather than evocatively. Portrait of Ada Lovelace by Dante Gabriel Rossetti, 1859, auctioned by Christie’s. Midjourney: This is beautiful. It is beautiful because the coarse, impressionistic brushstroke is more evocative than literal. And it actually looks like a woman drawn by Rossetti . And look at the greens! Gorgeously green. The palette is so narrow, and the painting is so beautiful. The NBP output: Pure philistinism. “Auctioned by Christie’s”, again, is meant to be evocative: “this is the kind of painting that would be sold at auction”. But NBP makes it a photograph of a painting at an auction house. Fine, I suppose I got what I asked for. But the woman doesn’t look like Rossetti! This is absurd. How can a model from 2022 get this right, and the SOTA image generation model gives us generic oil painting slop? A Persian miniature of the cosmic microwave background, from Herat circa 1600, trending on ArtStation Midjourney v2: Again: what can one say? Dream Story, 1961, blurry black and white photograph, yellow tint, from the Metropolitan Museum of Art. This is one of my favourite DALL-E 2 outputs: They remind me of The King in Yellow . I love these because of how genuinely creepy and mysterious they are. You could pull a hundred horror stories from these. It is hard to believe how bad the NBP output is: What are we doing here? The old models were beautiful and compelling because the imperfections, vagueness, mistakes, and contradictions all create these little gaps through which your imagination can breathe life into the art. The images are not one fixed, static thing: they can be infinitely many things. The new models—do I even need to finish this sentence? They’re too precise and high-resolution, so they cannot make abstract, many-faced things, they can only make specific, concrete things. We need to make AI art weird again.

0 views
Fernando Borretti 7 months ago

I Wish People Were More Public

Probably not a popular thing to say today. The zeitgeisty thing to say is that we should all log off and live terrible cottagecore solarpunk lives raising chickens and being mindful. I wish people were more online and more public. I have rarely wished the opposite. Consider this post addressed to you, the reader. I will often find a blog post on Hacker News that really resonates. And when I go to check the rest of the site there’s three other posts. And I think: I wish you’d write more! When I find someone whose writing I really connect with, I like to read everything they have written, or at least a tractable subset of their most interesting posts. If I like what I see, I reach out. This is one of the best things about writing online: your future friends will seek you out. And, from the other side, I have often written a post where, just before publishing, I would think: “who would want to read this? It’s too personal, obscure, idiosyncratic, probably a few people will unsubscribe to the RSS feed for this”. And always those are the posts where people email me to say they always thought the same thing but could never quite put it into words. I really value those emails. “I am understood” is a wonderful feeling. I try to apply a rule that if I do something, and don’t write about it—or otherwise generate external-facing evidence of it—it didn’t happen. I have built so many things in the dark, little experiments or software projects or essays that never saw the light of day. I want to put more things out. If it doesn’t merit an entire blog post, then at least a tweet. If I follow you on Twitter, and you have posted a picture of your bookshelf, I have probably scanned every book in it. This is why I appreciate Goodreads . Like many people I have been reading a lot less over the past ~5y, but since I made a Goodreads account earlier this year, I’ve read tens of books. Reading in public has helped to motivate me. You may say reading in public is performative. I say reading in private is solipsistic. Dante, in De Monarchia , writes: All men on whom the Higher Nature has stamped the love of truth should especially concern themselves in laboring for posterity, in order that future generations may be enriched by their efforts, as they themselves were made rich by the efforts of generations past. For that man who is imbued with public teachings, but cares not to contribute something to the public good, is far in arrears of his duty, let him be assured; he is, indeed, not “a tree planted by the rivers of water that bringeth forth his fruit in his season,” [ Psalms 1:3 ] but rather a destructive whirlpool, always engulfing, and never giving back what it has devoured. My default mode is solipsism. I read in private, build in private, learn in private. And the problem with that is self-doubt and arbitrariness. I’m halfway through a textbook and think: why? Why am I learning geology? Why this topic, and not another? There is never an a priori reason. I take notes, but why tweak the LaTeX if no-one, probably not even future me, will read them? If I stop reading this book, what changes? And doing things in public makes them both more real and (potentially) useful. If you publish your study notes, they might be useful to someone. Maybe they get slurped up in the training set of the next LLM, marginally improving performance. And Goodreads, for all its annoyances, is a uniquely tender social network. Finishing a book, and then seeing a friend mark it as “want to read”, feels like a moment of closeness. I have a friend who lived in Sydney, who has since moved away, and we don’t keep in touch too often, because the timezones are inconvenient, but occasionally she likes my book updates, and I like hers, and I will probably never read that avant-garde novel, but I’m glad she is reading it. It is like saying: “You exist. I exist. I remember. I wish you happiness.” Lots of people use spaced repetition , but most everyone’s flashcard collections are private. They exist inside a database inside an app like Anki or Mochi . You can export decks, but that’s not a living artifact but a dead snapshot, frozen in time. One reason I built hashcards : by using a Git repo of Markdown files as the flashcard database, you can trivially publish your deck to GitHub. My own flashcard collection is public. I hope that more people use hashcards and put their decks up on GitHub. The point is not that you can clone their repos (which is close to useless: you have to write your own flashcards) but because I’m curious what people are learning. Not the broad strokes, since we all want to learn thermo and econ and quantum chemistry and the military history of the Song dynasty and so on, but the minutiae. Why did you make a flashcard out of this Bible passage? Why does it resonate with you? Why do you care about the interpretation of that strange passage in Antigone ? Why did you memorize this poem? Computers mediate every aspect of our lives, yet most people use their computers the way they came out of the box. At most they might change the desktop background. Some people don’t even change the default icons on the macOS dock. Even most Linux users just use the stock configuration, e.g. GNOME on Fedora or whatever. I’m interested in people who customize their experience of computing. This is often derided as “ ricing ”. But agency is interesting. People who remake their environment to suit them are interesting. And I am endlessly curious about how people do this. I like reading people’s , their custom shell scripts, their NixOS config. It’s even better if they have some obscure hardware e.g. some keyboard layout I’ve never heard of and a trackball with custom gestures. I put my dotfiles up on GitHub because I imagine someone will find them interesting. And beyond my selfish curiosity there’s also the Fedorovist ancestor simulation angle: if you die and are not cryopreserved, how else are you going to make it to the other side of the intelligence explosion? Every tweet, blog post, Git commit, journal entry, keystroke, mouse click, every one of these things is a tomographic cut of the mind that created it.

0 views
Fernando Borretti 8 months ago

Ad-Hoc Emacs Packages with Nix

You can use Nix as a package manager for Emacs, like so: Today I learned you can also use it to create ad-hoc packages for things not in MELPA or nixpkgs . The other day I wanted to get back into Inform 7 , naturally the first stack frame of the yak shave was to look for an Emacs mode. exists, but isn’t packaged anywhere. So I had to vendor it in. You can use git submodules for this, but I have an irrational aversion to submodules. Instead I did something far worse: I wrote a Makefile to download the from GitHub, and used home-manager to copy it into my . Which is nasty. And of course this only works for small, single-file packages. And, on top of that: whatever dependencies your vendored packages need have to be listed in , which confuses the packages you want, with the transitive dependencies of your vendored packages. I felt like the orange juice bit from The Simpsons . There must be a better way! And there is. With some help from Claude, I wrote this: Nix takes care of everything: commit pinning, security (with the SHA-256 hash), dependencies for custom packages. And it works wonderfully. Armed with a new hammer, I set out to drive some nails. Today I created a tiny Haskell project, and when I opened the file, noticed it had no syntax highlighting. I was surprised to find there’s no in MELPA. But coincidentally, someone started working on this literally three weeks ago ! So I wrote a small expression to package this new : A few weeks back I switched from macOS to Linux, and since I’m stuck on X11 because of stumpwm , I’m using XCompose to define keybindings for entering dashes, smart quotes etc. It bothered me slightly that my file didn’t have syntax highlighting. I found in kragen’s repo , but it’s slightly broken (it’s missing a call at the end). I started thinking how hard it would be to write a Nix expression to modify the source after fetching, when I found that Thomas Voss hosts a patched version here . Which made this very simple: Somehow the version of in nixpkgs unstable was missing the configuration option to use a custom shell. Since I want to use nu instead of bash, I had to package this myself from the latest commit: I started reading Functional Programming in Lean recently, and while there is a , it’s not packaged anywhere. This only required a slight deviation from the pattern: when I opened a file I got an error about a missing JSON file, consulting the README for , it says: If you use a source-based package-manager (e.g. , Straight or Elpaca), then make sure to list the directory in your Lean4-Mode package recipe. To do this I had to use rather than :

0 views
Fernando Borretti 8 months ago

Linux on the Fujitsu Lifebook U729

This post describes my experience using Linux on the Fujitsu Lifebook U729 . The tl;dr is that it’s a delightful laptop, and Linux runs flawlessly, and all the hardware things I’ve needed run OOTB. The only difficulty I had was in disabling Secure Boot, but I figured out how to do it, which I explain below. From early 2024 my daily driver was an M2 MacBook Air, until earlier this year I broke the screen, and the repair was quoted at almost 1000 AUD. Since I used it as a desktop most of the time, this didn’t affect me much. After some flip-flopping I decided to get an M4 Mac mini. Partly for the faster CPU and more RAM, but partly because I liked the idea of LARPing like it’s the 2000s, when computers, and by extension the Internet, where fixed in physical space, rather than following everyone around. Of course this was a terrible idea. I had three working computers—a Linux+Windows desktop, a Mac Mini, and a MacBook Air that I could use as a desktop—and none of them were portable. When I went to RustForge 2025 I just brought my phone. If I wanted to travel, even within Sydney, to a demo night or math club or some such, I didn’t have a laptop to bring with me. So I needed a new laptop. And the Tahoe release of macOS was so ugly (see e.g. 1 , 2 , 3 ) it made me boot up the old Linux desktop, and start playing around with NixOS again. And I fell in love with Linux again: with the tinkering and the experimentation and the freedom it affords you. So, I wanted a Linux laptop. I had a ThinkPad X1 some years ago and it was terribly: flimsy plastic build and hardware that vastly underperformed its price. I looked around for old, refursbished workstation laptops, and, randomly, I ran into an eBay seller offering a refurbished Fujitsu laptop. The specs/price ratio was pretty good: 16 GiB of RAM and 512GiB of SSD, all for 250 AUD. And it was 12in and 1.1kg, which I like: laptops should be small and lightweight. But the thing that got me, in all honesty, was the brand. “Fujitsu laptop” sounds like colour in a William Gibson novel: “crawling into the avionics bay, Case took out a battered Fujitsu refurb, and stuck a JTAG port in the flight computer—”. I already use NixOS and a trackball and a mechanical keyboard , so a laptop that’s even more obscure than a ThinkPad is perfect for me. And it was only 250 AUD. So I got it. The only problem I had was disabling Secure Boot in order to install Linux. Otherwise: I love it. It’s small and lightweight, feels solid, the keyboard is good, all the hardware works out of the box with NixOS, and the battery life is pretty good. This section describes the problems I encountered. I tried to install Linux the usual way, when I was greeted by this: Going into the BIOS, the option to disable Secure Boot was greyed out. I tried a bunch of random bullshit: wiping the TPM, disabling the TPM. That didn’t work. What did work was this: First, install Windows 11. This came with the laptop. And the installation makes installing Linux feel easy: I had to do so many weird tricks to avoid having to create an account with Microsoft during the installation. Once Windows is installed, go into Windows Update. Under “Advanced Options > Optional Updates”, there should be an option to install Fujitsu-specific drivers. Install those. And for good measure, do a general Windows update. There should be a program called DeskUpdate on the Desktop. This is the Fujitsu BIOS update tool. Run this and go through the instructions: this should update the BIOS (the ordering seems to be important: first update the Fujitsu firmware through Windows Update, then the BIOS through DeskUpdate). Reboot and go into the BIOS (F2). You should have a new BIOS version. In my case, I went from BIOS 2.17 to 2.31 which was released on 2025-03-28: You now have the option to disable Secure Boot: After this, I was able to install NixOS from a live USB: The laptop comes with this corporate spyware thing called Absolute Persistence . It’s some anti-theft tracking device. Since the Lifebook is typically an enterprise laptop, it makes sense that it comes with this type of thing. I only noticed this because I was searching the BIOS thoroughly for a way to disable Secure Boot. The good news is disabling it is pretty straightforward: you just disable it in the BIOS. As I understand it, Absolute Persistence requires an agent running in the OS, so the BIOS support, by itself, doesn’t do anything once disabled. The following work flawlessly OOTB: Things I have not tested: To enter the BIOS: smash until you hear the beep. No need to hold down the key. To enter the boot menu: as above but with . Troubleshooting Secure Boot Non-Problems Sound (using PipeWire ) Display brightness control (using brightnessctl ) Touchscreen (I didn’t realize the screen was actually a touchscreen until I touched it by accident and saw the mouse move) Webcam (not winning any awards on quality, but it works) Fingerprint sensor Fujitsu product page ( archive.org ) Data sheet (PDF)

0 views
Fernando Borretti 8 months ago

Agda on NixOS

To install Agda and its standard library, add this to your config: Or, using home-manager : The here stands for the package set. Note that the following will not work: If you use Emacs, you probably want , which if you use , can be installed using Nix: Now, if you have a file with: So far, so good. Using the standard library however is more complicated. If you have a file with: Then will not work: Instead, create a file in the same directory with: Now will succeed.

0 views
Fernando Borretti 9 months ago

Hashcards: A Plain-Text Spaced Repetition System

hashcards is a local-first spaced repetition app, along the lines of Anki or Mochi . Like Anki, it uses FSRS , the most advanced scheduling algorithm yet, to schedule reviews. The thing that makes hashcards unique: it doesn’t use a database. Rather, your flashcard collection is just a directory of Markdown files, like so: And each file, or “deck”, looks like this: You write flashcards more or less like you’d write ordinary notes, with lightweight markup to denote basic (question/answer) flashcards and cloze deletion flashcards. Then, to study, you run: This opens a web interface on , where you can review the flashcards. Your performance and review history is stored in an SQLite database in the same directory as the cards. Cards are content-addressed, that is, identified by the hash of their text. This central design decision yields many benefits: you can edit your flashcards with your editor of choice, store your flashcard collection in a Git repo, track its changes, share it on GitHub with others ( as I have ). You can use scripts to generate flashcards from some source of structured data (e.g. a CSV of English/French vocabulary pairs). You can query and manipulate your collection using standard Unix tools, or programmatically, without having to dig into the internals of some app’s database. Why build a new spaced repetition app? Mostly because I was dissatisfied with both Anki and Mochi. But also, additionally, because my flashcards collection is very important to me, and having it exist either in some remote database, or as an opaque unusable data blob on my computer, doesn’t feel good. “Markdown files in a Git repo” gives me a level of ownership that other approaches lack. The rest of this post explains my frustrations with Anki and Mochi, and how I landed on the design decisions for hashcards. Anki was the first SR system I used. It’s open source, so it will be around forever; it has a million plugins; it was the first SR system to use FSRS for scheduling. It has really rich stats, which I think are mostly useless but are fun to look at. And the note types feature is really good: it lets you generate a large number of flashcards automatically from structured data. The central problem with Anki is that the interface is really bad. This manifests in various ways. First, it is ugly to look at, particularly the review screen. And this diminishes your enjoyment of what is already an often boring and frustrating process. Second, doing simple things is hard. A nice feature of Mochi is that when you start the app you go right into review mode. You’re drilling flashcards before you even realize it. Anki doesn’t have a “study all cards due today”, rather, you have to manually go into a deck and click the “Study Now” button. So what I would do is put all my decks under a “Root” deck, and study that. But this is a hack. And, third: card input uses WYSIWYG editing. So, you’re either jumping from the keyboard to the mouse (which increases latency, and makes flashcard creation more frustrating) or you have to remember all these keybindings to do basic things like “make this text a cloze deletion” or “make this TeX math ”. Finally, plugins are a double-edged sword. Because having the option to use them is nice, but the experience of actually using most plugins is bad. The whole setup feels janky, like a house of cards. Most of the time, if a feature is not built into the app itself, I would rather live without it than use a plugin. Mochi feels like it was built to address the main complaint about Anki: the interface. It is intuitive, good looking, shortcut-rich. No jank. Instead of WYSIWYG, card text is Markdown: this is delightful. There’s a few problems. While Markdown is a very low-friction way to write flashcards, cloze deletions in Mochi are very verbose. In hashcards, you can write this: The equivalent in Mochi is this: This is a lot of typing. And you might object that it’s only a few characters longer. But when you’re studying from a textbook, or when you’re copying words from a vocabulary table, these small frictions add up. If writing flashcards is frustrating, you’ll write fewer of them: and that means less knowledge gained. Dually, a system that makes flashcard creation as frictionless as possible means more flashcards, and more knowledge. Another problem is that Mochi doesn’t have an equivalent of Anki’s note types . For example: you can make a note type for chemical elements, with fields like atomic number, symbol, name, etc., and write templates to generate flashcards asking questions like: And so on for other properties. This is good. Automation is good. Less work, more flashcards. Mochi doesn’t have this feature. It has templates , but these are not as powerful. But the biggest problem with Mochi, I think, is the algorithm. Until very recently , when they added beta support for FSRS, the algorithm used by Mochi was even simpler than SM-2 . It was based on multipliers : remembering a card multiplies its interval by a number >1, forgetting a card multiplies its interval by a number between 0 and 1. The supposed rationale for this is simplicity: the user can reason about the algorithm more easily. But I think this is pointless. The whole point of an SR app is the software manages the schedule for you, and the user is completely unaware of how the scheduler works. The optimality is to have the most advanced possible scheduling algorithm (meaning the one that yields the most recall for the least review time) under the most intuitive interface possible, and the user just reaps the benefits. Obviously without an RCT we can’t compare Mochi/ SM-2 /FSRS, but my subjective experience of it is that the algorithm works well for the short-term, and falters on the long-term. It’s very bad when you forget a mature card: if a card has an interval of sixty days, and you click forget, you don’t reset the interval to one day (which is good, because it helps you reconsolidate the lost knowledge). Rather, the interval is multiplied by the forget multiplier (by default: 0.5) down to thirty days . What’s the use? If I forgot something after sixty days, I surely won’t have better recall in thirty. You can fix this by setting the forget multiplier to zero. But you have to know this is how it works, and, crucially: I don’t want to configure things! I don’t want “scheduler parameter finetuning” to be yet another skill I have to acquire: I want the scheduler to just work . In general, I think spaced repetition algorithms are too optimistic. I’d rather see cards slightly more often, and spend more time reviewing things, than get stuck in “forgetting hell”. But developers have to worry that making the system too burdensome will hurt retention. In Anki, it’s the interface that’s frustrating, but the algorithm works marvelously. In Mochi, the interface is delightful, but it’s the algorithm that’s frustrating. Because you can spend months and months drilling flashcards, building up your collection, but when the cards cross some invisible age threshold, you start to forget them, and the algorithm does not help you relearn things you have forgotten. Eventually I burned out on it and stopped doing my reviews, because I expected to forget everything eventually anyhow. And now they added support for FSRS, but by now I have 1700 cards overdue. Additionally: Mochi has only two buttons, “Forgot” and “Remembered”. This is simpler for the user, yes, but most SR scheduling algorithms have more options for a reason: different degrees of recall adjust the card parameters by different magnitudes. What do I want from a spaced repetition system? The first thing is: card creation must be frictionless. I have learned that the biggest bottleneck in spaced repetition, for me, is not doing the reviews (I am very disciplined about this and have done SR reviews daily for months on end), it’s not even converting conceptual knowledge into flashcards, the biggest bottleneck is just entering cards into the system. The surest way to shore up your knowledge of some concept or topic is to write more flashcards about it: asking the same question in different ways, in different directions, from different angles. More volume means you see the same information more often, asking in different ways prevents “memorizing the shape of the card”, and it acts as a kind of redundancy: there are multiple edges connecting that bit of knowledge to the rest of your mind. And there have been many times where I have thought: I would make this more solid by writing another flashcard. But I opted not to because the marginal flashcard is too effortful. If getting cards into the system involves a lot of friction, you write fewer cards. And there’s an opportunity cost: the card you don’t write is a concept you don’t learn. Integrated across time, it’s entire oceans of knowledge which are lost. So: the system should make card entry effortless. This was the guiding principle behind the design of the hashcards text format. For example, cloze deletions use square brackets because in a US keyboard, square brackets can be typed without pressing shift (compare Mochi’s curly brace). And it’s one bracket, not two. Originally, the format was one line per card, with blank lines separating flashcards, and question-answer cards used slashes to separate the sides, like so: And this is strictly less friction. But it creates a problem for multi-line flashcards, which are common enough that they should not be a second-class citizen. Eventually, I settled on the current format: Which is only slightly more typing, and has the benefit that you can easily visually identify where a card begins and ends, and what kind of card it is. I spent a lot of time arguing back and forth with Claude about what the optimal format should be. Another source of friction is not creating the cards but editing them. The central problem is that your knowledge changes and improves over time. Often textbooks take this approach where Chapter 1 introduces one kind of ontology, and by Chapter 3 they tell you, “actually that was a lie, here’s the real ontology of this subject”, and then you have to go back and edit the old flashcards to match. Because otherwise you have one card asking, e.g., for the undergraduate definition of some concept, while another asks you for the graduate-level definition, creating ambiguity. For this reason, when studying from a textbook, I create a deck for the textbook, with sub-decks for each chapter. That makes it easy to match the flashcards to their source material (to ensure they are aligned) and each chapter deck only has a few tens of cards usually, keeping them navigable. Sometimes you wrote multiple cards for the same concept, so you have to update them all at once. Finding the related ones can be hard if the deck is large. In hashcards, a deck is just a Markdown file. The cards immediately above and below a card are usually semantically related. You just scroll up and down and make the edits in place. But why plain-text files in a Git repo? Why not use the above format, but in a “normal” app with a database? The vague idea of a spaced repetition system where flashcards are stored as plain-text files in a Git repo had been kicking around my cranium for a long time. I remember asking an Ankihead on IRC circa 2011 if such a thing existed. At some point I read Andy Matuschak’s note on his implementation of an SR system. In his system, the flashcards are colocated with prose notes. The notation is similar to mine: and tags for question-answer cards, and for cloze deletions. And the cards are content-addressed: identified by their hash. Which is an obviously good idea. But his code is private and, besides, I feel that prose notes and flashcards are very different beasts, and I don’t need or want them to mix. But I think the idea of plain-text spaced repetition got bumped up the priority queue because I spontaneously started using a workflow that was similar to my current hashcards workflow. When studying from a textbook or a website, I’d write flashcards in a Markdown file. Usually, I used a shorthand like for cloze deletions. Then I’d use a Python script to transform the shorthand into the notation used by Mochi. And I’d edit the flashcards in the file, as my knowledge built up and my sense of what was relevant and important to remember improved. And then, when I was done with the chapter or document or whatever, only then, I would manually import the flashcards into Mochi. And it struck me that the last step was kind of unnecessary. I was already writing my flashcards as lightly-annotated Markdown in plain-text files. I had already implemented FSRS out of curiosity. I was looking for a personal project to build during funemployment. So hashcards was by then a very neatly-shaped hole that I just needed to paint inside. It turns out that using plain-text storage has many synergies: The result is a system where creating and editing flashcards is nearly frictionless, that uses an advanced spaced repetition scheduler, and which provides an elegant UI for drilling flashcards. I hope others will find it useful. What is the atomic number of [name]? What element has atomic number [number]? What is the symbol for [name]? What element has symbol [symbol]? You can edit the cards using whatever editor you use, build up a library of card-creating macros, and navigate the collection using the editor’s file browser. You can query and update the collection using standard Unix tools, or a programming language, e.g. using to get the total number of words in the collection, or using to make a bulk-update to a set of cards. You can use Git for version control. Git is infinitely more featureful than the change-tracking of any SR app: you can edit multiple cards in one commit, branch, merge, use pull requests, etc. You can make your flashcards public on GitHub. I often wish people put more of themselves out there: their blog posts, their dotfiles, their study notes. And why not their flashcards? Even if they are not useful to someone else, there is something enjoyable about reading what someone else finds interesting, or enjoyable, or worth learning. You can generate flashcards using scripts (e.g., turn a CSV of foreign language vocabulary into a deck of flashcards), and write a Makefile to tie the script, data source, and target together. I do this in my personal deck. Anki’s note types don’t have to be built into hashcards, rather, you can DIY it using some Python and make.

0 views
Fernando Borretti 11 months ago

Adding Planets to Celestia on macOS

tl;dr: you have to modify the application bundle. Celestia is a space simulator: you can fly around space and look at moons and exoplants, fast forward time. It is sometimes used by sci-fi artists for worldbuilding because you can easily add new stars/planets/megastructures/spacecraft. Some people have built whole virtual worlds for storytelling in Celestia. The Orion’s Arm collaborative worldbuilding project has a collection of Celestia addons so you can explore the world of the year 10,000 AT. But the documentation is sparse and old. As with many things: the biggest hurdle to starting is just knowing which files go in which directories. Celestia uses (solar system catalogue) files to define planets. These are plain-text files with a syntax resembling HCL . Let’s create baby’s first planet: below is a minimal file that adds a planet “Alpha” around the star Gliese 555 : Now, what you would hope is that there exists a standard directory like you can put this into. I spent a lot of time looking through old docs and source code for this, and I’m writing this so others don’t have to. Unfortunately, at least on macOS, you have to modify the application bundle itself. This feels morally wrong, but it works. Save the above code as , and execute: Open Celestia, and navigate to Gliese 555 (press enter, type “Gliese 555”, press enter, press g). You should see a new planet: Zooming in, you can see it’s using the built-in asteroid texture: To verify it’s reading the right file, press tilde and use the arrow keys to scroll up the logs, and you should see a line like: Celestia traverses the directory recursively, so you can put your files inside folders to organize large worldbuilding projects.

0 views

Notes on Managing ADHD

The pleasure is in foreseeing it, not in bringing it to term. — Jorge Luis Borges, Selected Non-Fictions This post is about managing ADHD. It is divided into two sections: “Strategies” describes the high-level control system, “Tactics” is a list of micro-level improvements (really it should be called “stratagems”, since most are essentially about tricking yourself). High-level advice, control systems. ADHD has a biological cause and drugs are the first-line treatment for good reasons. There is no virtue in trying to beat it through willpower alone. The first-line treatment for ADHD is stimulants. Everything else in this post works best as a complement to, rather than as an alternative to, stimulant medication. In fact most of the strategies described here, I was only able to execute after starting stimulants. For me, chemistry is the critical node in the tech tree: the todo list, the pomodoro timers, etc., all of that was unlocked by the medication. Some people can’t tolerate a specific stimulant. But there are many stimulant and non-stimulant drugs for ADHD. I would prefer to exhaust all the psychiatric options before white-knuckling it. A lot of people don’t want to take medication for shame-based reasons. There is a lot of pill-shaming in the culture. You must learn to ignore it: we are automata, our minds are molecules in salt water. As a motivating example for the “salt water automaton” view: I struggled with sleep hygiene for a long time. It felt like WW1: throwing wave after wave of discipline at it and always failing. I would set an alarm, for, say, 10pm, that said: it is time to go to bed. How many times did I obey it? Never. I was always doing something more important. What fixed it? Melatonin. I have an alarm that goes off at 8pm to remind me to take melatonin. The point of the alarm is not, “now you must log off”, which is a very discipline-demanding task. The point of the alarm is simply: take this pill. It takes but a moment. Importantly, I’m not committing to anything other than taking a pill. Thirty, forty minutes later, I want to sleep. That is the key thing: the melatonin has changed my preferences. And then I don’t need willpower to close the sixteen Wikipedia tabs or whatever, because I want to sleep more than I want to scroll, or watch YouTube. The broader perspective here is that personal growth is a dialogue between internal changes and external changes. Internal changes might come from medication, meditation, therapy, coaching, or practicing habits for a long enough time. External changes are the scaffolding around the brain: using a todo list, and using it effectively. Using a calendar. Clearing your desk so you don’t get distracted by things. Journaling, so that you can introspect and notice patterns: which behaviours leads to a good workday, and which behaviours lead to a day being wasted. Are internal changes more important? Kind of. It’s more a back and forth, where internal changes unlock external changes which unlock further internal changes. Here’s an example: you (having undiagnosed ADHD) try to set a schedule, or use a todo list, or clean your bed every day, but it doesn’t stick. So you get on medication, and the medication lets you form your first habit: which is using a todo list app consistently, checking it every morning. Then, with the todo list as a core part of your exocortex, you start adding recurring tasks, and forming other simple habits: you have a daily recurring task to make your bed, and so every morning when you check the todo list, you see the task, and make your bed, and in time, with your now-functioning dopamine system, you make a habit to make your bed every day, such that you no longer need to have that in the todo list. So the timeline is: Taking Ritalin with no plan for what you will do today/tomorrow/this week doesn’t work. Dually, an ambitious todo list will sit idle if your brain won’t let you execute it. So personal growth comes from using both internal and external changes, like a ladder with alternating left-right steps. A todo list is a neuroprosthesis that augments long-term memory for tasks. I use Todoist on my desktop and my phone. The pro plan is worth it. I don’t really think of it as an app, rather, it’s a cognitive prosthesis. The todo list provides three things: Of these, the most important is memory. The todolist is an action-oriented long term memory prosthesis. This is especially useful for habit formation: my biggest blocker with forming habits was just remembered that I’d committed to doing something. If you think, i will make the bed every day, you might do it today, tomorrow, and by the third day you forget. You’re failing by simply forgetting to show up, which is a sad way to fail. By making something a recurring task on the todo list, it ensures I will see it. In a sense, the todo list turns many habits into one. You don’t need to remember “I will make my bed every day”, “I will floss my teeth every night”, etc., because the todolist remembers all those things for you. You only need to form a single habit: checking the todo list. Analogously, I often fail to finish projects simply because I forget about them. I start reading a book, but I don’t write it down anywhere (say, in Goodreads) that “I’m reading this book” is something I have committed to. I leave the book on a table where it’s out of sight (and therefore out of mind) for all of my waking hours. I glance at it occasionally and think, oh, yeah, I was reading that book, and then I’m distracted by something else. And weeks later, when I’ve already started another book, I notice the first book, with the bookmark on page 20, abandoned. The todolist prevents this failure mode: you create a project to represent reading the book, and that project is now tracked, and when you open the todo list, you can see it in the list of active projects. In Todoist, every task is part of a project (which really should just be called a list). My sidebar looks like this: Tasks is the list for ad-hoc tasks. Mostly chores and things that don’t fit in elsewhere. Unload the dishwasher, reply to this email, etc. The only rule for this list is that everything in it must be scheduled. Groceries is self-explanatory. Ideas is the where every half-formed goal, intention, project idea etc. goes. “Go deeper into metta” and “learn how to use the slide rule” and “go penguin watching in Manly” and “write a journalling app” and “learn PLT Redex ”. I put these things here so that they don’t live in my brain. And occasionally I go through the list and promote something into an actual, active project. Blog is like the ideas list specifically ideas for blog posts. Reading List is for media I want to consume. This is divided into: fiction books, non-fiction books, technical books, blog posts, papers, games, films. Cycles is for recurring tasks. This one is divided into sections by period: daily, weekly, and above. The daily recurring tasks are things like “take vitamin D”, “meditate”, and the inbox-clearing task. Projects is a container for actual projects: an objective which takes multiple tasks to accomplish. Why lift projects into lists? Why not just use a top-level task to represent the project’s objective, and nested subtasks to represent the execution steps of the project? Because having the project in the sidebar is one mechanism I use to ensure I don’t forget about it. Every time I glance at the todo list, I can see the list of active projects. I can notice if something has not been worked on for a while, and act on it. Otherwise: out of sight, out of mind. The difficulty class of the tasks you can perform declines throughout the day. There are many metaphors for the concept of mental energy. Spoon theory , for example. The usual metaphor is that “mental energy” is like a battery that is drained through the day, in greater and lesser quantities, and is replenished by sleep. To me, energy is less like a battery and more like voltage. Some machines require a threshold voltage to operate. Below that voltage they don’t just operate slower, they don’t operate at all. Analogously, different categories of activity have different threshold voltages. For me, it’s like this: And when I wake up I have the highest possible voltage, and throughout the course of the day the voltage declines. And that’s the key difference from spoon theory: spoons are fungible across time, voltage is not. For each category of activity, there is a span of the day when I can action it. When I wake up, I do my morning routine, get some quick wins, and then I try to tackle the thing I dread the most, as early in the morning as possible, because that’s the time of day when I have the most energy and self-control. I get that done and I move on. (Another reason to do the dreaded tasks first: if you put it off to, say, late morning, well, why not put it off again? And again and again. And then it’s 7pm and you can’t even think about the task, and it’s late, and I don’t have energy, so I couldn’t even do it if I wanted to, so let’s do it tomorrow.) And then, when I have removed that burden, I work on projects. The creative, generative, intellectual things. The things that move some kind of needle, and aren’t just pointless chores. And when I run out of energy to create, I read. And when I run out of energy to read, I clean and go to the gym and do the other things. And when the sun goes down everything starts to unravel: I have zero energy and the lazy dopamine-seeking behaviour comes out. So I take melatonin, and try to be in bed before the instant gratification monkey seizes power. Typology of procrastination, approaches. In my ontology there are three types of procrastination: This is the easiest kind to address. The solution is pharmacological treatment for ADHD + having a productivity system and some tricks. This one is harder. The good thing is you know, cognitively, what you have to do. The hard part is getting over the aversion. In the short term, the way to fix this is to do it scared. Accept the anxiety. Asking for help also works, sometimes you just need someone in the room with you when you hit send on the email. You can also use techniques like CBT to rationally challenge the source of the anxiety and maybe overcome it. In the long term: write down the things you procrastinate one due to anxiety, and find the common through-line, or the common ancestor. By identifying the emotional root cause, you can work on fixing it. And this is the hardest, because you don’t know, cognitively, what the right choice is, and also you probably have a lot of anxiety/aversion around it. Many things in life are susceptible to this: you have set of choices, there’s good arguments for/against each one, and you have a lot of uncertainty as to the outcomes. And so you ruminate on it endlessly. I don’t have a good general solution for this. Talking to people helps: friends, therapists, Claude. This works because thinking by yourself has diminishing returns: you will quickly exhaust all the thoughts you will have about the problem, and start going in circles. Often people will bring up options/considerations I would never have thought of. Sometimes, if you’re lucky, that’s all it takes: someone mentions an option you had not considered and you realize, oh, it was all so simple. One thing to consider is that thinking in your head is inherently circular, because you have a limited working memory, and you will inevitably start going in circles. Writing things down helps here. Treat the decision, or the emotions behind it, like an object of study, or an engineering problem. Sit down and write an essay about it. Name the arguments, number the bullet points, refer back to things. Make the thoughts into real, physical, manipulable entities. Journaling is good for detecting maladaptive patterns and tracking your progress. I keep a hierarchical journal in Obsidian . Hierarchical because I have entries for the days, weeks, months, and years. The directory tree looks like this: In the morning I finish yesterday’s journal entry, and begin today’s. Every Sunday I write the review of the week, the first of each month I write the review of the previous month, the first of each year I review the past year. The time allotted to each review is in inverse proportion to its frequency: so a monthly review might take an hour while a yearly review might take up a whole morning. The daily reviews are pretty freeform. Weekly and above there’s more structure. For example, for the weekly reviews I will write a list of the salient things that happened in the week. Then I list on what went well and what went poorly. And then I reflect on how I will change my behaviour to make the next week go better. Journaling is a valuable habit. I started doing it for vague reasons: I wasn’t sure what I wanted to get out of it, and it took a long time (and long stretches of not doing it) until it became a regular, daily habit. I’ve been doing it consistently now for three years, and I can identify the benefits. The main benefit is that to change bad patterns, you have to notice them. And it is very easy to travel in a fix orbit, day in, day out, and not notice it. Laying it out in writing helps to notice the maladaptive coping mechanisms. Reading back over the journal entries helps you notice: when an event of type X happens, I react with Y. Today’s journal entry is a good default place for writing ad-hoc notes or thoughts. Often I wanted to write something, but didn’t know where I would file it (how do you even file these little scraps of thought?) and from not knowing where to put it, I would not do it. Nowadays I just begin writing in the journal. Later, if it is valuable to file it away, I do so. Creating a journal entry in the morning is a good opportunity to go over the goals and priorities for the day and explicitly restate them to myself. The final benefit is retrospection: I can look at the past and see how my life has changed. And this is often a positive experience, because the things that worried me didn’t come to pass, the things I used to struggle with are now easy, or at least easier. There’s a paradox with productivity: when you grind executive function enough, things that you used to struggle with become quotidian. And so what was once the ceiling becomes the new floor. You no longer feel proud that you did X, Y, Z because that’s just the new normal. It’s like the hedonic treadmill. You might feel that you never get to “productive”. Journaling helps to combat this because you can see how far you’ve come. Manage time at the macro level with calendars, at the micro level with timers. To manage time, you need a calendar (macro) and a timer (micro). At the macro level, I use the calendar very lightly. Mostly for social things (to ensure I don’t forget an event, and that I don’t double-book things). I also use it to schedule the gym: if the goal is to lift, say, five times a week, I schedule five time blocks to lift. Lifting is special because it has a lot of temporal constraints: But outside these two categories, my calendar is empty. The calendar might be useful to you as a self-binding device. If you keep dragging some project along because you “haven’t made time” for it: consider making a time block in the calendar, and sticking to it. Creating a calendar event is, literally, making time: it’s like calling . Some people use the calendar as their entire todo list. I think this kind of works if your todo list is very coarse grained: “buy groceries” and “go to the dentist”. But I have a very fine-grained todo list, and putting my tasks in the calendar would make it overwhelming. Another problem with calendars is they are too time-bound: if I make a calendar block to do something, and I don’t do it, the calendar doesn’t know it. It just sits there, forgotten, in the past. In a todo list, everything gets dragged along until I explicitly complete it. Along the same lines, the calendar is not good for collecting vague ideas and plans for things you want to do in the future, while todo lists are ideal for this. The problem with todo lists is that they’re timeless: there is no sense of urgency. You look at the list and think, I could do the next task now, or in five minutes, or in an hour. There’s always some time left in the day. Or tomorrow. You need a way to manufacture urgency. If you have ADHD you’ve probably heard of the Pomodoro method, tried it, and bounced off it. The way it’s framed is very neurotypical: it’s scaffolding around doing , but ADHD people often have problems with the doing itself. And so the scaffolding is kind of pointless. The method works well in three kinds of contexts: Overcoming Aversion: when you have a large number of microtasks, each of which takes a few seconds to a few minutes, but the number of them, and the uncertainty factor, makes the sum seem a lot larger. A classic example for me is having to reply to like ten different people. Realistically, each person can be handled in 15s. One or two might require a couple of minutes to compose a longer reply. But often I will avoid those tasks like the plague and drag them across the entire day. The pomodoro method works here because you’re basically trading (up to) 25m of pain for an entire day’s peace and quiet. So you get all the annoying little tasks together, start a timer, and go through them. And usually you’re done in maybe ten minutes. And you feel really good after, because all those annoying little tasks are done. It really is amazing what a little bit of fake urgency can do. Starting: sometimes the problem is just starting. It is very trite, but it’s true. You have something you want to want to do, but don’t want to do. I want to want to read this book, to learn this topic, to write this blog post, to work on this software project. But I don’t want to do it. The pomodoro method helps you start. You’re not committing to finishing the project. You’re not committing to months or weeks or days or even hours of work. You’re committing to a half hour. And if you work just that half hour: great, promise kept. 30m a day, over the course of a single month, is 15h of work. And often I start a 30m timer and end up working four hours, and maybe that’s a good outcome. Stopping: dually, sometimes the problem is stopping. If you’re trying to advance multiple projects at the same time, if you hyperfocus on one, it eats into the time you allocated for the others. And more broadly, spending too much time on one project can derail all your plans for the day. Maybe you meant to go to the gym at 6pm but you got so stuck in with this project that it’s 8:30pm and you’re still glued to the screen. So the gym suffers, your sleep schedule suffers, etc. Actually stopping when the pomodoro timer goes off can prevent excessive single-mindedness. Additionally, the five-minute break at the end of the pomodoro block is useful. It’s a time to get up from the computer, unround your shoulders, practice mindfulness, essentially, all those little things that you want to do a few times throughout the day. Stratagems, tricks. To select the next task, pick either the shortest or the most-procrastinated task. I don’t like the word “prioritize”, because it has two subtly different meanings: “Weak prioritization” is something everyone should do: it takes a moment to go over the todo list and drag the tasks into more or less the order in which you will do them. This keeps the most relevant tasks near the top, which is where your eyes naturally go to. “Strong prioritization” is a terrible job scheduling algorithm. Importance alone is not good enough. Consider the case where you have a very important task A which takes a long time to finish, and a less important task B which takes 5m to finish. For example, writing an essay versus replying to an email. Which should you do first? I would execute B first, because doing so in turn unblocks B’s successor tasks. If you reply to the email and then get to work on task A, the other person has time to read your email and reply to you. And the conversation moves forward while you are otherwise engaged. Of course, the pathological version of this is where you only action the quick wins: all the minute little chores get done instantly, but the big tasks, requiring long periods of concentration, get postponed perpetually. My task-selection algorithm is basically: do the shortest task first, with two exceptions: To remember something, put it in your visual field. Dually: to forget, get it out of sight. Out of sight, out of mind. The corollary: to keep something in mind, put it in your visual field; to keep it out, leave it out. My desk is very spartan: there’s a monitor, a mouse, and a keyboard, and a few trinkets. My desktop is empty. There are no files in it. The dock has only the apps I use frequently. And at a higher level, I try to keep the apartment very clean and orderly. Because everything that’s out of place is a distraction, visual noise. That’s the negative aspect: the things I remove. The positive aspect, the things I keep in my visual field: most of the time, I have two windows open on my computer the todo list occupies the left third of the screen, the right two-thirds are occupied by whatever window I have open at the time, e.g.: And so at a glance, I can see: Keep in regular contact with long-running projects. A common failure mode I have is, I will fail to finish a project because I forget I even started it. Or, relatedly: I will let a project drag on and on until enough time has passed that my interests have shifted, the sun has set on it, and it is now a slog to finish. One reason I do this is that creative/intellectual work often requires (or feels like it requires) long stretches of uninterrupted time. So I procrastinate working on something until I can find such a chunk of time. Which never comes. Time passes and the project begins to slip the moorings of my attention, as other new and shiny things arrive. And sometimes I will pick the project back up after months or years, and I have lost so much context, it’s impossible to know what I even intended. And then you procrastinate even more, because you don’t want to feel the guilty of picking up a project and realizing it has become strange and unfamiliar to you. One way to combat this is to make regular project checkins. This could be a daily or few-times-a-week recurring task on Todoist that just says “spend 30m on this project”. You don’t even have to work on the thing: just allocate fifteen minutes to hold the project in your mind and nothing else. If it’s creative writing, you might open the Word document and just look at it. If it’s a programming project: read the Jira board and look at the code again. Don’t write anything. Just read the code. You will likely come up with a few tasks to do, so write those down. Think. Plan. Build up the structures in your mind, refresh the caches. If you can do, do, otherwise, plan, and if you can’t even do that, read. When you’re doing this regularly, when you’re in regular contact with the project, when the shape of it is clear in your mind, you will have the tasks on the top of your mind, you will no longer feel that you need a giant empty runway of time to work on it, you will be able to work on it in shorter chunks. To manage long-term creative work, keep in regular contact. That doesn’t mean work on them every day, but maybe look at them every day. The pomodoro method works here. Set a timer for just 25m to keep in touch with the project. Bring all tasks, broadly defined, into one todo list. Life is full of inboxes: These are inboxes because they fill up over time and need action to empty. You can also think of them as little domain-specific task lists. “Centralizing your inboxes” means moving all these tasks from their silos into the one, central todo list. For example, I have a daily task called “catch up” to clear the digital inboxes: In this way I mostly manage to stay on top of comms. All inboxes should be at zero. You have probably heard of inbox zero. It sounds like LinkedIn-tier advice. But if you struggle with comms, with replying to people in a timely manner (or at all), inbox zero is a good strategy. There are two reasons, briefly: And, like everything: before you make it into a habit, it feels incredibly time-consuming and labour-intensive. But once you make it into a habit, it’s almost effortless. So, I will give you an example. I come in to work, and read four emails. Three could’ve been archived outright, one needed a reply from me. And I said, oh, I’ll get to it in a second. And then I got distracted with other tasks. And throughout the day I kept glancing at the email client, and thinking, yeah, I will get to it. Eventually I got used to those four emails: they are the “new normal”, and what’s normal doesn’t require action. I would think: if those emails are there, and I already looked at them, then it’s probably fine. At the end of the day I looked at the inbox again and saw, wait, no, one of those emails was actually important. That’s the failure mode of inbox greater-than-zero: the important stuff hides among the irrelevant stuff, such that a quick glance at the todo list doesn’t show anything obviously wrong. Dually, with inbox zero, if you see a single email in the inbox, you know there’s work to do. Inbox zero removes ambiguity. If there’s anything in the inbox, you know, unambiguously, you have a task to complete. If there is nothing in the inbox, you know, unambiguously, there is nothing to do. Inbox zero frees you from false negatives, where you think you’ve handled your correspondence but there’s some important email, camouflaged among the trivial ones, that has not been replied to. A problem with doing inbox zero is most communication apps (like Discord, Slack, iMessage etc.) don’t have a concept of an inbox, just the read/unread flag on conversations. Since there’s no separation between the inbox and the archive, it takes more discipline to ensure every conversation is replied to. If an inbox is overwhelmed, archive it in a recoverable way. By the time I started to become organized I’d already accumulated thousands of bookmarks, unread emails, files in my downloads folder, papers in my physical inbox, etc. It would have been a Herculean effort to file these things away. So I didn’t. All the disorganized files, I wrapped them up in a folder and threw them in my folder. Emails? Archived. Bookmarks? Exported to HTML, archived the export, and deleted them from the browser. Ideally you should do this once, at the start. And by archiving things rather than deleting them, you leave open the possibility that as some point in the future, you might be able to action some of those things. Triage the old bookmarks, sort your filesystem, etc. Bring aversion-causing tasks into an environment that you control. If you’re averse to doing something, for emotional reasons, one way to overcome the aversion is to do it as much as possible on your own terms. An example: you have to fill out some government form. You’re averse to it because you worry about making a mistake. And just the thought of opening the form fills you with dread. So, take the boxes in the form, and make a spreadsheet for them. If fonts/colours/emojis/etc. if that makes it feel more personal, or like something you designed and created. Then fill out the form in the spreadsheet. And then copy the values to the form and submit. This helps because instead of performing the task in this external domain where you feel threatened, you’re performing the task in your own domain, in your own terms. Another example: you have an email you have to reply to, and you’re anxious about it. Just opening the email client gives you a bad feeling. Instead, try composing the email elsewhere, say, in a text editor. The change of environment changes the emotional connotation: you’re not replying to an email, you’re writing a text. You might even think of it as a work of fiction, a pseudoepigraphy. Turn off notifications, check comms as an explicit task. “Interrupts” means notifications, which arrive at unpredictable and often inconvenient times. “Polling” means manually checking the source of the notifications for things to action. The obvious benefit of replacing interrupts with polling is you don’t get interrupted by a notification. The less obvious benefit is that when notifications are smeared throughout the day, it is easy for them to fall through the cracks. Something comes in when you’re busy, and you swipe it away, and forget about it, and realize days later you forgot to respond to an important message. Polling is focused: you’ve chosen a block of time, you’re committed to going through the notifications systematically. Instead of random islands of interruptions throughout the day, you have a few short, focused blocks of going through your notifications. Often I get an email while I’m on my phone and think, well, I can’t reply, typing on mobile is horrible, I’m on a train, etc. Polling usually happens at my desk so I have no excuses: I’m in the right environment and in the right mental state. This is so trite. “Put your phone on Do Not Disturb and silence notifications”. And yet it works. For a long time I resisted this because I aspire to be the kind of person who gets a message and replies within minutes. But I didn’t notice how much notifications were impairing my focus until one day I accidentally put the phone/desktop on DND and had a wonderfully productive, distraction-free day. Get someone to sit next to you while you work. If you’re struggling to work on something, work next to another person. Set a timer and tell them what you’re going to accomplish and when the timer ends tell them how you did. Just being around other people can make it easier to overcome aversion. This is why coworking spaces are useful. If you don’t have a person around, you might try Focusmate . It works for some people . Sometimes I’ll start a conversation with Claude, lay out my plans for the day, and update Claude as I do things. If I’m stuck, or if I need help overcoming procrastination, I can ask Claude for help, and it’s easier to do that in an on-going thread because Claude already has the necessary context, so I don’t have to describe what I’m struggling with ab initio . Separate planning from action, so if you get distracted while acting, you can return to the plans. Separating planning from doing can be useful. Firstly because planning/doing require different kinds of mental energy. When you’re too tired to do, you can often still plan. Secondly because by separating them you can look back and see how useful the plan was, how much you stuck to it, and then get better at planning. Thirdly, and most importantly, because for ADHD people doing can be a source of distractions that impair other tasks. From Driven to Distraction : The first item on the list referred to a cough drop. As I read it, I asked her about it. “Oh,” she answered, “that is about a cough drop someone left on the dashboard of our car. The other day I saw the cough drop and thought, I’ll have to throw that away. When I arrived at my first stop, I forgot to take the cough drop to a trash can. When I got back into the car, I saw it and thought, I’ll throw it away at the gas station. The gas station came and went and I hadn’t thrown the cough drop away. Well, the whole day went like that, the cough drop still sitting on the dashboard. When I got home, I thought, I’ll take it inside with me and throw it out. In the time it took me to open the car door, I forgot about the cough drop. It was there to greet me when I got in the car the next morning. […] It was such a classic ADD story that I’ve come to call it the “cough drop sign” when a person habitually has trouble following through on plans on a minute-to-minute, even second-to-second, basis . This is not due to procrastination per se as much as it is due to the busyness of the moment interrupting or interfering with one’s memory circuits . You can get up from your chair, go into the kitchen to get a glass of water, and then in the kitchen forget the reason for your being there. Emphasis mine. When I notice a micro-task like this, my instinct is not to do it, but to put it in the todo list. Then I try to do it immediately. And if I get distracted halfway through, it’s still there, in the todo list. A practical example is something I call the apartment survey. When I clean the apartment, I start by walking around, noticing everything that needs fixing, and creating a little task for it. Even something as simple as “move the book from the coffee table to the bookshelf”. But I don’t start anything until the survey is done. And when the survey is done, I execute it. And if I get distracted halfway through cleaning the apartment, I have the tasks in the list to go back to. Introspect to find the things that ruin your productivity and avoid them. Through introspection you can discover the behaviours that derail your productivity. Lifting in the morning derails the day. Cardio is fine, but if I lift weights in the morning, the rest of the day I’m running on -40 IQ points. The most cognitively demanding thing I can do is wash the dishes. I’m not sure what the physiology is: maybe it’s exhaustion of the glycogen stores, or fatigue byproducts floating around in my brain, or the CNS is busy rewiring the motor cortex. The point is that I try to do the cognitively-demanding things in the morning and lift in the evening. Motion also does this. I suppose it’s the H in ADHD: hyperactivity. I used to be a big pacer: put on headphones, pace my room back and forth daydreaming for hours and hours. Some days I would pace so much my legs were sore. To think, I have to be in motion. But sometimes I’ve thought enough, and it’s time to do. Music, too, derails me. If I start listening to music very soon I start pacing the room and it’s over. Music is almost like reverse methylphenidate: it makes me restless, mentally hyperactive, and inattentive. So, to be productive I have to not move too much, and be in silence, and not have fried my brain with exercise. If being organized makes you feel good, spend more on organizing your productivity system. In a sense, having a really complex productivity system is like trying to use neuroticism to defeat ADHD, to use high neuroticism to defeat low conscientiousness. There’s an element of truth to that, sure (see mastery of drudgery). But here’s the thing: you have to play to your strengths. You have to. If you like order and systems and planning but you struggle with doing, then, yeah, it might work, for you, to spend more energy on the trappings of productivity (ensuring your todo list is properly formatted, organized, etc.) if that bleeds over into making it easier to do the real, meaningful things. For example: I like emojis in my todo list. The chores have a 🧼 emoji, the comms tasks have an ✉️ emoji. That kind of thing. Makes it easy to see at a glance what kind of things I have to do, to group them by category. But Todoist doesn’t support emoji icons on tasks, unlike Notion, so adding the emojis takes a bit more effort: I have to open Raycast and search for the emoji I want and paste it into the task title. It adds a little friction each time I create a task, but the benefit is I enjoy using the todo list more. Avoid spending too much productive time on worthless chores. A productivity antipattern: indulging too much in “quick wins”. There’s this running joke, or meme, online, about the kind of person who has this huge, colossal productivity system, but they get nothing done. They have five todo list apps and everything is categorized and indexed and sorted, but their material output is zero. They complete a hundred tasks a day and when you interrogate what those tasks are they are “brush my teeth” or “reorganize my bookshelf”. There’s a lot of truth to that. Every task falls into one of two categories: the quick wins, and everything else. Life is not made of quick wins. Creative, generative, open-ended work requires long periods of focused work. A lot of unpleasant, aversion-causing things have to be done. But the quick wins are infinite: there’s always some micro-chore to do around the house, for example. I don’t have advice specifically on avoiding this. But you should notice if you’re doing it and course-correct. Don’t let procrastiation on one task derail everything else. A bad failure mode I have is: I have a task T that I have to do, but I can’t, because of some kind of aversion. But when I try to work on other things, the alarms are going off in my head, telling me to work on T because you’ve been putting this off for so long and life is finite and the years are short and all that. The end result is that because one thing is blocked, everything grinds to a halt. It’s a very annoying state to be in. And I don’t have a perfect solution, but I try to manage it but applying a sense of proportionality, “render unto Caesar” etc. You can’t ignore T forever, dually, you probably won’t solve it in the next ten minutes. But you can timebox T : allocate some block of time every day to try to advance it, or at least to work around it, e.g. to ask a friend for help, for example. And the rest of the day you can dedicate to moving other things forward. Calculate travel time ahead of time to avoid being late. I am chronically late. So if I have a calendar event like a party at someone’s home, I will go on Google Maps and measure the travel time (from my home or wherever I’m likely to be) to the destination, and make a time block for that. e.g., if it takes 30m to go to the dentist and back, this is what my calendar looks like: This ensures I leave my home on time. If it’s something especially important I often add 15m to the travel block as a buffer. Use tools that are effective and you like. What productivity app should I use? Reminders? Linear? Todoist? A bullet journal? Use something that feels good and works. That’s all. Personally I use Todoist. A lot of people think todo list apps are commodities, but when you have an app open for 98% of your screentime, the little subtleties really add up. I’ve tried using Reminders, Linear, as my todo lists, and building my own. My productivity always suffers and I always go back to Todoist. One app is better than two: the more disjoint things you have to pay attention to, the worse it is. If you’re a software engineer I strongly advise against building your own, which is a terrible form of procrastination for creative types. Thanks to Cameron Pinnegar for reviewing. Strategies Chemistry First Procrastination Introspection Tactics Task Selection Visual Field Management Project Check-Ins Centralize Your Inboxes Inbox Bankruptcy Do It On Your Own Terms Replace Interrupts with Polling Accountability Buddy Plan First, Do Later Using Neuroticism to Defeat ADHD The Master of Drudgery Put Travel in the Calendar Choice of Tools Acknowledgements Internal change: starting medication unlocks… External change: using a todo list, which provides scaffolding (e.g. daily recurring tasks) for forming new habits, which unlocks Internal change: new habits formed (make bed, brush teeth in the morning) Memory: the list remembers things for me. I’m not at the mercy of my brain randomly pinging me that I forgot to do X or I want to someday do Y. The todo list remembers. Order: the todo list lets you drag and drop tasks around, so you can figure out the ordering in which you’re going to do them. Hierarchy: the todo list lets you break tasks down hierarchically and without limit. Things I am averse to, the things I intuitively want to put off because they bring up painful emotions, are high-voltage. Creative, open-ended work is high-voltage to start, but once you get started, keeping it going is medium-voltage. Simple chores like cleaning, throwing clothes in the washing machine, etc. are low-voltage. ADHD Procrastination: you want to do the task, but can’t because of distraction/hyperactivity. Anxious Procrastination: you know you have to do the task, but you don’t want to, because it triggers difficult emotions. Decision Paralysis Procrastination: you don’t know how to execute the task, because it involves a decision and you have difficulty making the decision. The main benefit is that to change bad patterns, you have to notice them. And it is very easy to travel in a fix orbit, day in, day out, and not notice it. Laying it out in writing helps to notice the maladaptive coping mechanisms. Reading back over the journal entries helps you notice: when an event of type X happens, I react with Y. Today’s journal entry is a good default place for writing ad-hoc notes or thoughts. Often I wanted to write something, but didn’t know where I would file it (how do you even file these little scraps of thought?) and from not knowing where to put it, I would not do it. Nowadays I just begin writing in the journal. Later, if it is valuable to file it away, I do so. Creating a journal entry in the morning is a good opportunity to go over the goals and priorities for the day and explicitly restate them to myself. The final benefit is retrospection: I can look at the past and see how my life has changed. And this is often a positive experience, because the things that worried me didn’t come to pass, the things I used to struggle with are now easy, or at least easier. There’s a paradox with productivity: when you grind executive function enough, things that you used to struggle with become quotidian. And so what was once the ceiling becomes the new floor. You no longer feel proud that you did X, Y, Z because that’s just the new normal. It’s like the hedonic treadmill. You might feel that you never get to “productive”. Journaling helps to combat this because you can see how far you’ve come. I lift exactly n times per week. I lift at most once a day. I lift in the evening, which potentially clashes with social things. There are adjacency constraints, e.g. doing shoulders the day before chest is bad. There is at least one rest day which has to be scheduled strategically (e.g. to have maximal distance between successive deadlift sessions). Overcoming Aversion: when you have a large number of microtasks, each of which takes a few seconds to a few minutes, but the number of them, and the uncertainty factor, makes the sum seem a lot larger. A classic example for me is having to reply to like ten different people. Realistically, each person can be handled in 15s. One or two might require a couple of minutes to compose a longer reply. But often I will avoid those tasks like the plague and drag them across the entire day. The pomodoro method works here because you’re basically trading (up to) 25m of pain for an entire day’s peace and quiet. So you get all the annoying little tasks together, start a timer, and go through them. And usually you’re done in maybe ten minutes. And you feel really good after, because all those annoying little tasks are done. It really is amazing what a little bit of fake urgency can do. Starting: sometimes the problem is just starting. It is very trite, but it’s true. You have something you want to want to do, but don’t want to do. I want to want to read this book, to learn this topic, to write this blog post, to work on this software project. But I don’t want to do it. The pomodoro method helps you start. You’re not committing to finishing the project. You’re not committing to months or weeks or days or even hours of work. You’re committing to a half hour. And if you work just that half hour: great, promise kept. 30m a day, over the course of a single month, is 15h of work. And often I start a 30m timer and end up working four hours, and maybe that’s a good outcome. Stopping: dually, sometimes the problem is stopping. If you’re trying to advance multiple projects at the same time, if you hyperfocus on one, it eats into the time you allocated for the others. And more broadly, spending too much time on one project can derail all your plans for the day. Maybe you meant to go to the gym at 6pm but you got so stuck in with this project that it’s 8:30pm and you’re still glued to the screen. So the gym suffers, your sleep schedule suffers, etc. Actually stopping when the pomodoro timer goes off can prevent excessive single-mindedness. Additionally, the five-minute break at the end of the pomodoro block is useful. It’s a time to get up from the computer, unround your shoulders, practice mindfulness, essentially, all those little things that you want to do a few times throughout the day. “Weak prioritization” means to sort a list of tasks by some unspecified criterion, that is, to establish an order where some things are prior to another. “Strong prioritization” is to sort a list specifically by importance. Stalled tasks get a priority bump. If I created a task weeks ago, or if I’ve been postponing in for many days in a row, it has to be done now. Content-dependence: if I’m working on a particular project, I’d rather focus on tasks from that project, rather than from the global todo list. What I’m currently working on. What I will work on next. The list of active projects, so that I don’t forget they exist. DMs on Twitter, iMessage, WhatsApp, Signal, Discord, etc. Twitter bookmarks Browser bookmarks Your Downloads folder. Messages in my myGov inbox. The physical mailbox in my apartment. Go through all my communication apps (email, Discord, Twitter DMs etc) and triage the unread conversations: if something needs replying to, I either reply immediately or make a task to reply later so I don’t forget. File the contents of my Downloads folder. Go through Twitter/browser bookmarks and turn them into tasks (e.g., if I bookmark an article, the task is to read the article). Inbox zero has no false negatives: if an inbox is empty, you know you’ve handled everything. Important communications have a way of “camouflaging” themselves among irrelevance. How To Do Things describes an ADHD-friendly version of the Pomodoro method. It’s a 50 page PDF with no fluff, so it’s worth buying to support writers who don’t waste the reader’s time. Getting Things Done has a lot of good advice (e.g. dump your entire brain into the todo list) but it’s somewhat neurotypical in that it’s assumed you won’t have any problems actually executing the tasks.

0 views

Inboxes are Underrated

I have a lot of communication apps. By volume: Twitter DMs, Signal, Whatsapp, iMessage, Discord, email. Because I have so many disjoint places where communication happens, I have a daily task on Todoist to go through each of these, and ensure that every conversation is handled, where “handled” means: if I can reply immediately, I do so; otherwise, I make a task to reply. Polling is better than interrupts. But this is imperfect, because often I get distracted, and I do neither. Sometimes I read the other person’s message, and mentally begin drafting a reply, but forget to make a task. Sometimes I check DMs outside of this timeblock, when I’m less disciplined about following the checklist. Sometimes I’m interrupted before I can create the task. And so on. And all of these systems have a concept a conversation being read/unread, but it is fragile: touch it and it goes away. So if I don’t reply immediately, and I don’t make a task, I might never reply. And then new conversations pile up, burying the old ones. Email is where I get the least human communication, but it is the one system that has an inbox. And the inbox is invaluable for me, because it acts as a domain-specific todo list: it draws a hard line between the things that have been handled (archived), and the things that are not (inbox). Crossing this line requires an explicit act. With email, I can execute this algorithm: Because archiving requires an explicit action, there’s no possibility of forgetting to handle a conversation. This is the utility of inbox zero: it has no false negatives! If the inbox is empty, I know that all of my correspondence has been handled. If the inbox is non-empty, I know there is work to do. Why do so few apps have inboxes? Probably because most people never archive their emails, they just keep everything in the inbox. And probably the concept of an inbox reminds them of email, and email feels old and corporate and spammy. Most of the email I get is transactional (e.g. login codes), notifications, and spam. For people like me who want to be conscientious about communication, and who need mechanical help to achieve that, the lack of an inbox is really, really frustrating. And while inboxes could be entirely local to the client software, the protocol doesn’t have to implement the inbox/archive distinction. But communication protocols are increasingly locked down , so that you can’t bring your own client, with your own features. Tangentially: inbox zero is not an obvious practice at all. Rather than relying on the user to implement the inbox zero workflow, the client should make triaging a first-class workflow. Like spaced repetition: you open Anki , click “Study”, go through the flashcards due today, choosing either “Forgot” or “Remembered”. You open the email client, click “Triage”, and go through one conversation at a time, and choose either “Delete”, “Archive”, “Reply”, or “Skip”. Usually I archive a conversation immediately after replying, but sometimes you need a reply from the other person. So I make a task on my todo list that says “Waiting for a reply from X”. The idea is from Getting Things Done . If the person doesn’t reply, the existence of the task reminds me to ping them again. Otherwise I will certainly forget about it.  ↩ For each conversation in the inbox: If it’s spam, delete it. If it doesn’t need a reply, archive it. If I can reply immediately, reply and archive the conversation 1 . If I can’t reply immediately, make a task to reply. Usually I archive a conversation immediately after replying, but sometimes you need a reply from the other person. So I make a task on my todo list that says “Waiting for a reply from X”. The idea is from Getting Things Done . If the person doesn’t reply, the existence of the task reminds me to ping them again. Otherwise I will certainly forget about it.  ↩

0 views