Latest Posts (20 found)
Unsung Today

“Literally hundreds of glitches”

A video from DarkViperAU showing a collection of bugs in Grand Theft Auto 5 : = 2x) and (width >= 700px)" srcset="https://unsung.aresluna.org/_media/literally-hundreds-of-glitches/yt1-play.2096w.avif" type="image/avif"> = 3x) or (width >= 700px)" srcset="https://unsung.aresluna.org/_media/literally-hundreds-of-glitches/yt1-play.1600w.avif" type="image/avif"> This is fun to watch in part because of the context – you see various strange states, people thrown around with GTA’s signature ragdoll physics, random explosions. But what I found satisfying was trying to figure out what might have gone wrong. Some of these are mistakes in the rendering engine, others in the scripting logic, and in many cases you can imagine a simple statement that could have prevented the problem. Mostly, it’s all a testament to the game’s complexity. Most of these are edge cases, corner cases, or whatever comes after corner cases (3D corner cases?). (This concludes our little 4-post Grand Theft Auto series. Previously, we talked about a particularly tricky bug and the way GTA streams cities .)

0 views
Unsung Today

“If this somehow reaches Rockstar”

Grand Theft Auto Online was to Grand Theft Auto V what World of WarCraft was to WarCraft 3: a 2013 release that allowed people to play online together, cooperatively or competitively. But the game had a problem. The single-player mode booted up quickly, but the online mode took over 5 or 6 minutes to load. It was a surprisingly lengthy load time, and it stayed this way for years. Eventually, in 2021, a player going by t0st got so bothered by it that they decided to try to fix it themselves. This is a write-up of how they approached it . It’s pretty technical, but there is something really interesting and even inspiring seeing an amateur just go after code this way: = 2x) and (width >= 700px)" srcset="https://unsung.aresluna.org/_media/if-this-somehow-reaches-rockstar/1.2096w.avif" type="image/avif"> = 3x) or (width >= 700px)" srcset="https://unsung.aresluna.org/_media/if-this-somehow-reaches-rockstar/1.1600w.avif" type="image/avif"> The culprit was one particularly inefficient, unoptimized loop. t0st not only managed to fix it for themselves, but their essay and fix did indeed reach Rockstar; the company patched the game for everyone within a few weeks, and then awarded t0st a $10,000 bounty. As you already know from Unsung, I won’t let this remain just a cute warm-feeling story. When I think of this, I think of 5 or 6 minutes, times 8 years of this bug existing, times however many users started the game each year. This is awful. I wonder what happened in Rockstar’s culture that allowed this kind of a simple thing to remain unfixed, despite them likely knowing very well about people’s complaints (as is obvious from the beginning of the post above). Here are two good comments from Hacker News showing it likely wasn’t even just bad user experience, but also a bad business decision: But how could Rockstar not do this? GTAV is so full of great engineering. But if it was a CPU bottleneck then who works there that wouldn’t just be irked to try to nail it? I mean it seems like a natural thing to try to understand what’s going on inside when time is much higher than expected even in the case where performance is not crucial. It was crucial here. Almost directly translates to profits. Unbelievable. I am absolutely shocked about this finding. The amount of money on microtransactions Rockstar lost because of this single issue must be gigantic. The amount of people that got turned off by the loading times over the years is massive. It’s mind boggling. But I did also like this comment: Honestly, while this horrible code is mildly offensive to me, I’m pretty impressed by this person’s persistence. It’s one thing to identify a bug in a compiled program, but it’s another to patch it without fully understanding what’s going on. Caching was a particularly clever trick that sidestepped a bunch of more complicated solutions.

0 views

An Interview With Eric Seufert About Agentic Commerce

An interview with Eric Seufert about agentic commerce, including why he thinks ads will be the answer, and why I want retailers who cater to agents.

0 views
iDiallo Today

SO Is Back! No, Not Stack Overflow, but Its Spirit

One thing people complained about most on Stack Overflow was having their questions closed and marked as duplicates of other questions that were only slightly related. The poster would argue in the comments, trying to make the case that their question was different, only for it to fall on deaf ears. Then LLMs came along and ate Stack Overflow's lunch. An LLM will answer your question, and with even more vigor if a related question exists online. Everyone was happy, until the LLMs suddenly stopped responding. Along the way, we decided that LLMs are too dangerous and shouldn't answer every development question. If your prompt sounds, even vaguely, like you are trying to circumvent security, the model drops your request and flags your account. Do it enough times, and your account is closed for good. Now it's no longer smug developers closing questions. You are left with an unanswered prompt and no one to pin the fault on. Even when they don't blatantly stop you in your tracks, the answers can feel gated, as if the model knows the answer but deliberately won't tell you. Now, I was never so much against marking questions as duplicates. In the majority of cases I encountered, the person asking could have benefited from reading the original question. You don't get a full answer, but it serves as a guide that helps you find a solution. With LLMs withholding answers, the fix is often to pay for a more expensive model. So maybe it's not so much Stack Overflow as ExpertSexChange that is back.

0 views

Ground Stoppage: $1,825.15

I’m one of those lucky few that was trying to get on an airplane on Friday evening, November 13th. Just for my own memories and whatnot, I thought I’d write up my journey. I was visiting friends in Wichita, Kansas. My flight back home to the Redmond, Oregon, airport was that Friday at 3:37pm. Naturally, I got to the airport about 9am because I’m a weirdo who likes getting work done at airports. So I was already at the airport about 6 hours before the first delay. 4:40pm. Dicey. I needed to make a connection in Minneapolis and then another after that in Seattle. An hour delay is going to make that ultra tight. Delta’s automated systems kicked in on that first delay, re-routing me to Salt Lake City instead of Seattle for an easier 2nd connection. But then that first flight was delayed until 5:45pm. We knew about the FAA grounding by then, but it seemed like everyone was holding out hope it would be lifted and we’d be on our way. Then the delay was until 7:00pm. I chatted with the gate agent, and she was like… ehhhh you should probably just bail. I appreciated the honesty. Added cost to the trip already, but I’d rather be comfortable and get work done, so the DoubleTree it was. $132.85 for a one-night stay that night. Fortunately there was also a baggage dude standing there while I was chatting with the gate agent, and he was kind enough to go snag my luggage so I’d have that. I Uber’d over there, so that cost a few bucks. Sitting at the hotel, I was evaluating my options. I got through on the phone to Delta, and they told me that the original first flight would still indeed be leaving! 1:00am, though. So I took a shower and got an hour or so of sleep and woke up to head back over to the airport. Fortunately I saw before I got too far that Delta had actually fully cancelled the flight, so I just went back to sleep. In the morning, I was looking at options again. I was rebooked onto a flight on Monday, which just felt way too long to me. So I poked around online and found a route I could get home on Saturday if I could get myself to Kansas City. So I pulled the trigger on that flight. $1,292.50. Yikes. But I figured I’d get the original flight refunded at least partially. Or something? Kansas City is three hours away by car. So I rent a car from Hertz, as some research suggested my AmEx card might have some travel disaster protection and offers refunds if you choose the right partners, and Hertz was one of them. $182.17 for that car rental, but it goes smoothly and I drive up to KC. I make the flight in Kansas City to Minneapolis just fine, despite an hour delay in leaving. I would have missed the Minneapolis to Seattle flight, but the Seattle flight was delayed in leaving too, so I made it. I get to Seattle with enough time to connect to the Redmond flight but… that flight was fully cancelled . Just no way home, again. It was super late now, and I was exhausted and demoralized. I wasn’t about to sleep on the airport floor, so I booked another DoubleTree. $169.63. I managed to find the free shuttle over there. Arriving there, it was cold and raining, and a raccoon charged me while I was standing at the front door of the hotel (wtf?!!). Then inside, there was quite a line to get checked in, and I was just 1000% wiped. I ultimately got my key and just flopped into bed and slept. The next morning I got back to the airport and caught my flight home fine. Two extra days of parking at the Redmond airport cost $48. Other than that $48 and some forced restaurant meals, I didn’t have to spend that extra $1,825.15. I could have slept on the floors of public buildings and just took whatever flights Delta gave me. But that would have turned my ~60-hour trip home to a ~100-hour flight home, and I’m not sure I could physically handle it.

0 views

Inside PyPy: first contact with RPython

I get restless now and then and I want to implement a programming language. Then after mustering the resolve, I stew, for there is no good implementation language. 1 What am I to do, build my own programming language so that I can then use it to implement the first language? So I go back to modifying an existing implementation instead. There do exist established general-purpose tools for building fast programming language implementations: And more nascent ones such as Deegen , which was used to reimplement Lua. They each take different approaches: While none of these spark joy , they do each have benefits, including accomplishing the primary goal of offloading a lot of the language runtime choices and nasty details. In this post we will take a first look at RPython because it is the kind of VM implementor’s programming language that I keep thinking about. More on that later. Before we continue, please heed this warning: RPython is an implementation detail of PyPy. It has not had the years of polish that the rest of the system has had. Please do not badger maintainers. We’re going to build a little program in RPython. I am mostly following along with the docs , specifically Getting Started with RPython . There’s a little more ceremony than you might be used to and that’s because we’re going to run this file in two modes: normal Python 2 interpreter and compiled to C. This is the weirdness of RPython. If you don’t have installed, you can install PyPy, which helpfully still implements Python 2. If this all went fine, you will see it print . None of this is RPython yet . For that, we need a hint more ceremony. This is when we clone the PyPy project, in which we will find RPython. Now edit the Python program. Below the definition, add the following function: This function looks unused, but it is actually a hint to RPython: this is where the compiler should start translating. Let us now compile this program. Either inside the PyPy directory or with , run: If all goes well, you will see a whole mess of output, including a partially rendered Mandelbrot fractal. Finally, you will see something like: This is the RPython compilation process. In it, RPython is analyzing types, removing memory allocations, monomorphizing functions, and generating C code. Then it hands this C code off to a C compiler to compile. You should have in your current directory an executable named , which you can run like . It should also print . So far, this is not so different from Python. But let’s try something Pythonic. Let’s see what happens when we also use to mean string concatenation. Under normal Python 2, this will work just fine, printing and then . Under RPython, though, you get this inscrutable error (again, rough edges): and are unceremoniously dropped into the debugger, Pdb (hit Ctrl-D or type ). From this message you are meant to intuit that RPython did not enjoy that two different types flowed into the function. It helpfully tells you that there was a when trying to reconcile the and types that flowed into the function’s first parameter. It then gives you a pointer to the offending line and an IR dump. This happens because RPython requires function parameters to be monomorphic. Though the variables are syntactically untyped, RPython computes a type analysis to discover what type each variable should be. When and both flow into , boom, complaint. 2 To get around this, we do what all good C++ programmers do and we templatize the function. The RPython spelling of this is, as with many other features, a function annotation: You will find now that RPython happily compiles the program. This works because it makes a new copy of for every input type of the first ( ) argument. “Hey wait a minute,”, you might ask, “doesn’t this mean it stops being a valid Python 2 program?” Great question. No. You can still run the program as long as you provide the location of the RPython libraries via (as before): This runs ~instantly, which is a big relief. Developing an interpreter project with a 30 second or more turnaround time for each compile would be really frustrating. This has been a taste of RPython, both great and somewhat frustrating. I intentionally made it about RPython as a programming language rather than being so focused on RPython as a programming language implementation tool because I want some of its features to exist in a general purpose programming language… that then also might be used to implement other programming languages. I bring it up because I want to rehash the stuff that I occasionally grumble about in the vicinity of PLDI but for some reason have not written about online. Perhaps writing about it will encourage people. I think there is a lot of good stuff in RPython: I wish some stuff were different, or at least modifiable: I will probably add more to this list as I continue to remember some years of these conversations. Wouldn’t this be great? I don’t really have the time, energy, or expertise to build such a thing. There are so many design decisions along the way. It would probably accidentally grow to be huge and ossify along the way, and what a bummer that would be. If you have any pointers to existing projects or a way to implement such a thing in a really lightweight form (read: sub 10k lines, portable ideas), I would be very interested. Here are some pointers to other projects in the neighborhood: Thanks for CF Bolz-Tereick first for allowing me to talk their ear off about this for years and second for reviewing this post. I don’t want to implement atop Racket. C++ and C give me endless nightmares and are completely DIY. Yes, yes, I have built large VMs on C++ and C before. One time I posted so hard about the frustration that my tech lead unfollowed me on Twitter. I don’t really want to try to think about GC in Rust.  ↩ I initially thought any variable had to be monomorphic but I could not get an error from programs such as .  ↩ RPython, which has PyPy (Python) as its primary success story but also can claim Topaz (Ruby) and a couple of other smaller ones Truffle, which is the foundation of TruffleRuby, GraalPython, GraalJS, and even Sulong (LLVM) Deegen requires you to write your bytecode interpreter and type system in a C++ DSL. From this it generates an interpreter, a baseline JIT compiler, and, hopefully eventually, an optimizing JIT compiler. Truffle requires you to write an AST or (newly) bytecode interpreter in an Annotation-based Java DSL. From this it specializes guest language code before emitting Graal IR, which uses aggressive partial evaluation to generate optimized code. RPython requires you to write an interpreter in a restricted dialect of Python 2 that acts more like Java or Go than Python. The RPython compiler will then analyze your code, translate your “Python” program into C code bundled with RPython IR, and then “tier up” from the C code to JITed code at run-time. In order to go from “random RPython program” to “JIT compiler”, you need to participate in its meta-tracing , which requires annotating where your interpreter loop loops. Compile to native AOT with additional JIT. Seems like this provides good start-up performance with (optional!) tier-up as the runtime system observes the system’s behavior. Automatic memory optimization. There is no good way to syntactically express how an object should be allocated—Python is, after all, a very high-level language—so Python programs are profligate allocators of memory. RPython programs would be the same except that the AOT compiler does a whole-program analysis to try and remove these allocations. The JIT does too, but via a different mechanism. The JIT is provided to you. You don’t have to think about program analysis; the PyPy authors think about it for you. It is possible to do manual memory layout via so that you can write better data structures than Python would otherwise let you express. It provides a garbage collector for you. Furthermore, it handles all the stack scanning stuff and “oop maps” so you don’t have to build handles/ /… yourself. RPython does its partial evaluation and automatic JIT creation via meta-tracing . It is one of the last surviving tracing JIT compilers (alongside LuaJIT and, kind of, HHVM). For a lot of programs, method-based compilers seem to have produced better, or at least more predictable, results. I kind of want to see what a meta-method-JIT would look like. The user experience leaves something to be desired. I want better error messages, faster compiles, and less output. I want thorough docs. I want better performance feedback. This is in line with the rest of my ramblings about mechanical sympathy: the runtime should tell you what is wrong. I (or CF) shouldn’t have to stare at IR in traces and go “hmmmmm…” It requires writing a lot of your tooling anew. Even if I had, for example, a JavaScript parser written in Python, it likely wouldn’t be in Python 2 and it likely would not work well with RPython’s special rules. Runtimes such as JRuby get around this by compiling parsers (Prism) to WebAssembly and then bundling a WebAssembly interpreter written in Java. Along these lines, I would like more help with lexing and parsing, for which I have so little patience. I think it would be neat if it had a way to pause and save an “image” of the heap. After all, RPython is in control of all the memory and the code. It would be neat if, in addition to a JIT, it also helped you build an AOT compiler for your guest language. What if your language is statically typed? Should the toolkit provide functionality for type checking? Type inference? Some solution for C code. You can call it and stuff just fine but there’s no Sulong equivalent so it’s a totally opaque barrier to optimization. Don’t write your runtime helpers in C, sure, but at some point you have to interact with outside code. Weval, which turns an interpreter into a baseline AOT compiler. Its current implementation requires the interpreter to be compilable to Wasm and then its heap snapshottable with Wizer. One can imagine this technique being used instead to implement a JIT instead of an AOT, thereby also sidestepping the snapshot requirement. One might also imagine this applying to another IR than WebAssembly. Say, LLVM… semPy, which is an executable semantics for Python. Zig and other languages such as the more nascent k1 have the ability to run and generate code at build-time. Perhaps someone could implement a VM toolkit in one of these languages. I think a lot of the effort would still go toward something like GC handles if you want a moving GC. I don’t want to implement atop Racket. C++ and C give me endless nightmares and are completely DIY. Yes, yes, I have built large VMs on C++ and C before. One time I posted so hard about the frustration that my tech lead unfollowed me on Twitter. I don’t really want to try to think about GC in Rust.  ↩ I initially thought any variable had to be monomorphic but I could not get an error from programs such as .  ↩

0 views

2026-11-18 22:11: Last few weeks we've seen PHP2Shell, Brotli, Java4Shell, Nginx, and another PHP critical vuln imminent....

Last few weeks we've seen PHP2Shell, Brotli, Java4Shell, Nginx, and another PHP critical vuln imminent. AI is really gonna fuck things up. This shit needs regulating. Fast. Thanks for reading this post via RSS. RSS is ace, and so are you. ❤️ You can reply to this post by email , or leave a comment .

0 views
Unsung Today

“The download numbers of the mod broke all records at our site.”

Grand Theft Auto: San Andreas followed in the footsteps of 2002’s GTA: Vice City, and was released in 2004. (Subsequent versions were IV from 2008, V from 2013, and VI, launching right now .) Here’s a 2012 story at Eurogamer , written by Simon Parkin, about the infamous Hot Coffee minigame , unlocked in San Andreas by a third-party mod. It all started with a last-minute decision to remove some sex scenes that were originally meant to be published in the game: The question now was how to extract the explicit material without breaking the wider game’s functionality so close to release. An emergency meeting was called so that the senior managers could discuss a solution. During the meeting Houser explained: “You can’t always take a thing out of a game.” He had an alternative solution: rather than remove the content, the team could ‘wrap’ the sexual scenes so that while the relevant code would still be present on the game disc, it would be impossible for the player to access from within the game. As he put it in an internal email sent at a later date: “We locked it away because there was no other way to get the game done on time – safely. The code is very interwoven in [GTA] and everything reacts to everything else. The impact of yanking something late is too scary.” The decision was made. The sex would remain, but the sex would remain hidden. The idea was perhaps to unlock the scenes later via an official patch, but we all know what happens to content hidden in game’s code – inevitably, a curious nerd will find it and then talk to other nerds about it: The video showed that the content wasn’t a hidden cut-scene but a pair of playable mini-games. In one, dubbed the “spanking game” by Wildenborg, players were invited to smack CJ’s girlfriend on the backside, rhythmically tapping a button to raise an “excitement” bar. In the “shagging game”, players moved the analogue stick in time with the characters’ bodies to increase excitement. Both characters remained fully clothed and there were no genital shots. But this was still the most explicit sexual content Wildenborg had seen in a video game. “It was at this point I decided to release the patch to the public,” he says. “I tossed the name «Hot Coffee» on the file, based on the fact that the girlfriends would ask CJ in for some «coffee» as a euphemism for sex. Hot Coffee was the first modification for San Andreas.” Despite not owning a copy of the game himself, with two days still to go before the game’s European release, Wildenborg had spilled Hot Coffee. Then everything blew up. I’ll let you read the rest . It’s an interesting story that contains some good observations – “Houser understood the great contradiction at the heart of Western culture: tolerance towards violence versus intolerance towards sex” – although I am somewhat doubtful that the game creators were interested in pushing the public debate as much as they were in generating marketing-friendly controversy. If you agree with that correction, it becomes an even more interesting story in that it doesn’t portray anyone involved in a particularly positive light.

0 views
Unsung Today

“It was awful, it was too sim-y.”

The original Grand Theft Auto – known in early production as Race ’n’ Chase – had a problem: it just wasn’t too fun to play. The driving was there, the buildings were there, the missions were there, but the joy wasn’t. What injected the right amount of joy was… an unexpected bug. When the player earned a “wanted” status, the game dispatched some cop cars to chase them. As they do, the cop cars had a particular pathfinding algorithm where they meant to converge on a player. But within that algorithm, there was a mistake, as described by one of the game’s creators : […] the other thing that was a problem was the handling – the car handling was appalling. There was a point in it where you used to have a button for opening the doors and it was just rubbish. I can’t remember if this is true because we used to joke about it that you even had to start the engine. It was awful, it was too sim-y. And there was a whole living city thing that crept into it. That kind of inspires people to be more realistic and simulate more often. That steers you in a certain direction. But there were people on the team constantly trying to get that fixed. So the core of playing was fundamentally broke. There were steps being taken to fix that, but it wasn’t really gelling together. The police behaved really badly, the way they originally worked was just rubbish. Then one day, I think it was a bug, the police suddenly became mental and aggressive. It was because they were trying to drive through you. Their route finding was screwed I think and that was an awesome moment because suddenly the real drama where, “Oh my God, the police are psycho – they’re trying to ram me off the road.” That was awesome, so that stayed in. It was tweaked a little bit, but that stayed in because that was great fun. Suddenly the game got more dramatic and it’s no longer boring – the police trying to pull you over. They’re after you, they’re trying to ram you off the fucking road. Everybody suddenly went, “Hey, this is actually pretty cool. There’s something in this, this is working.” It was less about the mission stuff, which we always thought was another mess, and more about just general play – just being able to piss around. I don’t think we’ve ever seen the code or the bug in question. I found the story interesting, not only because it teaches us that you can’t really work your way around bad mechanics (this can be as true for serious apps as it is for videogames), but also because it highlights the interesting push and pull between realism and fun. The game was eventually released in 1997 and spawned a best-selling series.

0 views
Unsung Yesterday

Le Monde’s interesting cookie pop-up

Cookie banners and pop-ups are bad not just because they are a nuisance , but also because so many try to trick you into choosing the setting that benefits the advertisers and reduces your privacy: the default option is the one bad for you, and the non-default one makes you jump through the hoops, mainfested as confusing dialogs with subpar, multi-clicks interfaces, with plausible deniability of “well, we’re giving the user control.” But I just went to the website of the French newspaper Le Monde , and saw something really interesting: = 2x) and (width >= 700px)" srcset="https://unsung.aresluna.org/_media/le-mondes-interesting-cookie-pop-up/1.2096w.avif" type="image/avif"> = 3x) or (width >= 700px)" srcset="https://unsung.aresluna.org/_media/le-mondes-interesting-cookie-pop-up/1.1600w.avif" type="image/avif"> The “Reject all cookies” was there where you usually expect a close box to be, which felt… strangely thoughtful? I wanted to click that anyway, and that ended up benefitting me. I’m expected to be proven wrong here – but this felt like an unexpected positive UI decision, given all this context, and an unexpected understanding of motor memory.

0 views
Martin Fowler Yesterday

Data Contracts

Data contracts are a way to describe the contents and guarantees of datasets. Simon Harrer and Arif Wider describe in detail what they are and how to use them. They apply practices from API design to data by treating them as data-providing services - such as data products - whose interfaces we want to define as clearly as possible. This approach significantly increases the robustness of large-scale data landscapes, and gives both people and AI agents the explicit, trustworthy metadata they need to work with data autonomously, which is why more and more enterprises are adopting them.

0 views
ava's blog Yesterday

workplace equality

At my workplace, the typical office worker secretary stuff - the kind of position meant to free the backs of the knowledge workers - is 99% done by women. Meanwhile, the knowledge workers are 50/50 men and women. That’s already considered progress and deserves some acknowledgement. They also try to hire more women into leadership positions, which has been going well. The difficulty is more about getting women to apply to these positions rather than unwillingness to hire them for it, and they’ve made an effort to offer dual leadership positions in which two people in part time positions fill one leadership role. Still, the fact that anything considered “lower” than a knowledge worker, specifically the job where you take care of the minutiae of others’ jobs so they can focus on their creative process or problem solving, is still female-dominated bothers me and negatively affects my view on career success as my gender. Of course, there are reasons beyond the influence of an organization: Office work like that needs less qualifications and can be done part time. They’re a great opportunity for mothers, who are unfortunately still expected to cut their career and have a more flexible job with less hours in the week for their child than the other parent (usually father), who is expected to stay at work full time, be dependable and never take time off for the child (that’s what the mother is for…). It’s good for chronically ill people (who often happen to be women), and it’s great for women who need to get a job after being a SAHM for years before the divorce happened and now they’re 45+ with no work experience. Realistically, this is bound to drown out male applicants, if they exist. Still, a part of it also feels like men are often considered ‘too good’ for these kinds of jobs and as if their potential would be squandered if they worked in these roles. I see it in traineeships and new hires, how women are expected to stay in these lower roles because it’s “safe and non-demanding” (“what if you want children?”) and men are expected to immediately surpass that for something bigger almost right out the gate, regardless of a potential wish to have children or not. Bias about women being less smart or capable but more nurturing also plays into this. Taking care of someone else’s calendar at work, pre-sorting their mailbox and filtering what gets their attention, taking their calls for them, writing emails on their behalf, preparing PowerPoint presentations for them and similar work feels like household work, but at the office instead. It’s like cleaning house, doing laundry, ironing shirts, and cooking so everything’s ready for when the man of the house gets home or has to leave for work and he doesn’t have to lift a finger so he can focus on work only. Making sure documents for their work are ready and reports are done in time for the official deadline feels like making sure the kids did their homework or the newspaper is next to his breakfast plate. It’s not just the work itself though, it’s also everything around the office that revolves around office culture and relationships. When I look around in my workplace, this is run by women. Who plans office events? Women. Who bakes the cakes? Women. Who gathers money and prepares a card and gift for people’s birthdays, retirements and weddings at the office? Women. Who do people turn to when they wanna vent about work or their private life? Women. Many women have care work at home and the office, both as core aspect of their work and just by existing in the office. When you tell men this, they’ll usually say that no one asked women to do this, because who needs someone checking in with others, who needs that decoration for Halloween, who asked for that annoying work event, who needs cake in the kitchen or a useless card, or a stocked fridge? I think this take is stupid, because I too don’t care for cards, can’t even eat most cakes here and stay away from most work events, yet I recognize that it adds something to the workplace atmosphere and relationships that I still profit from even as a work hermit. Many men at work will scoff at these things, do nothing to get people together and roll their eyes when the first 5 minutes of a work meeting are spent discussing non-work things, yet still show up to it all to get drunk, feast on cake and laugh loudly with the boys, taking advantage of it while pretending they don’t care and it would be equally as good if this simply did not happen. Many don’t even have a reference for how cold and sterile the climate would otherwise be because almost all workplaces have women (or a woman) who is inofficially or officially responsible for these things. And even if she herself does not want to do these things (as everyone seems to think women naturally just crave managing office relationships), the people around her will expect her to or directly ask her to take over these matters. It’s like when people point out or call for a “woman’s touch” in a house or apartment due to a good eye for decoration or a lack thereof, but for the office culture instead. During my earlier times at my workplace while I was at different departments, I experienced firsthand how they tried to force me into the office-woman-box. For men, it was okay to arrive, silently walk past the open office doors to their own office, close the door, and focus on their own thing, and only emerge during lunch, if at all. It was accepted not only because these men held knowledge worker positions where the need to lock yourself away to focus was understandable to most, but also because of the expectation that men aren’t social. Meanwhile, women were expected to stop at every door to say good morning, and after arrival, should chitchat a bit about last weekend or the planned vacation. And they better leave their office door open, otherwise it comes off as rude and closed off. While the higher positions awarded almost all men a single office, the women were sitting in offices with 2-4 other women in the same position. So when I behaved like it was normal for men to behave, it was seen as arrogant and antisocial, when the same behavior was accepted for men. As a woman, you are supposed to be accessible to everyone at all times. You’re the office mommy after all, so if someone needs help finding a document or something else they should be able to find themselves, it’s faster to go to your office or call you and make it your problem, like children who spilled juice on themselves. I have dealt with this by helping the first time while explaining how to do it themselves, and when they ask a second time, refer to the first explanation. I will help, but I am not your maid. It has led to a lot less “I just couldn’t care to first try and solve this myself” type of mails and calls to me, but an increase for others who do take it upon themselves to be the maid for everything. I cannot even fully explain how all-encompassing it all is, in how many situations in and outside of work, people of all ages and genders have the automatic response to search for the nearest woman regardless of responsibility, availability or skill. You could be deep in your work in another subteam as a woman and people will rather bother you about the broken coffee machine than the nearest available man. I recognize that women at work never asked to be a role model for anyone; they’re here to work, so of course they are not responsible for the impression it gives me to see work still split up so conservatively between genders, especially the older generation of women 55+. Change takes time, and many of them started working under different conditions, so all that I have mentioned are effects from different attitudes. Yes, some may just not wanted to dream bigger and that’s their ideal job. But many were also put on this path because of expectations around childcare or because while they still could, they could not get promoted over a similarly qualified man, or could not get any support from their partners to gain other qualifications on the side to help advance a career. It’s hard to tell who chose this versus who settled for it and now makes the best of it, or who might even be secretly unhappy. I’m glad that nowadays, I work in a department that doesn’t treat people in a strongly gendered way, accepts the way I prefer to behave at work, and where my boss is a woman I can look up to that is ambitious and career-driven and who supports me in my endeavors to break out of the women job box. It’s something I need to see inbetween all the normalization of part time work and financial reliance on a husband for women who work here, or who have never recovered their interests and drive back after just being mother for 18 years. Published 18 Nov, 2026

0 views
Stratechery Yesterday

Nvidia Earnings; Office Convergence; OS Wars, AI Edition

Nvidia's earnings were boring, and also a statement as to why Jensen Huang probably isn't coming back; then, Microsoft and Anthropic ship dueling operating system updates.

0 views

curl on OSS-Scanner

OSS Scanner is a service by Anthropic to scan critical open-source repositories for security vulnerabilities curl maintainer Max Dymond submitted pull-request 1191 to OSS-Scanner in the end of October and we were swiftly enrolled into the program. The idea for this service is inspired by OSS-Fuzz : Anthropic scans the participating open source projects for security problems on their machines at some interval with their magic applied and they let us know if they find anything. I don’t think they officially say exactly which model they use for this nor how often they rescan. Early in the morning of November 5 we received our first sign of life from them since they merged the PR. An automated mail: Forty-five security vulnerabilities in a single shot is a lot . But sure, we did ask them to do this. Of course, had we not asked them, chances are someone else would instead have figured these ones out and reported to us separately. There are many people with capable harnesses and AI models out there. The Anthropic email with all the findings described that the analysis considers one of the flaws to be severity MEDIUM and the remaining 44 at severity LOW. In addition, they also found 23 ordinary bugs that are also included in the report. The ordinary bugs they reported have not yet been analyzed. This blog post focuses on the 45 reported claimed vulnerabilities. In this large tarball we got individual markdown reports for each finding, together with their associated reproducers and in many cases also their suggested patches for mitigation. With a little scripting and lots of manual fiddling, I submitted all these reports as individual issues on GitHub following our new policy . I paced myself and did this over a period of several days to soften the impact this had on the team. Each report starts in ASSESS mode and once it has been given proper attention we move it to a suitable severity level or we set it to NONE if there is no vulnerability at all there. You can view all the issues yourself . In the curl project we have decided to gradually raise the requirements for severity LOW vulnerabilities. Issues that seem too ridiculous or unlikely we now set to NONE to a larger extent than we have in the past. As just a bug as we like to call them. With this in mind, curl maintainers worked fiercely on the reports of the coming days until we had reached an initial verdict for all the 45 reports – and in the mean time we also received a few additional reports submitted by other reporters. The severity MEDIUM finding we consider to be a LOW and we also agreed with an additional four findings, thus landing on five (11.1%) confirmed. 36 of the 45 findings we consider just bug s, three of them were not even bugs while one of the findings was completely wrong . The wrong one insisted the issue in the complete opposite way and claimed we should patch away our proper way to instead do it the AI’s suggested inferior way – which would introduce the vulnerability it warned for. Vulnerability rate The 11% vulnerability confirm rate is lower than the average in vulnerability reports we have seen in 2026 but the 80% just a bug share is a much higher rate than ordinary reports. The average share of vulnerability reports that report “just a bug” has been at about 43% earlier during this year. Combined, a conclusion must land on that these reports have high quality, but are way too eager to call them vulnerabilities. This should also be seen with the understanding that we as a project have shifted slightly and have higher requirements now. One of the most annoying things with AI generated reports in general is the length of the reports and these ones are no exceptions. It feels like an unwritten law that they must produce very long texts and it feels like the reports are always excessively long no matter the complexity of the issue it reports. In that regard, human reports still easily outperform the AIs’. Several of these findings contain proposed patches for the identified issues. In some instances they have been almost exactly what were necessary, but more commonly the fixing took human effort to analyze the (too) long report and write up the fix for it. Since 41 out of the 45 findings identified problems, we got our hands full. At the time of this writing, eleven of the reported bugs are still not addressed. When an AI finds a bug, they tend to identify problems that no user ever ran into. Users typically report problems when they do something and curl then does something unexpected or it somehow doesn’t satisfy the user’s wishes. In these findings, the reported problems are more theoretical . In many cases this makes the reports less important, and sometimes unlikely to cause problems in real world use cases. We willingly joined this effort as getting flaws and bugs reported helps us improve curl. However, since the severity levels of the findings are of this, shall we say trivial , kind, it feels reasonable to reconsider our participation if this keeps up. Part of the idea of making more vulnerability reports public early is to make it possible for everyone to join in and help. Provide your comments and views on reports still in ASSESS. Submit your proposed changes as pull-requests, or help review changes proposed by others. Help review the advisories for confirmed vulnerabilities to make sure the descriptions make sense and are accurate and that we figure out exactly when they were introduced etc.

0 views
Jason Tucker Yesterday

Teaching Home Assistant to read my RV generator (without starting it at midnight on accident)

It was late at night and I had a question I couldn't let go of: could the Raspberry Pi running Home Assistant in the RV talk to the generator's auto-start module? Our coach has an AGS (auto generator start) module, the little box that starts the generator when the house batteries get low or the temperature climbs. The only way to talk to it is the manufacturer's phone app over Bluetooth. No integration, no API, nothing in Home Assistant Marketplace, and I later find out why. So I asked Claude (Claude Code, running on my Mac with SSH access to the RV's Home Assistant box) to go look for it. A few hours later I had live generator status on my dashboards, a decoded protocol, and a pretty clear picture of who did what. This post is that picture. I want to be upfront about which parts were me and which parts were the AI, because I think that split is the interesting part. My ask was basically "use Bluetooth on the Home Assistant and see if you can find the AGS." Claude SSHed into the Pi, ran a 20-second scan, and there it was, advertising with a strong signal from inside the coach. It also spotted the OBD dongle and one of my temperature sensors, which was a nice sanity check that the scan was real. Then it stopped and asked before connecting. Its reasoning was that the module might only allow one connection at a time (which would lock out the phone app), and that this is a generator controller, so it wanted my OK before talking to it at all. I said yes. It connected, listed the Bluetooth services, and read the labels on them: a device name, a command channel, firmware updates and pairing. Nothing was written. This is where I nudged things. I pointed Claude at the Android app on the Play Store and said it could decompile it if it wanted to know what we could control. Then, while it was working, I sent over the manufacturer's manuals and firmware page too. Claude downloaded the APK from a mirror, decompiled it with jadx, and found out a few things fast: The firmware page turned out to be a dead end for this project (it's all head-unit firmware, the AGS updates itself through the app), but the AGS manuals were useful context. Claude gave me three options for where the listener should live: an ESP32 running ESPHome near the module, a small Home Assistant add-on, or a script on my Mac. I picked the add-on. Before building anything, it ported the Telink login and encryption from the decompiled Java to Python, line by line, and ran a read-only test from the SSH add-on. It logged in on the first try and status packets started rolling in about once a second: 12.88 volts, manual mode, generator off. Temperature reads zero, which I think means there's no probe connected. Then it packaged it up. The add-on is a couple hundred lines of Python using bleak for Bluetooth and MQTT discovery through the Mosquitto broker I already had, so the entities show up as a proper device in Home Assistant. One detail I liked: it doesn't hold the Bluetooth connection open. It connects once a minute, listens for 10 seconds, and lets go, so the official app on my phone can still connect. The tradeoff is up to a minute of lag, and that's fine for a generator. The first build failed because this version of the Supervisor no longer passes a base image into local add-on builds. Claude read the Supervisor log, switched to a pinned Python base image, and the second build worked. That's the kind of thing that would have cost me 30 minutes of googling. With the entities in place, I asked for everything on the RV Home dashboard plus a new RV Generator dashboard. Claude backed up every dashboard file first, then added a Generator section to RV Home, built the new dashboard (status tiles, a battery gauge with 24-hour and 7-day history, and a 7-day run timeline), and added a Generator button to the navbar on every RV dashboard. It restarted Home Assistant core to load them and checked that the entities came back. There are no buttons on any of it. Read-only, on purpose. The status message only gets you so far. The AGS settings (start and stop voltage, quiet hours, run time limits) and the run-hours counter only show up when the app asks for them, and the bytes for asking live in the compiled Dart code. Getting those out meant running a Flutter decompiler called blutter. Here's the funny part. The first time Claude tried to build blutter, Claude Code's own safety check blocked it. Claude didn't try to sneak around it. It stopped, finished the dashboards, and told me what it couldn't do and why. When I came back to it and said go ahead, it ran. I was pretty nervous about this stage, and I told Claude so more than once: don't start the generator, don't change any settings. It took that seriously: Even then, the first two attempts got no answer. Claude worked out why: the module's mesh address was hiding in a second block of the Bluetooth advertisement, and the decompiled Java was building one part of the encryption a little differently from what the firmware actually expects. When it switched to the way the open-source Telink libraries do it, the module answered both requests. AGS disabled, quiet hours 10:20 PM to 8 AM, and 5 minutes on the run-hours counter. And that's where I called it. It was late, and I'd rather finish this in daylight when I can hear the generator if something goes sideways. Turns out burning the midnight oil is risky business too. I didn't want to wake anyone up by cranking the generator at 11:45 PM, and I really didn't want to explain to my wife, "Sorry babe, I was vibe coding a generator controller because I'd already run out of stock hardware to hack on the house side of the RV." I keep getting asked how much of these projects are me and how much is the AI, so here's the honest version. What I did: What Claude did: If I'm honest, I couldn't have written the encryption port myself. That's not my skill set. But Claude also wouldn't have gone looking at the manufacturer's app without the nudge, and it definitely wasn't going to decide on its own how much risk I was willing to take with a generator. When we bought this RV, I pulled out the manuals for every product in the shell, everything that makes it tick. With Claude's help I scanned all the PDFs and built an owner's manual of manuals: exactly what we have, how it's set up and which model of each thing is installed. At that point we both knew what was in there, so let's start digging. Every module running this app appears to use the same Bluetooth login, and the app's passcode isn't enforced by the module. That means anyone within Bluetooth range of an RV with one of these could probably talk to it, and possibly start the generator. A generator starting on its own next to a parked RV is a carbon monoxide problem, not just an annoyance. So I'm not naming the brand or the model, and I'm not publishing the login or the command bytes for start and stop. I'm reaching out to the manufacturer first. If your rig has a Bluetooth generator auto-start, keep your CO detectors working (you should anyway). I'd even go so far as to add a second, smart detector and monitor it in Home Assistant and notify you on your phone. In daylight, with the generator locked out so it physically can't start, I'll compare the values Claude read against the app to figure out the units, then roll the two read requests into the add-on so settings and run hours show up as sensors. After that come alerts for low battery, faults and failed starts. Start and stop buttons in Home Assistant might come later, with a confirmation step, or might not. I haven't decided. Have you wired an RV system into Home Assistant that was never meant to be? And how much do you let AI tools touch hardware that can actually hurt you? Let me know, I'm curious. More on this soon. One last thing. This post isn't really about finishing the project. It's about how I did it, and how you could too. Pick the problem, point at the right sources with what you already know, make the calls, ask lots of questions, switch to plan mode and ask more, and set the rules so the generator doesn't start at 11:45 PM on a Tuesday in your dead-quiet neighborhood. Then ship it to an audience of one. Not everything I build needs a GitHub repo, an issue tracker and strangers asking for features. This one just has to work in my rig. It's a Flutter app. The real logic is compiled Dart, with a thin Java layer that hands Bluetooth calls to a native library. It's built on Telink's light-mesh SDK. Yes, the same Bluetooth mesh stack used in cheap smart bulbs. The generator controller is basically a very angry light bulb. The login is the same for every unit. The mesh name and password are hardcoded in the app. The six-digit passcode you type in the app is only checked inside the app, not by the module. More on that below. The status layout was right there. The Java code that unpacks the status message spelled out every field: battery voltage, temperature, generator running, fault, start failed, manual mode, ignition and retry count. It mapped every command first. Every command the app can send, sorted into reads and controls. Start, stop, reset, factory reset, settings changes, door lock, key fob pairing and set clock all landed in the do-not-touch pile. It proved the two reads were safe. Both are sent automatically by the app when a screen opens. An app doesn't change your generator just because you looked at it. It wrote a hard allowlist. The code that builds commands refuses anything except those two exact requests, and Claude tested that locally (start, stop and the rest all got rejected) before anything went over the air. Picked the problem. I wanted generator status in Home Assistant, and I knew the module was Bluetooth. I also knew the app existed and had played with it. Of course I'd already scanned for Bluetooth devices in the rig looking for things to control, and this was one of them. Pointed at the right sources. The Android app and the manufacturer's manuals and firmware page were my idea. Claude hadn't gone looking for them yet. I run iOS, but I know Android apps are easy to pick apart, so let's have a little fun. Made the calls. Yes to connecting, add-on over ESP32, which dashboards, and when to stop for the night. Set the rules. No starting the generator, no settings changes, no testing for real. I said it three times, and I'd say it again. Approved the scary stuff. Connecting to the module, running the decompiler, and sending the two read requests each waited for a yes from me. All of the hands-on work. Scanning, connecting, reading services, downloading and decompiling the app, and reading the Java and Dart. I kept asking what it was looking at, and used /btw for side chats while it decompiled. All of the code. The Python port of the Telink protocol, the add-on, the Dockerfile, the MQTT discovery config and the command allowlist. I know how MQTT and Docker work, but every step of this was virtual hands doing the work for me. The debugging. The add-on build failure, the missing mesh address and the encryption difference, each from logs and decompiled code. Oh man, this was the tricky bit, and I'm glad Claude Code handled it. The Home Assistant plumbing. Dashboard JSON, navbar edits on five dashboards, backups and the core restart. Once it had built the sensors, I let Claude Code handle all of this. Knowing when to stop. It asked before connecting, stopped when the safety check said no, and kept the generator out of reach the whole time.

0 views

Re: Dying Indies

Cassidy wrote a post titled “Why are all the indie-friendly products dying at the same time?” that it’s worth reading if you’re interested in this kind of topic. I’m not gonna TLDR her post, but I wanna add one extra consideration: a lot of startups are good products, but terrible businesses. And the problem with VC-powered projects is that you can trick yourself into thinking you have a good business when in reality you have a good product, with no real business attached to it. And what end up surviving are good businesses with solid products. Services that started charging a fair and reasonable amount of money from the get-go, delivering a quality service in return. Services that are more like traditional businesses, in a way. And that’s honestly good in my view. Thank you for using and believing in RSS. You're awesome. Send me an email :: Sign my guestbook :: Become a supporter

0 views

Attackers Used Optimizely to A/B Test Malware on Top Websites

At least 178 top web destinations unwittingly served a variety of malware exploits against visitors over the past 24 hours thanks to a security vulnerability involving Optimizely , a company that helps websites customize user experiences and test out new features. Experts say the incident, which saw data-stealing malicious software silently injected into sites like the BBC , CNN ,  Equifax , Ledger and Zoom , was exacerbated by the reality that few popular websites enforce strict rules on the sources of third-party content. The Zoom.com homepage loading the malicious JavaScript file from Optimizely. Image: blog.report-uri.com. Click to enlarge. According to a blog post from the security firm Report URI , on November 16 malicious JavaScript code was served to visitors of 178 organizations through Optimizely’s platform. Report URI researcher Scott Helme wrote that the payload delivered by the malicious Javascript was rebuilt 26 times during the day, dropping a multi-purpose malware kit that could steal payment card data, cookies and screenshots, and swap any cryptocurrency payment addresses for the attacker’s. Helme noted the affected websites also served exploit code custom made to attack known vulnerabilities in older Apple iPhone and iPad devices. Known by such names as “ DarkSword ” and “ Coruna ,” these are zero-click exploit kits that chain together a half-dozen security holes to seize complete control over outdated devices and extract data. “The important lesson here is that trusted JavaScript doesn’t always remain trustworthy,” Helme wrote . “A website can be compromised through a third-party dependency without its own code or infrastructure ever being breached.” Contacted for comment, Optimizely said that on November 16, 2026 it “identified a security incident in which an unauthorized party exploited a vulnerability in the Optimizely Experimentation to add malicious JavaScript to some customer projects.” “We acted swiftly to contain the incident and have fully remediated the identified vulnerability,” reads a written statement shared by Optimizely. “These measures included blocking access to the vulnerable path, deploying a fix, removing the injected code from affected projects, ending active sessions, revoking tokens, and resetting access for affected user accounts. We have also implemented additional protections to prevent malicious code from being delivered in Cloudflare. While the incident has been fully remediated, we are working with third-party experts on a comprehensive investigation.” Many top web properties no longer fully display content unless visitors agree to let often dozens of third parties serve JavaScript, a powerful web scripting language that enables interactive content. JavaScript code is run on the user’s device, and it can read information displayed in the user’s browser and even modify a website’s appearance or content. One reason JavaScript is so heavily used is that it enables fairly precise browser fingerprinting and other ways of tracking visitors and clicks. According to the 2025 Web Almanac by HTTP Archive, the median homepage loads at least 22 JavaScript files. But as the incident with Optimizely shows, a compromise at a third-party vendor’s website can quickly snowball into a supply chain attack against downstream websites that end up serving visitors tampered and malicious JavaScript files. Zach Edwards is a researcher at Infoblox and the co-founder of the ad-tracking service DecryptAds . Edwards said Optimizely is a vendor which often collects data outside of consent flows, with their JavaScript snippets being embedded as close to the top of the page as possible to ensure that it’s one of the first things to render, which is important since the product is primarily built for A/B testing. “So to make the product work as expected, this code is setup to fire immediately on-page load, and not restrict rendering behind a consent dialog box,” he said. “This means that this supply chain attack didn’t require any clicking or consent to trigger — most of the impacted clients would immediately serve up the payload as soon as someone loaded the page, further increasing risks from this type of JavaScript snippet being compromised.” Websites can minimize the chances that a breach at a third-party content provider spirals into a supply chain attack by taking full advantage of “ Content Security Policies ” or CSPs, which specify the domain names that are allowed to serve third-party content. But Edwards said most websites — apart from perhaps the largest e-commerce, social media and financial platforms — don’t even bother with CSPs, or else tend to leave them overly permissive for marketing reasons. “With literally all websites which embed 3rd party JavaScript resources, if you don’t have a content security policy then if any of those partners get compromised, new domains can be injected into your website via JavaScript which won’t be stopped,” he said. “We’re in the age of JavaScript supply chain attacks and yet almost no one is talking about why content security policies were invented and how this is largely the solution for operators, even though it’s not always simple to get it initially deployed.” How broadly deployed were CSPs at the websites impacted by the Optimizely attack? According to Report URI, 68 of the sites had no CSP at all, while 50 of them had a CSP that still allowed the malware payload and the data theft. The company found only 24 of the affected sites (15 percent) had CSPs that fully blocked the malicious payload. Image: blog.report-uri.com. The overall deployment of CSPs across the Web’s busiest sites is somewhat lower — about 10 percent — according to Helme’s site crawler.ninja , which scans the top million websites daily for security issues. Helme said he hopes this incident will encourage more sites to adopt effective CSPs, noting that it could have been far worse: By Report URI’s estimates, the purveyors of this malware attack managed to steal only around $7,500 worth of virtual currency from affected users, as well as an unknown number of payment card records. Helme said he often compares the current widespread lack of CSPs to the Wild West. “Organizations are running all this code, but they don’t know what it’s doing,” Helme said in an interview with KrebsOnSecurity. “This is why we keep seeing such large scale breaches in places [where] there are no checks and rules in place on the code we’re running, so this was kind of inevitable. Once an attacker gets to the point of running code on your site, the question is what do they want to do with that and can they write the script to do it. Now with AI that’s not a problem anymore.” Internet users can control the JavaScript elements allowed to run on webpages by using simple script-blocking plugins like NoScript. But these tools have always only been effective for diehard security and privacy nerds who are willing to put up with sifting through dozens of JavaScript requests on each new website. Happily, modern ad blocking software can handily block most third-party JavaScript requests. Ten years ago, the standard security advice for end users was to install antivirus and enable a firewall. These days, your ad/script blocker is your firewall. We explored several options and approaches to blocking ads in our August 2026 story, Who’s Tracking You?

0 views
Unsung Yesterday

“I’ve spent years on it. Years. On a box.”

Designer Pablo Stanley created a really fun interactive exploration of what it takes to create a seemingly simple “composer” (industry’s jargon for a more sophisticated input field or things like it): = 2x) and (width >= 700px)" srcset="https://unsung.aresluna.org/_media/ive-spent-years-on-it-years-on-a-box/1.2096w.avif" type="image/avif"> = 3x) or (width >= 700px)" srcset="https://unsung.aresluna.org/_media/ive-spent-years-on-it-years-on-a-box/1.1600w.avif" type="image/avif"> It’s a bit outside of Unsung’s purview since a lot of it is very “sung.” The case study focuses on visual presentation, and doesn’t cover systems design or consistency with other things; I even worried at times it could perpetuate an image of a UX designer being a “lone genius,” overindexing on visuals and tactile experiences over more important things, of which there is a ton in the AI neck of the industry woods. At the same time, there are also mentions of flow, and a general drive toward reducing complexity that feel worthwhile. Plus, the theme of details that seem minuscule on the surface, but will all ladder up to a lot of friction in repeated use, is something we cover a lot . Also, I am burying the lede: it’s a really enjoyable and well-crafted experience – don’t miss the sound and music! – and this unique way of talking about interface details could be inspiring in and of itself. You can also watch the entire thing as a video with Stanley narrating, but I personally liked the interactive version more:

0 views
Marc Brooker Yesterday

Traffic mix matters

Wanna listen to my mixtape? The preliminary report on last week’s M365 outage contains one statement that really caught my eye: Our normal load testing did not detect the latent issue because [of] the traffic mix and SKUs used in our labs. There’s a lot going on in this report (as there is in any report for a complex system), but I wanted to zoom in on this one issue: traffic mix . It’s important, because its the one thing that makes the difference between a great load test and a complete waste of time. The performance of computer systems is extremely sensitive to workload mix. Let’s start with a simple simulator, looking at a system with a table of locks. Requests arrive with a key, hold the lock for their key for some period of time, and then free the lock and complete. This isn’t an unreasonable mental model of a relational database, where each transaction takes a lock during its execution. arrivals backlog 16 worker threads lock table (one lock per key) done Poisson FIFO, never empty at saturation holder FIFO waiters hold ~Exp(mean 1 ms) key 1 key 2 key 3 ⋮ key N holding its key's lock blocked behind the holder (thread still occupied) Keys (N):    Simulate Each request takes one of 16 worker threads, waits in a FIFO queue for the lock on its key, holds the lock for an exponentially distributed time (mean 1 ms), then releases it and frees its thread. Keys are drawn from a Zipf distribution over N keys; a coefficient of 0 is uniform. As we may expect, the more skewed the distribution, the less throughput you get out of the system. A small number of keys are highly contended, leading to under utilization of the rest of the resources of the machine, driven by the global concurrency limit. Now, let’s consider a different mental model of a relational database (at least a single-system one like Postgres). A fast, local, in-memory cache containing some of the accessed data backed by a slower store containing the rest of the data. arrivals backlog 16 worker threads done Poisson FIFO, never empty at saturation hit miss fill on miss LRU cache 5 % of keys, ~Exp(mean 0.01 ms) storage all N keys, ~Exp(mean 1 ms) serving a cache hit waiting on storage Keys (N):    Cache size: % of keys    Cache is × faster than storage    Simulate Each request takes one of the same 16 worker threads and reads its key. A hit is served from an LRU cache; a miss goes to storage (exponentially distributed, mean 1 ms) and the key is added to the cache. Keys are drawn from a Zipf distribution over N keys; a coefficient of 0 is uniform. Note the log scale on the throughput axis. This curve goes the other way! The more skewed the distribution, the better the performance, over something of a broad range. This is what makes it so important that workload mix in load tests and benchmarks matches real production traffic: throughput can vary by multiple orders of magnitude, in both directions, depending on things as subtle as key skew in the benchmark workload. This is especially true in relational database-shaped things, but applies to systems of all kinds. Aside : This is also a reason I like optimistic concurrency control, and architectures with a single cost/latency mode . Aurora DSQL reflects this thinking on how to make things less workload sensitive: all reads go to a single fast storage layer, and nobody is holding resources waiting on locks.

0 views
Lea Verou Yesterday

Nudeps: bundler-like imports, none of the baggage

You a package (e.g. ), you write , and it works — as long as there is a bundler in between. Without one, the browser has no idea what is: it only understands URLs, and was never meant to be deployed. So even the simplest project ends up needing a bundler, only so it can use dependencies instead of reinventing the wheel. But bundlers add a significant tax. They process every single file, introduce several layers of abstraction between source and deployment, and these abstractions often leak : things that work fine in the browser can break in the build. Earlier this year, I published Web dependencies are broken: Can we fix them? that discusses this from a platform architecture perspective. Besides the architectural concerns, the complexity is an active developer pain point: in State of JS 2025 , “Managing Dependencies” was the 3rd biggest pain point , and “Build tools” were 6th. However, getting rid of build tools is not the goal. Some use cases should not be handled by the browser, so bundlers and build tools will always have a role to play. The goal is making them lighter, composable, and less essential . In that vein… Nudeps 1 is a new kind of lightweight build tool that lets you continue using to manage dependencies, vendor them locally, and import them via bare specifiers (package names like or instead of URLs), without the bundler. You set it up once, and then you can forget about it: you keep ing packages and importing them by name, and they work in the browser. And it only ever touches your dependencies, never your own code . Since my apprentice Dmitry and I prototyped the initial MVP in February, we and others have tested it on a variety of projects, and at this point I’m confident that — while not perfect — it’s ready for prime time. A core architectural difference between Nudeps and bundlers is that your own code remains untouched . In fact, it doesn’t even need a watcher that runs whenever you make edits! It only touches dependency files, and doesn’t rewrite anything, making it extremely lightweight in terms of complexity it adds. This means it can complement any other tooling — or none. You write raw HTML, CSS, JS? This is for you. You use a templating engine, a CSS preprocessor, and TypeScript? This is also for you (though understandably you may have less use for it). This also makes it complement static site generators and island architectures particularly well. Does it replace your build process? If all you needed it for was getting imports to work, it could. If you also compile your code (JSX, TypeScript, single-file components), you still need a tool for that, but it can be a much smaller one. Bundlers make complex things possible. Nudeps is hoping to occupy the space on the left of the curve and make simple things easy . Assuming you don’t need to customize anything (e.g. using for the map, for the dependencies, all default settings) it goes like this: That’s it. You’re done. You can now and to your heart’s content, and start using packages right away in your code. Things Just Work™. We have been so trained to expect friction and complexity, that some testers thought they were doing it wrong: I ran the npx command and added the import map to my app, but I assumed that there was still a lot more work to do. I was shocked to realize I was done. — Sam Littlefair Most of the pieces were already there, and were just waiting for someone to put the puzzle together. Import maps allow us to import bare specifiers (package names like ) instead of URLs in the browser and are Baseline Widely Available. JSPM is a library that traces a dependency graph and generates an import map. It focuses on CDN use cases, but its engine is exposed as a separate library that can be repurposed, which is what Nudeps uses under the hood (with a lot of tweaks). Import maps currently have to be inline in the HTML of every page, which would require templating, but external import maps can be easily emulated via a small script that injects the map. Package managers like npm already give you the file structure and let you manage versioning, that structure just can’t be deployed as-is to the web . When you install Nudeps via , it does two things: Using as a hook means there is no Nudeps watcher or command to run when you start working on a project! In that sense, Nudeps actually gets you better DX than a bundler 2 . Then, whenever runs, it… Here’s an example of what that script may look like. In production, you can prune to only the specifiers actually used (via the option), and including them all in development means the import map only needs to change when your dependencies do, not whenever you write an import. Yes! Obviously some frameworks are compile-only (e.g. Svelte), but many have runtime-only imports. Even React can be used, though without JSX the ergonomics are poor. My personal go-to is Vue . Most libraries also work fine, including D3 , gsap , Lit , Three.js , Floating UI , interact.js , and Underscore . Beyond common cases, Nudeps supports quite a few edge cases too: Many CJS-only packages like lodash work too, via a tiny shim (that Nudeps handles), and the jQuery demo even loads two different jQuery versions side by side through npm aliases. Yes! In fact the demos include two such dependencies: Open Props and Bootstrap Icons . The catch is that since browsers currently have no way to include CSS stylesheets via specifiers , you need to use actual URLs ( this is changing ). This also means these packages cannot use other dependencies (unless they bundle them). Thankfully, that’s the case for most. To make this easier, Nudeps creates symlinks (or redirects, where symlinks are not supported) so you can import versionless URLs like . From the very beginning of our testing (back in February), Claude understood it just fine, making only minor mistakes that were unnecessary, but ultimately harmless (Nudeps still worked fine), such as: And the package now includes a file, which makes them go away entirely once the agent is instructed to actually use it. Most packages work. Also, since Nudeps doesn’t bundle, packages with a lot of tiny modules pulled together by ESM imports may be slower to load initially. If you’re a package author that wants to provide a Nudeps-friendly bundle, generating a bundle that consolidates them somewhat can improve performance. But there is a tradeoff to all bundling: the more files are bundled, the less granularly they can be loaded. There is typically a sweet spot, and that varies depending on the structure and usage patterns of your package. But please do not bundle your package’s dependencies in there as well — these need to remain separate, so they can be shared with other packages that use the same version of the same dependency. Nudeps does one job, so there are things it doesn’t do, and things it doesn’t do yet : Nudeps is just the beginning, and is far from perfect. There are certainly plenty of unknown unknowns, and many things we simply haven’t gotten around to. Besides bugfixes and closing the gaps above, at the top of the roadmap is testing more packages to ensure compatibility and uncover edge cases. If you want to give Nudeps a try, the easiest way is to head to your terminal and run in your project directory — or just let your agent do it. Get Nudeps Demos Nudeps on npm I’m hoping that Nudeps is the first step towards a future of lighter, composable build tools . Try it and let us know how it went! Thanks to the beta testers: @g12n , @jak2k , @lgarron , @beejunk . Thanks to Jordan Harband for his early feedback around package subsetting. And as always to my apprentice Dmitry for his help working out the kinks and making this a reality. Which you can choose to read as either nude deps or nu (new) deps ↩︎ Of course if you need to start a server for development, that doesn’t make a ton of difference. But localhost is cheap. Your editor can start one. Your agent can start one. Heck, I even have one running at the root of all my cloned repos. ↩︎ You run and it will set everything up for you. You add to your HTML through whatever mechanism you want, before any other scripts that import dependencies: Adds Nudeps to your Adds two scripts that run : , so Nudeps re-runs itself every time you or , and , so a fresh clone is ready too. copies the necessary files from into a directory, which is meant to be deployed, but not committed: it is regenerated on every , and comes with its own flattens the directory structure by including the version number in the directory name (e.g. becomes ) which gives you better deduplication and granular cache busting, generates an import map injection script with all specifiers in your direct dependencies and the specifiers they actually use, using JSPM under the hood. Local packages ( ) npm aliases ( ) git dependencies ( ) npm workspaces (experimental) Adding entries to (the generated files already ignore themselves) Running manually, adding it as an script, or even running manually because it thought it was a custom script. It wasn’t aware of the hook (and would in fact insist it doesn’t exist 😅) Adding config file overrides that weren’t necessary Nudeps works much better with ESM packages. CJS support is very experimental. Some packages unfortunately assume that they are running in a Node.js environment and rely on Node.js-specific APIs like . For the most common ones, you can just stub them, but if it starts getting out of hand, you’re better off using a bundle for that particular package (you can add overrides via Nudeps’ config). It doesn’t transform your code. Anything that needs compiling (JSX, TypeScript, Svelte) still needs its own tool, which Nudeps happily works alongside. npm only, for now. Supporting other package managers (pnpm, yarn, etc) is at the top of the roadmap, since many people today have moved away from npm. Non-JS dependencies need actual URLs, not specifiers. Workers also don’t do specifiers, see No benchmarks yet. Depending on the package structure and type of usage, bundlers may be significantly faster or even slightly slower. It would be nice to get some data on this. Which you can choose to read as either nude deps or nu (new) deps ↩︎ Of course if you need to start a server for development, that doesn’t make a ton of difference. But localhost is cheap. Your editor can start one. Your agent can start one. Heck, I even have one running at the root of all my cloned repos. ↩︎

0 views