All that is under the Sun
There is a lovely moment in Arthur C. Clarke’s fiction where a machine does something so far beyond expectation that the humans watching it stop asking how fast and start asking how. I had that moment in July 2026 when Moonshot AI shipped Kimi K3: a 2.8-trillion-parameter open-weight model, the largest ever released to the …
The Feynman Test for Not Fooling Yourself About Test-Set Accuracy “The first principle is that you must not fool yourself — and you are the easiest person to fool.” — Richard Feynman I keep Feynman’s line taped, metaphorically, to the inside of every model I train. Because here is the uncomfortable truth about that beautiful …
Imagine you’re teaching an archery student. They loose an arrow, and it thuds into the target, a little off-center. You wouldn’t just say, “You missed.” To be a good teacher, you need to know how much they missed by. Was it a near-perfect shot, just a hair’s breadth from the bullseye? Or did it land …
Welcome back to All that is under the Sun! In our last blog post in Learning AI Series, we unmasked “Optimization,” the tireless engine that helps AI models strive for their “best selves.” We saw how AI isn’t just born brilliant; it learns and improves through a process of iterative refinement. But that begs a …
Welcome back to All that is under the Sun, your friendly guide through the fascinating, and sometimes bewildering, world of Artificial Intelligence. This month, we’re kicking off a brand-new series that gets to the very heart of how AI learns and improves. Think of it as the AI equivalent of a motivational seminar, a Marie …