Is Your Model’s Accuracy Real, or Did It Just Get Lucky?
The Feynman Test for Not Fooling Yourself About Test-Set Accuracy “The first principle is that you must not fool yourself — and you are the easiest person to fool.” — Richard Feynman I keep Feynman’s line taped, metaphorically, to the inside of every model I train. Because here is the uncomfortable truth about that beautiful …