tl;dr:Benjamin concludes with what he's learned from debugging: (1) No matter how battle-tested and old the code and how reputable the distributor - the code contains bugs. (2) Old bugs can manifest themselves seemingly out of nowhere, caused by subtle changes in timing or memory layout. (3) Whenever the file system is involved, there is a significant danger that bugs are caused by race conditions. And more.