When I see someone say 'you shouldn't need a bug tracker' I hear that as an aspirational statement, and something to work towards. Others hear it as an attack and get defensive about the 'real world'. Not a lot of discussion about which constraints make but tracking necessary

Maybe this is because it’s typically phrased as if anyone using a bug tracker is just wrong

That sounds a bit hyperbolic. But bugs shouldn't stay in a tracker for very long. Fix it or document why you won't. Anything else will foster a broken windows syndrome.