Responding to myself here. Out of curiosity, I just
did some AB'ing
(hadn't in a very long time)
A/B doesn't remove confirmation bias unless it's randomized. Perhaps
that's what you meant (FTR, squishyball will give you casual A/B,
randomized A/B, A/B/X and X/X/Y testing).
Some very high end ears routinely fall prey to this-- It's not that
you can't trust your ears, it's the brain that's gullible.
Monty