Are tone controls bad?

In purist audio realms, the bass and treble controls are often unavailable on equipment and even shunned and despised by audiophiles. Why is that and is there any truth to the notion that tone controls make the sound worse?