Do audiophiles care more for the music or the gear?

Audiophiles are often accused of listening more to their gear than the actual music itself. What truth is there behind that?