Does simple sound better?

Does high-performance audio need to be expensive and complex or can we get great sound with simple?