Simplicity is desirable, yet you've often seen people taking simplicity too far. What's really happening there?
Simplicity involves finding the best explanation with the fewest assumptions. Complexity involves assuming unimportant things are important; naivety embraces ignoring important details.
The way to aim for simplicity is to move away from unwarranted assumptions.