I have it set to run its fan upon startup because you can't hear it so why not.
Its certainly a personal choice. Unless there's a major fault, it will never over heat and that is a possibility regardless the setting.
Much may depend on the case it is in and how well it suppresses noise. The location of the computer, or more specifically the power supply in relation to the user's ear might matter too. Then there's always the ambient (room/background) noise that may or may not drown out some fan noise. And of course, the user's hearing matters.
I know with my EVGA PSU, my fan is silent at low speeds too. In fact, the only way I can tell it is running is by putting my ear up to the exhaust vent then I can feel the warm air hitting my ear. I credit much of that to my Fractal Design case - an excellent case that is lined with sound deadening materials.
Typically, if I hear a fan, it is either the CPU fan or graphics card fans spinning up.
Odds are, I'm listening to music anyway.