If there is a void for a fan then yes, not worth spending all that money then having a condensation issue.
even though you said there has never been a damp issue!
I am in the trade and always fit humidistat version with timed run on.
dont forget they remove smells too after toilet, especially if no window.
yes you can get a silent one, but the word silent doesn't really exist, do check out the decibels of the fans prior to purchase.
obviously the quiet versions art the cheapest.
all down to you, if you don't like it, disconnect it, at least it would provide some form of ventilation.