It really depends on how much vibration the engine makes and how much transmits through the mount. If everything is tight and stays tight then the added wear will be minimal.
From what I've seen with jet engines, when fretting damage between loose parts starts, the amount of wear that happens will get worse the longer you leave it.