That does sound strange. A few questions:
How is this section built? Are you using a repeater, layouter, pro gallery etc?
How are you making the hover effect, is this via the interactions tab, or via Velo, or within the element settings (should that option be available)