Persistent Close button(X icon) in a LightBox

Is it possible to make the Close button(X icon) in a LightBox visible at all times, even if a user scrolls down to see the rest of the content inside that LightBox?