Do you always have to create a dynamic page to use data sets or can you use them on regular pages?

If you can code, you almost do not need any dynamic pages, because you can generate and manage everything with code.
Without coding you are reliant to use dynamic-pages.

And YES —> you can also use regular DATASETs.