Hi Lorraine! Indeed the new media manager is site based, therefore all site contributors have access to the same media manager and can work together easily.
In existing sites you can delete the files and folders which you don’t need in this site from the media manager, it won’t affect other sites.
In new sites you won’t have any issue as you will start from scratch.