Feature Release: Creating Custom Roles for Your Site

A great feature that we already implemented. I noticed though that the custom role I created on one client site is now available across all client sites. This will create confusion for clients who need different permissions and roles. Is this a bug on my end or something that can be updated so custom roles are specific to each site?