Limit Timeline Activity Types based on User Groups

Would love to be able to segment out Timeline activities based on Permissions or User Groups.

Example Use Cases:

We have a few teams that have activity types that are specific to their roles that have custom fields and other automation based on them.  Being able to only show those activity types to those specific users would help 1-cut down on activities logged incorrectly 2-shorten the list of activity types for others who do not use those types. 

We’d still want them to be filterable, but not be selectable in the dropdown when creating an activity.