Head over to your WordPress admin dashboard.
From here you want to go to Settings > WP SVG. On that page, you’ll see a section like below:
In this section, change the Restrict Users dropdown to Yes and tick the users you’d like to allow to upload SVGs.
You can then go ahead and hit the Save Changes button and only those users will be allowed to upload SVGs.