Hello,
The Access is denied error message means that, nevertheless, you didn't grant appropriate rights to manage the membership of the group. Can you post here or send us a screenshot of your Security Role, where the permissions and also the Assignment Scope of the Security Role would be visible?