Hello Josh,
Currently, this is impossible, but in the future we'll add the possibility to hide the Disenroll button. We'll apply all our effort to manage to do this in Adaxes 2014.1, but if we don't manage, this will be implemented in the release that will follow Adaxes 2014.1.
By the way, thanks for the suggestion!