For now what we decided to do is create a scheduled task to run every hour with the following properties:
If the "Password Last Set" property is greater than or equal to '%datetime,-1h%' then send email notification
Not the most perfect solution but it should do the trick.