After an update to Azure AD Connect we found that status of DirSync was syncing the directory but not the passwords.
The password sync had become disabled. To re-enable we need to re-configure Azure AD Connect.
Start Azure AD connect and press configure
In the optional features screen, check Password Synchronization