Changing password of service account causes random domain users to not be able to connect to SQL Server

Wondering if anyone has ever experienced this issue.

We change the password of the accounts that run the services of  MSSQLSERVER and SQLAgent and but do NOT restart the services or server right away.  After that some users can connect