Included below is a postmortem to the connectivity issue we experienced yesterday. If there are any outstanding questions after reading, please feel free to reach out to our support team - support@roadmunk.com

What happened - Customers that were not already logged in to Roadmunk were unable to log in and access the application.

Why it happened - An invalid configuration change was made to Roadmunk’s authentication and released to production which caused the application to not run properly. Please note that at no time were any accounts vulnerable to unauthorized access.

What was done to fix it - When the extent of the problem became available Roadmunk’s engineering team investigated and found the root cause. The team executed a manual rollback that deployed an earlier version of authentication to alleviate the issue and allow users the ability to log in. Then, the permanent solution was solidified and deployed to the current version. The issue was resolved within 1 hour. 

How will this be prevented in the future - Moving forward, Roadmunk deployment automation has been enhanced to block deployment on this type of misconfiguration.  In addition, code and configuration review process improvements were made to catch such changes ahead of time.