Users on the https://secure.allocadia.com Allocadia instanced experienced performance issues and some users were unable to login to the system for a brief period on November 2. The first issues were reported approximately 2:40pm Pacific time and the system was restarted and operational again at approximately 2:55pm Pacific time.
Root Cause Analysis
The outage was caused by requests to our application being temporarily blocked inside the Java Virtual Machine. The nature of the event combined with the request timeout period prevented the application from recovering as it normally would, which would have eventually starved the host of resources had we not restarted the service. We are working to better define and detect the root cause of this event, and continually working to improve our recovery process.