All systems are operational

Stickied Incidents

28th November 2021

Radagast Emergency maintenance

We had to perform emergency maintenance on the host, the customers are moved live to a temp host, we will revert to radagast after the server gets backup.

  • Due to the extra traffic on the node we reached a point where the swapiness level was breaking performance since we had a low size SWP mount, we introduced a new per instance SWP that is 4.5 time larger.

  • 26th August 2021

    Software Update Services Migration of Software Update Services

    We are performing a migration to a new LB cluster from the current single server solution.

  • Move finished

  • Past Incidents

    8th December 2018

    eServices Members Area Members Area maintenance.

    Members Area is fully functional.

    eServices Members Area Members Area maintenance.

    During the maintenance we got hit by a bug on rejoining the update members area to Halcyon. We have resolved the issue and expect the members area to be up and accessible from all locations in the next hour.

    7th December 2018

    eServices Members Area Members Area maintenance.

    We will be performing maintenance for our Members Area. No downtime on services expected.

    1st December 2018

    ESGWDEBE01 Network Configuration Changes

    Maintenance Finished

    ESGWDEBE01 Network Configuration Changes

    We are performing some changes in one of our core switches. We are routing traffic through our other route for the next 1 hour.

    Denethor Server reboot took too long to reboot

    Issue fixed

    Denethor Server reboot took too long to reboot

    We have identified the issue, the problem is with the mounting of the backup storage while booting. We are in the process of fixing the issue.

    Denethor Server reboot took too long to reboot

    Server was expected to reboot in 4 seconds, it took 4 times that to finish the reboot. We are investigating the issue.

    Denethor Server Reboot (Kernel Upgrade)

    Server rebooted due to major kernel upgrade Note: Server took 16 seconds to come up, we are going to investigate the delay.

    Lalaith Server Reboot (Kernel Upgrade)

    Server rebooted due to major kernel upgrade

    Freca Server Reboot (Kernel Upgrade)

    Server rebooted due to major kernel upgrade

    Radagast Server Reboot (Kernel Upgrade)

    Server rebooted due to major kernel upgrade

    Gandalf Server Reboot (Kernel Upgrade)

    Server rebooted due to major kernel upgrade