MonsterMegs - Notice history

All systems operational

About This Site

Welcome to MonsterMegs' status page. If you want to keep on top of any disruptions in service to our website, control panel, or hosting platform, this is the page to check. We report minor/major outages and scheduled maintenance to this status page. However, issues affecting a small number of customers may be reported directly to affected customers in MyMonsterMegs (https://my.monstermegs.com). If you're experiencing an issue you do not see reported on this page, please log into MyMonsterMegs to view any alerts our team has added to your account.

100% - uptime

Website - Operational

100% - uptime
Nov 2023 · 100.0%Dec · 100.0%Jan 2024 · 100.0%
Nov 2023
Dec 2023
Jan 2024

Customer Portal - Operational

100% - uptime
Nov 2023 · 100.0%Dec · 100.0%Jan 2024 · 100.0%
Nov 2023
Dec 2023
Jan 2024
100% - uptime

Thunder - Operational

100% - uptime
Nov 2023 · 100.0%Dec · 100.0%Jan 2024 · 100.0%
Nov 2023
Dec 2023
Jan 2024

Hurricane - Operational

100% - uptime
Nov 2023 · 100.0%Dec · 100.0%Jan 2024 · 100.0%
Nov 2023
Dec 2023
Jan 2024

Storm - Operational

100% - uptime
Nov 2023 · 100.0%Dec · 100.0%Jan 2024 · 99.99%
Nov 2023
Dec 2023
Jan 2024

Lightning - Operational

100% - uptime
Nov 2023 · 100.0%Dec · 100.0%Jan 2024 · 99.99%
Nov 2023
Dec 2023
Jan 2024
100% - uptime

DNS-1 - Operational

100% - uptime
Nov 2023 · 100.0%Dec · 100.0%Jan 2024 · 100.0%
Nov 2023
Dec 2023
Jan 2024

DNS-2 - Operational

100% - uptime
Nov 2023 · 100.0%Dec · 100.0%Jan 2024 · 100.0%
Nov 2023
Dec 2023
Jan 2024

DNS-3 - Operational

100% - uptime
Nov 2023 · 100.0%Dec · 100.0%Jan 2024 · 100.0%
Nov 2023
Dec 2023
Jan 2024

DNS-4 - Operational

100% - uptime
Nov 2023 · 100.0%Dec · 100.0%Jan 2024 · 100.0%
Nov 2023
Dec 2023
Jan 2024
100% - uptime

US Backup Storage Daily - Operational

100% - uptime
Nov 2023 · 100.0%Dec · 100.0%Jan 2024 · 100.0%
Nov 2023
Dec 2023
Jan 2024

US Backup Storage Weekly - Operational

100% - uptime
Nov 2023 · 100.0%Dec · 100.0%Jan 2024 · 100.0%
Nov 2023
Dec 2023
Jan 2024

EU Backup Storage Daily - Operational

100% - uptime
Nov 2023 · 100.0%Dec · 100.0%Jan 2024 · 100.0%
Nov 2023
Dec 2023
Jan 2024

EU Backup Storage Weekly - Operational

100% - uptime
Nov 2023 · 100.0%Dec · 100.0%Jan 2024 · 100.0%
Nov 2023
Dec 2023
Jan 2024
100% - uptime

Zabbix Monitoring Server US - Operational

100% - uptime
Nov 2023 · 100.0%Dec · 100.0%Jan 2024 · 100.0%
Nov 2023
Dec 2023
Jan 2024

Zabbix Monitoring Server EU - Operational

100% - uptime
Nov 2023 · 100.0%Dec · 100.0%Jan 2024 · 100.0%
Nov 2023
Dec 2023
Jan 2024

Third Party: Cloudflare → Cloudflare Sites and Services → CDN/Cache - Operational

Notice history

Jan 2024

Emergency Hardware Replacement
  • Completed
    January 29, 2024 at 2:33 AM
    Completed
    January 29, 2024 at 2:33 AM

    The hardware components have been replaced and the server is now back online. We will continue to monitor the server closely for any further reboots, but hopefully the replacement of these components will be the solution.

  • In progress
    January 29, 2024 at 2:00 AM
    In progress
    January 29, 2024 at 2:00 AM

    Maintenance is now in progress

  • Planned
    January 29, 2024 at 2:00 AM
    Planned
    January 29, 2024 at 2:00 AM

    We are reaching out to inform you about an urgent maintenance operation that needs to be conducted on the server hosting your account. Over the past two weeks, we've encountered sporadic reboots on this server, occurring every few days. Initially, we suspected kernel panics as the root cause and took measures to enable extended logging to capture kernel dump logs during the subsequent reboots. However, upon analysis, we found no output from the kernel and no additional logs shedding light on the issue.

    Given the absence of software-related explanations, we have engaged with our datacenter, and they suspect a faulty CPU may be the culprit. To address this, we will need to replace the CPU, a process that will require the server to be offline for an estimated period of 30-60 minutes. Additionally, we've requested the datacenter to swap out the RAM sticks and the power supply concurrently. While the CPU is the primary suspect, we are taking a comprehensive approach to ensure that other hardware components are not contributing to the problem. The replacement of these additional components will only marginally extend the downtime, adding approximately 5-10 minutes.

    The scheduled maintenance to replace the CPU and other hardware components is set for** 8 PM CST tonight**. Typically, we like to provide more advanced notice for such operations, but given the urgency to mitigate further disruptions caused by the random reboots, we believe swift action is warranted.

    We sincerely appreciate your understanding and apologize for any inconvenience this may cause. Should you have any concerns or questions, please don't hesitate to reach out to our support team.

    Thank you for your cooperation.

    Warm regards,

    MonsterMegs Team

Kernel Panics - Thunder
  • Resolved
    Resolved

    The reboot has been completed and the kdump extended logging has been enabled. It appears there have been several kernel panics that caused these random reboots throughout the week. The addition of kdump will generate a dump file on any kernel panics that Cloudlinux will review to determine the cause of the kernel panics.

    This know this is directly related to Cloudlinux due to the fact that we had this server running on cpanel for over a month before the migrations, with no reboots or issues of this kind. Since incorporating Cloudlinux into the server, the issue started to present itself a few days later after the migrations were complete.

    Over the next several days we will be monitoring the server closely for any of these kernel panics and will work closely with the Cloudlinux team to track down the issue and get this resolved ASAP.

    If any more information comes to light, we will update this post accordingly.

  • Monitoring
    Monitoring

    We are going to require an additional server reboot to enable additional logging. This is going to happen in the next 5 minutes and should take about 3-5 minutes.

  • Update
    Update

    The reboot was completed at 6:53am CST.

    The cloudlinux team are still investigating the issue and we will update as more information comes in. Please be aware that further reboots may be required, but not guaranteed. They also may need to restart services as they troubleshoot, but have been informed to keep any impacts to a minimum.

  • Investigating
    Investigating

    We need to perform an emergency reboot on the server. We have found an issue where the server has been rebooting on its own and we are working with the Cloudlinux team to track down the cause.

Hosting Migrations - US Servers
  • Completed
    January 14, 2024 at 4:28 AM
    Completed
    January 14, 2024 at 4:28 AM

    The server migrations are now complete. Over the next few hours we will be resolving any small issues, performing follow up tasks, and doing a post migration audit.

    If you are using a 3rd party dns provider such as Cloudflare or DNSMadeEASY, you may now update 3rd party dns zone with the new ips:

    Storm Server: 184.95.50.250 -> 38.46.220.132
    Thunder Server: 108.170.49.202 -> 38.46.220.134

    If you have a dedicated ip assigned to your account, you can find this ip listed your cpanel account. It is listed in the right had column under the "General Information" section.

    We have also added Mailbaby email delivery to the Storm server. This is a email service that we have been using on our Semi-Dedicated hosting plans for the last year and have had great success with email deliverability. Those using a 3rd party dns service will need to add the following to their SPF txt entry.

    +include:relay.mailbaby.net

    Over the next couple days we will be resolving any lingering issues and ask everyone to be patient as we work through these issues.

  • Update
    January 14, 2024 at 3:35 AM
    In progress
    January 14, 2024 at 3:35 AM

    The server migration of the Thunder server is now complete. The Storm server is at about 74% and should complete within the next 2 hours or so.

    We will provide another update when the Storm server migration is complete.

    Once the migration itself is complete, we will have a couple hours of backend task to complete, so please be patient as we update all our backend components.

  • In progress
    January 14, 2024 at 2:00 AM
    In progress
    January 14, 2024 at 2:00 AM

    Maintenance is now in progress

  • Planned
    January 14, 2024 at 2:00 AM
    Planned
    January 14, 2024 at 2:00 AM

    As mentioned a couple of weeks ago, we will be migrating your server to new updated server and a new datacenter location in Salt Lake City, Utah (Fiberstate). In this email we will address a few details of the server migration process, along with a time line. The time line will be a rough estimate as it is hard to anticipate transfer speeds, but if anything we believe this will go faster than anticipated.

    We are very excited for this move and we feel our customers are going to love the changes. The server speeds on these new Ryzen 9 7950x servers are nothing short of amazing. These servers are outfitted with top of line components and really shows in the work we have done over the last month to get these servers ready for production.

    This Saturday (January 13th, 2024) at 8:00pm CST we will begin the migration process. We anticipate this transfer to take 4-6 hours, but like stated earlier, we expect it finish quite a bit faster. During this migration there will be no downtime, although there may be slow downs due to the strain on the servers during the migration. We recommend that if possible, to avoid any changes to websites, cpanel settings, etc during this time. These changes could get lost during the transfer process.

    Once the migration is complete, we have some small back-end tasks to complete before we can consider the migration to complete. Over the following 72 hours we will be tweaking settings and taking care of any small issues that may be detected. So you may notice some small slowdowns or very short periods of failed connections as we restart services. We anticipate the impact will be little to none.

    With all migrations, the ips that serve your website will be changing. If you are using our nameservers as standard, such as ns1.megpanel.com, ns2.megpanel.com, etc, there will nothing required on your end to point to the new server. As your account migrates to the new server, the new ip will be automatically updated in the dns cluster.

    Now, if you are using a 3rd party dns provider, such as Cloudflare, you will need to be aware that once the migrations are complete, you will need to update your dns zones directly at the dns provider with the new ip address. The ip changes are as follows:

    Storm Server: 184.95.50.250 -> 38.46.220.132
    Thunder Server: 108.170.49.202 -> 38.46.220.134

    If your account has a dedicated ip and using a 3rd party dns provider, you will need to use that dedicated ip in place of the ips listed above. You will be able to find your assigned dedicated ip in your cpanel interface after the migration. You can find the dedicated ip listed under the "General Information" in the right column of cpanel.

    We will be posting updates on our Server Status page throughout the entire process. So if you have not yet subscribed, we urge you do so as all updates will be there. Our Server Status page is also directly integrated into our billing portal, so all details will also be found on customer portal homepage.

    All migration updates and post-migration details will be posted on our Server Status page and in our client portal.

    We ask that everyone is patient during the migration process and the days following. Our staff will be incredibly busy with post migration tasks, so we ask that if possible, to hold off on any non-urgent tickets.

    We will send one final email the day before the migration that will serve as a final reminder.

Dec 2023

Enom Domain Access
  • Resolved
    Resolved

    We have come up with a workaround for the time being. We have come up with a reverse proxy that masks this server as the Enom server and the proxies straight to the Enom ip address.

    This workaround will allow customers to access their Enom domains like normal until Enom updates their OpenSSL version.

  • Identified
    Identified

    After last nights server upgrade, we are aware of an issue accessing domains that are through our old domain registrar Enom. If you are affected, you will see an error "An issue was encountered while retrieving the domain nameservers. Please contact support.". This error has no impact on the domain service itself, but rather making changes to the domain via our client portal.

    This error is due to an upgrade in the OpenSSL version on the server and Enom running an old version that is not compatible with the new version. At this point there is not a fix offered from Enom or WHMCS (our billing system vendor). We have confirmed that there are many others facing the same issue.

    We are attempting to come up with a solution to this ASAP, but at this point it is out of our hands until one of these vendors offers a fix to this issue.

    Until this is resolved, customers will have 2 options to make changes to their domain.

    1. We could start a domain transfer to our current domain registrar. The cost associated with this is basically the cost of the domain for 1 year. The domain transfer will also extend your domain for 1 year of registration. If you are interested in this option, please contact our Domains department and we will get you squared away.

    2. The other option available if you need to make changes to your domain, is to open a support ticket to our Domains department and we will perform the changes for you.

    We understand this a huge inconvenience and we are doing everything in our power to come up with a solution. Once we have more information, we will update this incident report.

Billing System Upgrades
  • Completed
    December 03, 2023 at 2:03 AM
    Completed
    December 03, 2023 at 2:03 AM

    Maintenance has completed successfully.

  • In progress
    December 03, 2023 at 1:00 AM
    In progress
    December 03, 2023 at 1:00 AM

    Maintenance is now in progress

  • Planned
    December 03, 2023 at 1:00 AM
    Planned
    December 03, 2023 at 1:00 AM

    We will performing update to our billing system and it may be unavailable to customers for a period of 2 hours. If you have any emergency issues during this time, we ask that you email support@monstermegs.com directly.

Nov 2023

No notices reported this month

Nov 2023 to Jan 2024

Next