Incidents | Pumpkin's Pool Incidents reported on status page for Pumpkin's Pool https://status.pumpkinspool.com/ https://d1lppblt9t2x15.cloudfront.net/logos/0dfe4c7750e8d1e0488c69a95dac637f.png Incidents | Pumpkin's Pool https://status.pumpkinspool.com/ en Latitude Outage https://status.pumpkinspool.com/incident/632342 Mon, 28 Jul 2025 18:14:00 -0000 https://status.pumpkinspool.com/incident/632342#bba48a1c548468e416e07825452d09b8f2418ce299124e1be9d862456d752d0a Pumpkin's Pool is back online after a brief outage. Post Mortem 1️⃣ Latitude sent us a notification scheduling Dallas maintenance two days from now. 2️⃣ We responded by patching & rebooted our backup to prep for that maintenance window. 3️⃣ Mid-reboot, an unplanned "power event" in Latitude's Dallas DC dropped the primary leaving both nodes offline. ✅ Changes going forward • We have ordered a new primary validator server from TeraSwitch. Latitude Outage https://status.pumpkinspool.com/incident/632342 Mon, 28 Jul 2025 18:14:00 -0000 https://status.pumpkinspool.com/incident/632342#bba48a1c548468e416e07825452d09b8f2418ce299124e1be9d862456d752d0a Pumpkin's Pool is back online after a brief outage. Post Mortem 1️⃣ Latitude sent us a notification scheduling Dallas maintenance two days from now. 2️⃣ We responded by patching & rebooted our backup to prep for that maintenance window. 3️⃣ Mid-reboot, an unplanned "power event" in Latitude's Dallas DC dropped the primary leaving both nodes offline. ✅ Changes going forward • We have ordered a new primary validator server from TeraSwitch. Latitude Outage https://status.pumpkinspool.com/incident/632342 Mon, 28 Jul 2025 18:14:00 -0000 https://status.pumpkinspool.com/incident/632342#bba48a1c548468e416e07825452d09b8f2418ce299124e1be9d862456d752d0a Pumpkin's Pool is back online after a brief outage. Post Mortem 1️⃣ Latitude sent us a notification scheduling Dallas maintenance two days from now. 2️⃣ We responded by patching & rebooted our backup to prep for that maintenance window. 3️⃣ Mid-reboot, an unplanned "power event" in Latitude's Dallas DC dropped the primary leaving both nodes offline. ✅ Changes going forward • We have ordered a new primary validator server from TeraSwitch. FD GUI recovered https://status.pumpkinspool.com/ Mon, 28 Jul 2025 18:02:15 +0000 https://status.pumpkinspool.com/#29561f1cc143023770dc49d171b178cce58266af013a6b5a9cce07001eb0c6c5 FD GUI recovered Dallas recovered https://status.pumpkinspool.com/ Mon, 28 Jul 2025 17:59:33 +0000 https://status.pumpkinspool.com/#af7d97ed70741c586c527ad45379acbe9941fab1995992fde489366147b5d754 Dallas recovered FD GUI went down https://status.pumpkinspool.com/ Mon, 28 Jul 2025 16:38:54 +0000 https://status.pumpkinspool.com/#29561f1cc143023770dc49d171b178cce58266af013a6b5a9cce07001eb0c6c5 FD GUI went down Dallas went down https://status.pumpkinspool.com/ Mon, 28 Jul 2025 16:37:41 +0000 https://status.pumpkinspool.com/#af7d97ed70741c586c527ad45379acbe9941fab1995992fde489366147b5d754 Dallas went down London recovered https://status.pumpkinspool.com/ Wed, 23 Jul 2025 01:20:56 +0000 https://status.pumpkinspool.com/#2160c48f2cbc41e697552ccfc65377fe8e8e5a92db67db14eb23a64a6b273bcb London recovered London went down https://status.pumpkinspool.com/ Wed, 23 Jul 2025 01:11:19 +0000 https://status.pumpkinspool.com/#2160c48f2cbc41e697552ccfc65377fe8e8e5a92db67db14eb23a64a6b273bcb London went down Watchtower recovered https://status.pumpkinspool.com/ Sun, 06 Jul 2025 02:10:34 +0000 https://status.pumpkinspool.com/#cc96a61a4f2a85041889aceef6f4acfe1714e9c0bc4acd5b4532afcedcd91fff Watchtower recovered Watchtower went down https://status.pumpkinspool.com/ Sun, 06 Jul 2025 02:08:36 +0000 https://status.pumpkinspool.com/#cc96a61a4f2a85041889aceef6f4acfe1714e9c0bc4acd5b4532afcedcd91fff Watchtower went down New York City recovered https://status.pumpkinspool.com/ Fri, 04 Jul 2025 04:25:33 +0000 https://status.pumpkinspool.com/#ec283aeb5c6c4d4884e2c9d844e6094a41b521448dff3d1a07f3b92887c0b2da New York City recovered New York City went down https://status.pumpkinspool.com/ Fri, 04 Jul 2025 04:22:37 +0000 https://status.pumpkinspool.com/#ec283aeb5c6c4d4884e2c9d844e6094a41b521448dff3d1a07f3b92887c0b2da New York City went down Testnet Watchtower Heartbeat recovered https://status.pumpkinspool.com/ Fri, 04 Jul 2025 04:17:15 +0000 https://status.pumpkinspool.com/#71ea7df02b2abcc8302beec467c2413c4e6a578fae0f2b691b7ccabf567845e0 Testnet Watchtower Heartbeat recovered Testnet Watchtower Heartbeat went down https://status.pumpkinspool.com/ Fri, 04 Jul 2025 04:05:39 +0000 https://status.pumpkinspool.com/#71ea7df02b2abcc8302beec467c2413c4e6a578fae0f2b691b7ccabf567845e0 Testnet Watchtower Heartbeat went down Testnet Watchtower Heartbeat recovered https://status.pumpkinspool.com/ Fri, 04 Jul 2025 03:50:27 +0000 https://status.pumpkinspool.com/#13b1ac773d8233ae898b3c00f8feb430e7c51352cba26fd55d16aaf800334453 Testnet Watchtower Heartbeat recovered Testnet Watchtower Heartbeat went down https://status.pumpkinspool.com/ Fri, 04 Jul 2025 03:48:00 +0000 https://status.pumpkinspool.com/#13b1ac773d8233ae898b3c00f8feb430e7c51352cba26fd55d16aaf800334453 Testnet Watchtower Heartbeat went down Watchtower recovered https://status.pumpkinspool.com/ Fri, 04 Jul 2025 03:29:06 +0000 https://status.pumpkinspool.com/#d7f8bb6ab8a63932ecaa6c776142e6c4a4b0e336d0e65e015e262a805a50534c Watchtower recovered Watchtower went down https://status.pumpkinspool.com/ Fri, 04 Jul 2025 03:19:57 +0000 https://status.pumpkinspool.com/#d7f8bb6ab8a63932ecaa6c776142e6c4a4b0e336d0e65e015e262a805a50534c Watchtower went down Watchtower recovered https://status.pumpkinspool.com/ Fri, 04 Jul 2025 03:05:09 +0000 https://status.pumpkinspool.com/#73c4f76fec5195fa264911c3b1f72adbace255f98e642d93d052651e2f56045f Watchtower recovered Watchtower went down https://status.pumpkinspool.com/ Fri, 04 Jul 2025 00:08:28 +0000 https://status.pumpkinspool.com/#73c4f76fec5195fa264911c3b1f72adbace255f98e642d93d052651e2f56045f Watchtower went down Watchtower recovered https://status.pumpkinspool.com/ Thu, 03 Jul 2025 21:37:17 +0000 https://status.pumpkinspool.com/#aa07f6d880360e43bf2e62a516cf225f4433c480ebb09208b6473294ffb7cca2 Watchtower recovered Watchtower went down https://status.pumpkinspool.com/ Thu, 03 Jul 2025 21:25:42 +0000 https://status.pumpkinspool.com/#aa07f6d880360e43bf2e62a516cf225f4433c480ebb09208b6473294ffb7cca2 Watchtower went down Downtime incident https://status.pumpkinspool.com/incident/613893 Thu, 03 Jul 2025 19:45:00 -0000 https://status.pumpkinspool.com/incident/613893#c525e73d9eba1a67ec001115da2041c87a9c76b0d24c9b99dbf7e68403e164a4 We have resolved all services and do not anticipate this happening again in the future. Downtime incident https://status.pumpkinspool.com/incident/613893 Thu, 03 Jul 2025 19:45:00 -0000 https://status.pumpkinspool.com/incident/613893#c525e73d9eba1a67ec001115da2041c87a9c76b0d24c9b99dbf7e68403e164a4 We have resolved all services and do not anticipate this happening again in the future. Downtime incident https://status.pumpkinspool.com/incident/613893 Thu, 03 Jul 2025 19:45:00 -0000 https://status.pumpkinspool.com/incident/613893#c525e73d9eba1a67ec001115da2041c87a9c76b0d24c9b99dbf7e68403e164a4 We have resolved all services and do not anticipate this happening again in the future. Downtime incident https://status.pumpkinspool.com/incident/613893 Thu, 03 Jul 2025 19:45:00 -0000 https://status.pumpkinspool.com/incident/613893#c525e73d9eba1a67ec001115da2041c87a9c76b0d24c9b99dbf7e68403e164a4 We have resolved all services and do not anticipate this happening again in the future. Downtime incident https://status.pumpkinspool.com/incident/613893 Thu, 03 Jul 2025 19:15:00 -0000 https://status.pumpkinspool.com/incident/613893#9e33414c76dd8c1094b1ec1354a8833e3a3fb00ea643eab958b6c48ffaf5a028 Today we had a surprising incident where both our monitoring server went down unexpectedly and our mainnet validator fell behind. We have improved our monitoring significantly to prevent this from happening in the future. Downtime incident https://status.pumpkinspool.com/incident/613893 Thu, 03 Jul 2025 19:15:00 -0000 https://status.pumpkinspool.com/incident/613893#9e33414c76dd8c1094b1ec1354a8833e3a3fb00ea643eab958b6c48ffaf5a028 Today we had a surprising incident where both our monitoring server went down unexpectedly and our mainnet validator fell behind. We have improved our monitoring significantly to prevent this from happening in the future. Downtime incident https://status.pumpkinspool.com/incident/613893 Thu, 03 Jul 2025 19:15:00 -0000 https://status.pumpkinspool.com/incident/613893#9e33414c76dd8c1094b1ec1354a8833e3a3fb00ea643eab958b6c48ffaf5a028 Today we had a surprising incident where both our monitoring server went down unexpectedly and our mainnet validator fell behind. We have improved our monitoring significantly to prevent this from happening in the future. Downtime incident https://status.pumpkinspool.com/incident/613893 Thu, 03 Jul 2025 19:15:00 -0000 https://status.pumpkinspool.com/incident/613893#9e33414c76dd8c1094b1ec1354a8833e3a3fb00ea643eab958b6c48ffaf5a028 Today we had a surprising incident where both our monitoring server went down unexpectedly and our mainnet validator fell behind. We have improved our monitoring significantly to prevent this from happening in the future.