Prism - Status Page

Experiencing partially degraded performance

Intermittent Network Instability Affecting Portions of Ashburn
  • Update
    Update

    Connection has been established, we will schedule a migration sometime this weekend for all affected nodes except ASH-1, ASH-3, ASH-7, and ASH-9

  • Monitoring
    Monitoring

    Network has stabilized a lot but still intermittently experiences issues for a select portion of users. We are currently waiting to be onboarded by DataPacket.

  • Update
    Update

    This has been postponed as Cloudflare is not currently processing LOAs due to reduced staffing over the holiday period. We expect to proceed once they resume normal operations around January 5th.

  • Identified
    Identified

    We've secured an alternative tunnel (Cosmic was too slow, so we made other arrangements) and plan to cut over tomorrow. We'll announce the specific time shortly. This should resolve all current issues, though it will serve as a temporary fix until our CDN77 cross connect is in place.

  • Monitoring
    Monitoring

    Since moving select chunks of targeted infrastructure over to Cloudflare magic transit (via CosmicGuard) on isolated infrastructure, the network has stabilized. We will continue to monitor the situation, and still plan to bring DataPacket & Cosmic into our main blend.

  • Investigating
    Investigating

    Due to sustained DDoS attacks reaching upwards of 10 Tbps against our Ashburn infrastructure, some customers may notice intermittent packet loss on certain routes (especially European ones) impacting ASH-1 through ASH-20. This is likely a result of our upstream + inline DDoS mitigation provider (GlobalSecureLayer) experiencing saturation at their scrubbing centers during the attacks (they are actually doing a fairly good job at mitigating the attacks with what's available. This is an astronomical amount of bandwidth though).

    Under normal conditions, we can reduce the blast radius by adjusting mitigation trigger thresholds for non-targets to avoid scrubbing paths. In this case, doing so would introduce unacceptable risk to overall network stability, so we’re keeping the more conservative posture in place.

    We understand that consistent connectivity is critical for many workloads. We maintain backup infrastructure in a separate datacenter, and we can move a limited/select number of servers over as a temporary mitigation for customers who are most impacted.

    To add redundancy, we’re bringing CDN77 / DataPacket online as a backup upstream, but provisioning is blocked until their team returns from the Christmas holiday in January. In parallel, we’re also in contact with CosmicGuard as an emergency failover option.

    We’ll continue to post updates as we make progress and appreciate your patience.

Operational

Billing Panel - Operational

Game Panel (Replica Aggregate) - Operational

Bare Metal Management - Operational

Operational

Ashburn Mass Offsite Storage - Operational

Frankfurt Mass Offsite Storage - Operational

Degraded performance

Ashburn Database Functions - Degraded performance

Frankfurt Database Functions - Operational

Degraded performance

ASH-1 - Degraded performance

ASH-2 - Degraded performance

ASH-3 - Degraded performance

ASH-4 - Degraded performance

ASH-5 - Degraded performance

ASH-6 - Degraded performance

ASH-7 - Degraded performance

ASH-9 - Degraded performance

ASH-10 - Degraded performance

ASH-11 - Degraded performance

ASH-12 - Degraded performance

ASH-13 - Degraded performance

ASH-14 - Degraded performance

ASH-15 - Degraded performance

ASH-16 - Degraded performance

ASH-17 - Degraded performance

ASH-18 - Degraded performance

ASH-19 - Degraded performance

ASH-20 - Operational

ASH-21 - Operational

ASH-22 - Operational

ASH-23 - Operational

ASH-24 - Operational

ASH-25 - Operational

ASH-26 - Operational

ASH-27 - Operational

ASH-28 - Operational

ASH-29 - Operational

ASH-30 - Operational

ASH-31 - Degraded performance

ASH-32 - Operational

ASH-33 - Operational

ASH-34 - Operational

ASH-35 - Operational

ASH-36 - Operational

ASH-37 - Operational

ASH-38 - Operational

ASH-39 - Operational

ASH-40 - Degraded performance

ASH-41 - Degraded performance

ASH-42 - Degraded performance

ASH-43 - Degraded performance

ASH-44 - Degraded performance

ASH-45 - Degraded performance

ASH-46 - Degraded performance

VIN-47 (Formerly ASH-47) - Operational

VIN-48 (Formerly ASH-48) - Operational

VIN-49 (Formerly ASH-49) - Operational

VIN-50 (Formerly ASH-50) - Operational

VIN-51 (Formerly ASH-51) - Operational

VIN-52 (Formerly ASH-52) - Operational

Operational

NYC-1 - Operational

NYC-2 - Operational

NYC-3 - Operational

NYC-4 - Operational

NYC-5 - Operational

NYC-6 - Operational

NYC-7 - Operational

NYC-8 - Operational

NYC-9 - Operational

NYC-10 - Operational

JFK-11 - Operational

JFK-12 - Operational

JFK-13 - Operational

JFK-14 - Operational

JFK-15 - Operational

JFK-16 - Operational

JFK-17 - Operational

Operational

g1.tp.abe.ab-ru3 - Operational

Operational

LAX-1 - Operational

LAX-2 - Operational

SEG-3 - Operational

SEG-4 - Operational

SEG-5 - Operational

SEG-6 - Operational

SEG-7 - Operational

SEG-8 - Operational

SEG-9 - Operational

SEG-10 - Operational

Operational

DAL-1 - Operational

DAL-2 - Operational

DFW-4 - Operational

DFW-5 - Operational

DFW-6 - Operational

Operational

MIA-1 - Operational

Operational

LON-1 - Operational

LON-2 - Operational

LON-3 - Operational

Operational

FRA-1 (Formerly LIM-1) - Operational

FRA-2 (Formerly LIM-2) - Operational

NUR-3 - Operational

NUR-4 - Operational

NUR-5 - Operational

NUR-6 - Operational

FAL-7 - Operational

FAL-8 - Operational

Operational

SGP-1 - Operational

Operational

SYD-1 - Operational

This page only shows core services, networking, and public nodes. Private dedicated machines aren’t listed here.

Recent notices

No notices reported for the past 7 days