
Three recent outages at Starlink, Charles Schwab, and the Internet Archive highlight key reminders for NetOps teams around backup options, the role of intelligence, and understanding your end-to-end service delivery chain.A subset of Starlink users were unable to establish a connection; some users of Schwab.com and its apps may have found themselves unable to transact or trade due to an authentication issue; and the Internet Archive and the Wayback Machine were intermittently overwhelmed by unexpected traffic floods.Tune in to learn more about what happened and why, or use the chapters below to jump to the sections that most interest you:
CHAPTERS:00:00 Intro00:54 Starlink Outage07:35 Charles Schwab Outage10:20 DDoS Attack Impacts Internet Archive13:33 Outage Trends: By the Numbers16:12 Get in Touch ———For more insights, check out The Internet Report blog: https://www.thousandeyes.com/blog/internet-report-schwab-starlink-outages?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q4_internetreport_q4fy24ep4_podcast———Want to get in touch?If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. Or follow us on X: @thousandeyes
Jun 21, 2024
16 min

Believe it or not, we’re already about halfway through 2024. Looking at the outage data from this year so far, we see continued evolution, following patterns observed over the past few years. Notably, the percentage of cloud service provider (CSP) outages is still increasing—though at a more accelerated rate than seen in recent years.Tune on to learn more about this trend and other themes we’re noticing in the Internet ecosystem, as well as tips for how IT teams can respond to these evolving challenges.———CHAPTERS:00:00 Intro01:14 Cloud Incident Trends Accelerate13:56 Blending Real Usage Data With Synthetics16:35 AI & NetOps20:52 Get in Touch ———For more insights, check out The Internet Report blog: https://www.thousandeyes.com/blog/internet-report-cloud-outages-rise-2024-trends?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q4_internetreport_q4fy24ep3_podcast———Want to get in touch?If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. Or follow us on X: @thousandeyes
Jun 14, 2024
21 min

When it comes to assuring great digital experiences for your users, intermittent issues can be incredibly difficult to discover and diagnose because the service is both working and not working simultaneously—or, it may simply be running slow. Some users may experience issues, while for others, everything will work just fine.In this week’s episode, The Internet Report team will explore the complexities that intermittent issues can bring by examining two recent incidents at Meta and Salesforce. They’ll also cover an automation bug at Google Cloud that caused problems for a range of customers, as well as recent Internet outage trends.Listen now or use the timestamps below to jump to the sections that most interest you:CHAPTERS00:00 Intro01:00 Meta Disruption05:07 Salesforce DNS Disruption10:08 Google Cloud Issues Impact Spotify, GitLab, and More15:09 Outage Trends: By the Numbers17:14 Get in Touch ———For more insights, check out the related Internet Report blog: https://www.thousandeyes.com/blog/internet-report-meta-salesforce-disruptions?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q4_internetreport_q4fy24ep2_podcast———Want to get in touch?If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. Or follow us on X: @thousandeyes
May 25, 2024
17 min

Explore what happened during recent outages at google.com, X (formerly Twitter), and CDN service jsDelivr. The Internet Report team will also discuss why a detailed understanding of every component in your service delivery chain is vital to maintain the availability and resiliency of your service. If even one component encounters challenges, the entire service can be impacted.In jsDelivr’s case, for example, the detail at issue was an expired cert, which created problems serving content and impacted many websites that rely on the CDN service.Listen now to learn more or use the timestamps below to jump to the sections that most interest you:CHAPTERS:00:00 Intro00:50 google.com Outage05:23 X Outage10:33 jsDelivr Outage15:01 Outage Trends: By the Numbers17:27 Get in Touch ———For more insights, check out the links below:- The Internet Report: Pulse Update blog: https://www.thousandeyes.com/blog/internet-report-x-jsdelivr-google-outages?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q4_internetreport_q4fy24ep1_podcast- Explore the X and google.com outages in the ThousandEyes platform (no login required): X outage: https://aitcvdgvbgkzdxlzjvazipwezvmjeljr.share.thousandeyes.comgoogle.com outage: https://azraqdwpahxlrnviylmbvpumoonabsnh.share.thousandeyes.com———Want to get in touch?If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. Or follow us on X: @thousandeyes
May 10, 2024
18 min

Go under the hood of a ChatGPT outage, H&R Block’s Tax Day disruption, and more incidents from the past few weeks. The Internet Report team will also discuss Microsoft’s update on recent subsea cable cuts and the latest global outage trends.———CHAPTERS:00:00 Intro00:57 ChatGPT Outage03:35 Revisiting West Coast of Africa Cable Cuts09:07 H&R Block Outage11:32 Sky Mobile Outage12:25 Outage on unpkg CDN14:06 PlayHQ Outage16:40 Outage Trends: By the Numbers19:33 Get in Touch ———For more insights, check out the links below:- The Internet Report: Pulse Update blog: https://www.thousandeyes.com/blog/internet-report-pulse-update-chatgpt-outage-more-news?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse34_podcast- Explore the ChatGPT outage in the ThousandEyes platform (no login required): https://akhdjionjdupmjvkqfyigkaorlxgzgir.share.thousandeyes.com- Review Microsoft’s post-incident report on the west coast of Africa cable cuts (see the entry labeled March 14, tracking ID: VT60-RPZ): https://azure.status.microsoft/en-gb/status/history/- Also watch Microsoft’s related Azure Incident Retrospective video: https://www.youtube.com/watch?v=ypU_UuwW_w8&list=PLmsFUfdnGr3xomlYbZPAYTtFdkcvbv2ye———Want to get in touch?If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. Or follow us on X: @thousandeyes
Apr 27, 2024
20 min

With tax season coming to a close in the United States, IT teams at tax preparation companies and other organizations in the industry will be taking extra care to make sure that their systems can handle a spike in traffic due to a potential last-minute rush of filings. Tune in to hear The Internet Report hosts discuss how IT teams can navigate major spikes in demand and give customers the best possible digital experience, whether it’s Tax Day, Black Friday, or another high-traffic period.They’ll also unpack recent outages at companies including Apple and WhatsApp, and explore why a sudden reduction in page load times may indicate functional issues rather than true improvements to the customer’s digital experience.———CHAPTERS:00:00 Intro01:11 Navigating U.S. Tax Season and Spikes in Demand06:37 Pulse Update: Outage Analysis06:40 Apple Outage: App Store, TV+, and Music13:35 WhatsApp, Other Meta Services Disrupted15:04 Square Outage17:19 Performance as a Cyber Indicator: XZ Utils20:48 Panera Bread Outage22:33 Ray AI Disruption24:13 Outage Trends: By the Numbers27:05 Get in Touch ———Want to get in touch?If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. Or follow us on X: @thousandeyes
Apr 13, 2024
27 min

The end-to-end delivery of modern digital services can introduce a complex web of dependencies and failure points, which can stem from direct relationships as well as third-party providers, introducing layers of abstraction for operations teams to keep track of. Managing this complex ecosystem can be challenging. Unexpected issues may arise from seemingly insignificant components, surprising even the largest, most technologically sophisticated organizations.For example, in recent weeks, problems at third-party providers led to outages at McDonald’s and the Department of Motor Vehicles. Tune in to the episode to hear what happened and explore other incidents from the last couple of weeks.——— CHAPTERS00:00 Intro01:09 Payment and Ordering Systems Cut Out at McDonald’s04:36 Disruptions at the DMV08:48 Cable Cut in West Africa10:16 Another Fiber Cut, but With Layered Redundancy14:12 PlayStation Network, GeForce Now Experience Issues16:21 Get in Touch ———For more insights, check out these links:- The Internet Report: Pulse Update Blog: https://www.thousandeyes.com/blog/internet-report-pulse-update-mcdonalds-dmv-outages?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse32_podcast- Explore the Africa undersea cable cut in the ThousandEyes platform (no login required): https://alxucgibmtsxarllvvybwfagzkvvlokf.share.thousandeyes.com/———Want to get in touch?If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. Or follow us on X: @thousandeyes
Mar 30, 2024
17 min

Over a two-day period this past week, major social media platforms—Meta’s Facebook and Instagram, LinkedIn, and Discord—all experienced disruptions. In the same timeframe, Comcast was also impacted by an outage that affected access to specific services and applications.Meta experienced issues with its log-in process, Discord navigated unexpectedly high load volumes, Comcast dealt with 100% packet loss in part of its backbone, and—the following day—LinkedIn worked its way through a backend issue.These incidents each leave valuable reminders for NetOps teams as they seek to minimize downtime and assure exceptional digital experiences.Tune in to the episode to learn more and also gain insight into the latest outage numbers and trends.——— CHAPTERS:00:00 Intro00:58 Comcast Outage05:09 Meta Outage09:38 Discord Disruption10:25 LinkedIn Outage13:22 DIRECTV Service Disruption15:25 Outage Trends: By the Numbers17:03 Get in Touch ———For more insights, check out these links:- The Internet Report: Pulse Update Blog: https://www.thousandeyes.com/blog/internet-report-pulse-update-meta-linkedin-comcast-outages?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse31_podcast- Explore the outages in the ThousandEyes platform (no login required):Comcast Outage: https://afplzaqpehynhosldcqefycfhqqcrbzh.share.thousandeyes.com LinkedIn Outage: https://anxjzezcpptrnpodjucgzzixdkldguzm.share.thousandeyes.com - Internet Outages Timeline: https://www.thousandeyes.com/resources/internet-outages-timeline?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse31_podcast———Want to get in touch?If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. Or follow us on X: @thousandeyes
Mar 16, 2024
17 min

Load is a fundamental but, at times, challenging variable for networks and operations teams to handle. In the past few weeks, ThousandEyes saw various load-related problems impact organizations including Google Cloud, Front, several Australian banks, and Minnesota State University Moorhead.Tune in to learn more about what happened during these incidents, as well as hear our commentary on the recent outage impacting AT&T. Use the timestamps below to jump to the sections that most interest you: CHAPTERS:00:00 Intro00:59 AT&T outage impacts cellular services nationwide04:40 Australian banks appear to lose online and app-based services for 24 hours07:46 Google Cloud metadata store faces sudden demand spike09:19 Front’s “large unexpected increase in web traffic”10:23 Box experiences outage as third-party network component fails11:23 Minnesota State University Moorhead’s case study on good visibility12:44 Outage trends: By the numbers15:35 Get in touch ———For more insights, check out these links:- Explore the Front disruption in the ThousandEyes platform (no login required): https://aczocbxpamiipkdqnaqdedkytwhlfjtw.share.thousandeyes.com?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse30_podcast- Internet Outages Timeline: https://www.thousandeyes.com/resources/internet-outages-timeline?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse30_podcast———Want to get in touch?If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. Or follow us on X: @thousandeyes
Mar 4, 2024
16 min

When outages happen, it’s what you do next that matters. It’s important to have a backup plan in place that you can quickly activate to minimize the impact of an incident.Over the past two weeks, companies initiated a range of resiliency actions, including asking customers to use alternate authentication methods (or to avoid logging out of a service), setting up a new contact center to re-establish lines of communication, and reverting to manual processes.Tune in to learn more about what happened during these and other recent incidents.CHAPTERS:00:00 Intro01:00 Square Outage Impacts “Multiple” Services04:18 Applied Digital’s Multi-week Data Center Issue07:14 UC Berkeley Data Center Outage08:44 Russia .ru Domain Outage10:05 Cyber Attack at Lurie Children's Hospital11:36 Outage Trends: By the Numbers15:55 Get in Touch———For more insights on outage trends and analysis of some of the most notable outages of 2023, check out our on-demand webinar: https://www.thousandeyes.com/resources/amer-top-outages-2023-analyses-takeaways-webinar?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse29_podcastIn EMEA and want to tune in live? We’re hosting one more live webinar session on Feb. 22 at 10 AM (GMT). Register now: https://www.thousandeyes.com/webinars/emea-top-outages-2023-analyses-takeaways?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse29_podcastAnd also check out these links:- The Internet Report: Pulse Update Blog: https://www.thousandeyes.com/blog/internet-report-pulse-update-square-outage-and-more-news?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse29_podcast- Explore the .ru domain outage in the ThousandEyes platform (no login required): https://awuyqonlmzxmvizsdcgevvdhcbzervks.share.thousandeyes.com?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse29_podcast- Internet Outages Timeline: https://www.thousandeyes.com/resources/internet-outages-timeline?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse29_podcast———Want to get in touch?If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. Or follow us on X: @thousandeyes
Feb 17, 2024
17 min
Load more
