Tag: outage

  • Yesterday, Facebook experienced their worst outage since 2008

    Yesterday, Facebook experienced their worst outage since 2008

    Yesterday if you were trying to login to Facebook, Instagram, WhatsApp or even Oculus VR you wouldn’t have had much luck. Facebook experienced their worst outage since 2008 (when a bug caused the site to be down for an entire day). They were down for just over 6 hours as a world that suddenly found themselves with more time on their hands speculated why.

    For a brief period, the domain Facebook.com was even for sale if you performed a search for the domain on a domain name search website.

    While many thought it could be an attack on their networks, such as what’s been happening in the VoIP sector lately, others speculated the outage was related to the fire Facebook has been under lately for their business practices.

    On Sunday, Facebook whistleblower Frances Haugen – a former Facebook project manager – went public on how Facebooks policies prioritize profits over their user’s wellbeing. She was the person responsible for the massive data dump that showed Facebook’s algorithms even optimize for hate speech. She noted these problems also exist at Google and Pinterest, other companies she’s performed similar duties for, but that the problem is much worst at Facebook.

    Mark Zuckerberg Meme
    There have been no shortage of memes taking shots at Facebook founder Mark Zuckerberg following the outage.

    Hearings begin this week analyzing the whistleblower findings, particularly as they relate to children on these sites. Amid the controversy Facebook has shelved plans for an Instagram Kids app, though Facebook claims the delay is so they can better analyze the needs of children and parents before moving forward with the app.

    The main crux of the case has to do with both the deluge of data and how major players such as Facebook (and likely beyond) serve that data to their users. It’s a tricky situation because you don’t want to stifle free speech but promoting hate speech and negative imagery, especially to vulnerable audiences such as children, is also wrong.

    There is so much more to the case then we can get to here but suffice to say hearings such as these play an important role in how we as a society consume and regulate data.

    Back to the topic at hand though, after being down for 6 hours Facebook finally emerged although they did so with little in the way of answers as to why their domains were down to the first place. They’ve issued an apology for the outage but beyond that silence.

    Experts who have weighed in speculate the issue had to do with Facebooks DNS (Domain Name System), and anonymous comments that have surfaced from employees said they don’t think the downtime was caused by an attack.

    Some reports have even said during the outage functions inside Facebook offices ground to a halt, with some employees being unable to even use their keycards which could have also contributed to the lengthy delay in fixing the problem.

    Outages such as these should cause even smaller businesses to take a hard look at their technology practices. If Facebook, with the resources they have available, can be brought to a standstill for hours over potentially a small issue such as DNS how would your business fare when faced with a similar issue?

    Downtime adds up, but it doesn’t have to. Having a partner in technology like Valley Techlogic is the number one way your business can avoid the hassle, expense, and embarrassment of lengthy downtime. Find out more today.

    Looking for more to read? We suggest these other articles from our site.

    This article was powered by Valley TechLogic, adns, n IT service provider in Atwater, CA. You can find more information at https://www.valleytechlogic.com/ or on Facebook at https://www.facebook.com/valleytechlogic/ . Follow us on Twitter at https://x.com/valleytechlogic.

  • The Massive Internet Outage and The Human Error Behind It

    The Massive Internet Outage and The Human Error Behind It

    A number of major websites were down yesterday morning, including Google, Amazon, Reddit and Twitch. The outage lasted for an hour and even broke services such as Twitter’s emoji.

    The outage occurred through Fastly which is a cloud computing provider and highlights how interconnected (and sensitive) the world wide web really is.

    The error occurred with something called the Content Delivery Network (CDN) which is a geographically distributed network of proxy services and data centers. They came about when performance bottlenecks in the 90’s were causing slowdowns, especially as use exploded.

    By distributing the load it allowed for the faster connectivity and increased bandwidth we enjoy today, along with better reliability. CDN nodes are deployed at multiple locations, and while the entire internet won’t go down if one is affected, as yesterday proves it can still cause significant issues.

    So, what caused yesterday’s issue in the first place?

    Believe it or not the thing that brought down all those major players was actually a customer error. A dormant bug in Fastly’s code reared it’s head on Tuesday when a customer changed updated their settings.

    This setting change (which was a valid configuration) triggered a specific circumstance which activated the bug and caused Fastly servers to begin reporting errors throughout 85% of their network.

    Fastly claims they detected the error within one minute which allowed them to contain the incident within an hour. They say they should have anticipated this error could occur in their messaging on the incident. Fastly maintains one of the largest CDN’s on the internet.

    While it was a relatively short outage, the cost to the websites that were down is still staggering, Early estimates indicated Amazon alone could have lost $32 million in sales.

    This outage indicates how truly disruptive technology related downtime is. Even for small business’s the costs can be extreme. Look at our chart below to see just how much downtime costs can add up.

    A Chart With Downtime Costs

    We know these numbers seem extreme, but if you tally up potential sales lost and the cost of just running your business during an outage – it really can add up fast.

    If you’d like to learn more about what downtime really costs you, as well as how to prevent it, we have a free report on this topic you can find here.

    We help the business’s we support prevent unnecessarily downtime every day. If you’re finding yourself navigating this and other technical problems – we can help. Visit our plan page to see if Valley Techlogic could be a good fit for your business.

    Looking for more to read? We suggest these tech articles from the last week.

    This article was powered by Valley TechLogic, an IT provider in Atwater, CA. You can find more information at https://www.valleytechlogic.com/ or on Facebook at https://www.facebook.com/valleytechlogic/ . Follow us on Twitter at https://x.com/valleytechlogic.

  • What to Do When a Service You Use is Down; 5 Tips on How to Survive a Tech Outage

    What to Do When a Service You Use is Down; 5 Tips on How to Survive a Tech Outage

    If you were using any Microsoft products on Monday (March 15th) you may have been party to the outage that took down services such as Office 365 and Teams worldwide.

    The outage was caused by an Azure authentication error (you can learn more here) and lasted roughly 14 hours. Whether you experienced this particular outage or not we have all experienced an outage that took out a tech service that is critical to doing our job or supporting the systems we use every day.

    Here are our top 5 tips to surviving a tech outage that is impacting your business:

    1. First of all, don’t panic. Outages are normal in the tech world, and sometimes even necessary if it’s a planned downtime event. Usually planned events will occur at times that are less inconvenient for most workplaces (late at night typically), and you will probably get some kind of notice, so you know to expect it.

    2. Determine that the outage is outside of your control. If a service is down, it’s a good idea to determine whether it’s on your end or truly due to the service provider. If it’s a popular well-known service (such as in the Microsoft case) you can usually check Google as an outage will be news. Another good place to check is their social media pages to see if there’s any mention of the outage by their team; Twitter especially seems to be the place many businesses convey outage news.

    3. If you’ve come to the conclusion it’s not on your end, reach out to their customer service. They may be swamped if it’s a large outage but if it’s just something to do with your particular instance they can probably assist you in getting back up. If you have a technology service provider you work with they can help manage this task for you.

    4. Reach out to your tech team if you have one. If you have an in-house tech team or a technology service provider behind your business, they can troubleshoot the outage for you and determine next best steps to getting your services back up.

    5. Check the post-outage documentation. It often helps to know why an outage occurred, especially if it was due to an update that may have changed things within the service.

    Outages are a good case in point for having a tech team behind your business, they can help navigate the issue for you and if your case does need to be escalated, they will know exactly who to contact.

    If you’re on your own trying and to Google fixes it can often lead you down a rabbit hole where the recommendations may not even be relevant to your particular instance.

    In general, we don’t recommend trying to navigate severe issues on your own, especially if the affected program host critical data or systems for your business. The “fix” you try may be worse than the problem that was causing the outage in the first place.

     

    If you have been looking for a team that can support your business in navigating tech outages and more, Valley Techlogic is a seasoned technical service provider and we have plans that can fit every business. You can learn more by booking a free consultation here.

    Looking for more to read? We suggest these tech articles from the last week.

    This article was powered by Valley TechLogic, an IT provider in Atwater, CA. You can find more information at https://www.valleytechlogic.com/ or on Facebook at https://www.facebook.com/valleytechlogic/ . Follow us on Twitter at https://x.com/valleytechlogic.