• Quick note - the problem with Youtube videos not embedding on the forum appears to have been fixed, thanks to ZiprHead. If you do still see problems let me know.

Facebook down

Brian Krebs, who is usually halfway in the know on this kind of thing, is reporting it's a DNS issue, with the records being withdrawn from the global routing tables.
 
I'm in the datacenter industry, I'm sure this outage is costing many companies lots of $$$. From advertisers to merchants, this is a big deal.
 
BowlOfRed said:
Internet rumor mill is mentioning that it's a router issue (nuked the BGP routes), with speculation that the outage took out access to the routers themselves. So the resolution needs to be done by people on site (with the routers), and that those people don't have access to do so yet.

Also that some FB employees can't enter buildings because the network outage is interfering with the authentication for access.
Click to expand...

That's my reading of various twitter feeds as well.
A place I know had all sorts of business continuity plans, fallback data centers etc and had a massive outage because as part of a failover someone didn't failover a particular class of kit so traffic that should have been internal to a data center was routed between 2 and ran over some timeout limits.
The best laid plans o' mice and men gang aft agley
 
I'm sure DNS is out for them, but it doesn't seem to be *caused* by DNS. If it's just public DNS, you can attempt access via IP address, but I haven't heard of anyone able to do that. Also, (in my limited experience) DNS is much more fixable. It should degrade more slowly as some folks have old entries in cache.

The (now-deleted) reddit account updates mentioned DNS was out due to BGP peering badness. I flee from the horror that is fixing bad routing.
 
May not be costing us direct $$, but I think this is affecting my company productivity today because all of the operations folks are discussing and speculating on the issue.

(And reminiscing about our recent outages and how they weren't going to be covered by WSJ or the evening news).
 
I'm seeing some posts that think everything they ever posted there is gone forever. "All my pictures!!!!!1!!11!"
(sigh)
I have posted a suggestion that when it comes back up, they do an Archive, a feature provided right on the site. Of course, it might get slammed in the first several hours...
 
BowlOfRed said:
Internet rumor mill is mentioning that it's a router issue (nuked the BGP routes), with speculation that the outage took out access to the routers themselves.
Click to expand...

Quite a major oversight if this is the case. Even much smaller companies that don't depend as much on 24/7 uptime usually have OOB for cases like this nowadays.
 
crescent said:
This week was scheduled to have 3 days or 10 days of darkness and some interpreted this as just meaning that the internet would go dark.
Click to expand...
:confused:

BowlOfRed said:
Internet rumor mill is mentioning that it's a router issue (nuked the BGP routes), with speculation that the outage took out access to the routers themselves. So the resolution needs to be done by people on site (with the routers), and that those people don't have access to do so yet.
Click to expand...
DNS.
BowlOfRed said:
Also that some FB employees can't enter buildings because the network outage is interfering with the authentication for access.
Click to expand...
Oh Dear. How Unfortunate.Never Mind. :rolleyes:

alfaniner said:
It must be that some business use FB as a crucial element. I wonder effect what a prolonged outage will have. Major implications, to be sure.
Click to expand...
Rethinking their reliance one hopes.
 
You gotta admit Facebook workers being unable to get inside Facebook because they networked the security system through...Facebook is some Douglas Adams level lol.
 
JoeMorgue said:
Brian Krebs, who is usually halfway in the know on this kind of thing, is reporting it's a DNS issue, with the records being withdrawn from the global routing tables.
Click to expand...

That halfway makes sense, because I see that facebook.com is not resolving, but I've never heard of DNS A records being put into routing tables.
 
crescent said:
This week was scheduled to have 3 days or 10 days of darkness and some interpreted this as just meaning that the internet would go dark.
Click to expand...

catsmate said:
:confused:
Click to expand...

Sorry, I was unclear. The Qanon idiots were predicting it. Again. I think this was probably the 10th or 11th time they've made that particular prediction.

Irrelevant hijack for anyone who cares:
Being a semi-religious belief system, they just keep repeating the prediction while trying to re-interpret it down to something different that what they used to claim it means. So it's gone from 10 days of actual darkness over the planet earth down to a three-day internet outage, after which Donald Trump will be president again.
 
alfaniner said:
I wonder what the meme for today is going to be? "Instageddon"? "FaceBust"?
Click to expand...


zGzxdNp.jpg


(He actually recently threatened to "crush" facebook if they continue to refuse to delete/block stuff illegal in Russia)

;):popcorn1
 
I saw it back up. No sense in me posting anything until I'm sure the traffic is back to normal. I was actually kind of hoping it would be down for a while, a few days maybe, just to see what would happen. I don't think there would actually be any life-threatening consequences but you never know.
 
You must log in or register to reply here.

Back
Top Bottom