Multiple issues yesterday. One of the GigE links that sends data through globla crossing was having data issues. After multiple partial outages (couple hundred megabit at a time), they finally tracked a bad card in one of their edge routers in palo alto.
Add to that lat last night we had a maintenance to add a card to one of our routers (which is a hot swap card that should have caused no downtime) and it crashed the router and forced a full reboot. That caused some network issues of it's own.
Needless to say, these have all been taken care of, but made for a ugly day.
Steve Alligood
Principal Systems Administrator
Bluehost.com