William Kern via Outages | 21 Jul 20:51 2016

Re: [outages] cloudflare down?

didn't hit reply all.

Our sites are backup up.  Evidently only people who had been directed to phoenix were affected. The sites in question were receiving traffic during the outage but we couldn't reach them even on mobiles.


On 7/21/2016 11:48 AM, William Kern wrote:

so I assume this was related to their Pheonix issue and they have been able to move traffic away from that and onto working nodes.

-bill


On 7/21/2016 11:45 AM, Mike wrote:
CloudFlare publicizes details on their status site:

-M

On Thu, Jul 21, 2016 at 2:43 PM William Kern via Outages <outages-w8q5NolJmqtAfugRpC6u6w@public.gmane.org> wrote:

has, CF outages includes our own www.pixelgate.net net (Which is cnamed to CF)

just pixelgate.net of course still works.

I guess I'll revert the cname until things clear up.

-bill


On 7/21/2016 11:40 AM, William Kern via Outages wrote:

we are in SoCal


On 7/21/2016 11:38 AM, William Kern via Outages wrote:

we show some of our customers who use CF having websites that are presently failing to respond.


-bill


On 7/21/2016 11:34 AM, jd via Outages wrote:

Anyone see cloudflare being down? I’m aware of their phoenix systems being routed however I am unable to get to anything else. It worked for a second and disappeared from Los Angeles (charter)



_______________________________________________ Outages mailing list Outages-w8q5NolJmqtAfugRpC6u6w@public.gmane.org https://puck.nether.net/mailman/listinfo/outages



_______________________________________________ Outages mailing list Outages-w8q5NolJmqtAfugRpC6u6w@public.gmane.org https://puck.nether.net/mailman/listinfo/outages



_______________________________________________ Outages mailing list Outages-w8q5NolJmqtAfugRpC6u6w@public.gmane.org https://puck.nether.net/mailman/listinfo/outages

_______________________________________________
Outages mailing list
Outages-w8q5NolJmqtAfugRpC6u6w@public.gmane.org
https://puck.nether.net/mailman/listinfo/outages


<div>
    <p>didn't hit reply all.</p>
    <p>Our sites are backup up.&nbsp; Evidently only people who had been
      directed to phoenix were affected. The sites in question were
      receiving traffic during the outage but we couldn't reach them
      even on mobiles.<br></p>
    <br><div class="moz-cite-prefix">On 7/21/2016 11:48 AM, William Kern
      wrote:<br>
</div>
    <blockquote cite="mid:15d03e3f-ec36-299a-90bd-08bdb99b393c@..." type="cite">
      <p>so I assume this was related to their Pheonix issue and they
        have been able to move traffic away from that and onto working
        nodes.</p>
      <p>-bill<br></p>
      <br><div class="moz-cite-prefix">On 7/21/2016 11:45 AM, Mike wrote:<br>
</div>
      <blockquote cite="mid:CAMerE0q+JxEam00Zq8P9K6Tbyk9tdo3GyieRgCmOM7tMyQRwHQ@...l.com" type="cite">
        <div dir="ltr">CloudFlare publicizes details on their status
          site:
          <div>
<a moz-do-not-send="true" href="https://www.cloudflarestatus.com/">https://www.cloudflarestatus.com/</a><br>
</div>
          <div><br></div>
          <div>-M</div>
        </div>
        <br><div class="gmail_quote">
          <div dir="ltr">On Thu, Jul 21, 2016 at 2:43 PM William Kern
            via Outages &lt;<a moz-do-not-send="true" href="mailto:outages@...">outages@...</a>&gt;
            wrote:<br>
</div>
          <blockquote class="gmail_quote">
            <div bgcolor="#FFFFFF" text="#000000">
              <p>has, CF outages includes our own <a moz-do-not-send="true" href="http://www.pixelgate.net" target="_blank">www.pixelgate.net</a> net (Which is
                cnamed to CF)</p>
              <p>just <a moz-do-not-send="true" href="http://pixelgate.net" target="_blank">pixelgate.net</a>
                of course still works. <br></p>
              <p>I guess I'll revert the cname until things clear up.<br></p>
              <p>-bill<br></p>
            </div>
            <div bgcolor="#FFFFFF" text="#000000"> <br><div>On 7/21/2016 11:40 AM, William Kern via Outages
                wrote:<br>
</div>
              <blockquote type="cite">
                <p>we are in SoCal<br></p>
                <br><div>On 7/21/2016 11:38 AM, William Kern via Outages
                  wrote:<br>
</div>
                <blockquote type="cite">
                  <p>we show some of our customers who use CF having
                    websites that are presently failing to respond.</p>
                  <p><br></p>
                  <p>-bill<br></p>
                  <br><div>On 7/21/2016 11:34 AM, jd via Outages wrote:<br>
</div>
                  <blockquote type="cite">
                    <div>
                      <p class="MsoNormal">Anyone see cloudflare being
                        down? I&rsquo;m aware of their phoenix systems being
                        routed however I am unable to get to anything
                        else. It worked for a second and disappeared
                        from Los Angeles (charter)</p>
                    </div>
                    <br><br>_______________________________________________
Outages mailing list
<a moz-do-not-send="true" href="mailto:Outages@..." target="_blank">Outages@...</a>
<a moz-do-not-send="true" href="https://puck.nether.net/mailman/listinfo/outages" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a>

                  </blockquote>
                  <br><br><br>_______________________________________________
Outages mailing list
<a moz-do-not-send="true" href="mailto:Outages@..." target="_blank">Outages@...</a>
<a moz-do-not-send="true" href="https://puck.nether.net/mailman/listinfo/outages" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a>

                </blockquote>
                <br><br><br>_______________________________________________
Outages mailing list
<a moz-do-not-send="true" href="mailto:Outages@..." target="_blank">Outages@...</a>
<a moz-do-not-send="true" href="https://puck.nether.net/mailman/listinfo/outages" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a>

              </blockquote>
              <br>
</div>
            _______________________________________________<br>
            Outages mailing list<br><a moz-do-not-send="true" href="mailto:Outages@...g" target="_blank">Outages@...</a><br><a moz-do-not-send="true" href="https://puck.nether.net/mailman/listinfo/outages" rel="noreferrer" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><br>
</blockquote>
        </div>
      </blockquote>
      <br>
</blockquote>
    <br>
</div>
jd via Outages | 21 Jul 20:34 2016

[outages] cloudflare down?

Anyone see cloudflare being down? I’m aware of their phoenix systems being routed however I am unable to get to anything else. It worked for a second and disappeared from Los Angeles (charter)

<div><div class="WordSection1"><p class="MsoNormal">Anyone see cloudflare being down? I&rsquo;m aware of their phoenix systems being routed however I am unable to get to anything else. It worked for a second and disappeared from Los Angeles (charter)<p></p></p></div></div>
Mauricio Lizano via Outages | 21 Jul 18:52 2016

[outages] Routing to/from Level 3

Did anyone else experience issues routing to/from Level 3 from about 11:20 to around 11:40 Central time today? The issue kinda just went away before I could exacly identify it. Trying to figure out if it was just me.

Thanks,

--
Mauricio Lizano

<div><div dir="ltr">Did anyone else experience issues routing to/from Level 3 from about 11:20 to around 11:40 Central time today? The issue kinda just went away before I could exacly identify it. Trying to figure out if it was just me.<div><br></div>
<div>Thanks,<br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature">
<div>Mauricio Lizano</div>
<div><br></div>
</div>
</div>
</div></div>
Phil Lavin via Outages | 21 Jul 09:48 2016

[outages] Telehouse North - Major Problems

We’ve just had 3 links drop simultaneously to (different) equipment in Telehouse North.

 

Fibre link to Vodafone – port is down

BGP peering to GTT is dropped

Copper link to BT – port is down

 

Anyone else seeing anything? We spoke to BT and they have confirmed a “major national problem”.

 

 

Phil Lavin

Telecoms Systems Manager

CloudCall
www.cloudcall.com

 

<div>
<div class="WordSection1">
<p class="MsoNormal">We&rsquo;ve just had 3 links drop simultaneously to (different) equipment in Telehouse North.<p></p></p>
<p class="MsoNormal"><p>&nbsp;</p></p>
<p class="MsoNormal">Fibre link to Vodafone &ndash; port is down<p></p></p>
<p class="MsoNormal">BGP peering to GTT is dropped<p></p></p>
<p class="MsoNormal">Copper link to BT &ndash; port is down<p></p></p>
<p class="MsoNormal"><p>&nbsp;</p></p>
<p class="MsoNormal">Anyone else seeing anything? We spoke to BT and they have confirmed a &ldquo;major national problem&rdquo;.<p></p></p>
<p class="MsoNormal"><p>&nbsp;</p></p>
<p class="MsoNormal"><p>&nbsp;</p></p>
<p class="MsoNormal"><span>Phil Lavin<p></p></span></p>
<p class="MsoNormal"><span>Telecoms Systems Manager<p></p></span></p>
<p class="MsoNormal"><span>CloudCall</span><span><br><a href="http://www.cloudcall.com/"><span>www.cloudcall.com</span></a><p></p></span></p>
<p class="MsoNormal"><p>&nbsp;</p></p>
</div>
</div>
Neil Robst via Outages | 21 Jul 00:40 2016

[outages] AT&T outage in Texas?

Hi,
        I manage an service using an AT&T OpteWAN circuit that connects a POP in
Allen, Texas with a second in Irvine, California. I¹ve experienced 3
outages on that circuit today the first this morning from 12:25 UTC
lasting approx 4 hours, and then 2 further outages at 21:30 UTC lasting 4
minutes and again at 21:53 etc lasting 8 minutes - though did also seem to
impact my AT&T provided internet-breakout at the same location in Texas as
well :-(

         AT&T support people are alluding to there being a wider issue in the
Texas area but I¹m struggling to get any real information.

        Anyone else impacted or having any further insight into this?

Regards,
Neil

This message is private and confidential. If you have received this message in error, please notify the
sender or servicedesk@... and remove it from your system.

Piksel Inc is a company registered in the United States New York City, 1250 Broadway, Suite 1902, New York,
NY 10001. F No. = 2931986
Frank Bulk | 20 Jul 21:07 2016
Picon

Anyone else seeing issues with GoToMeeting?

Anyone else seeing issues with GoToMeeting?

 

 

<div><div class="WordSection1">
<p class="MsoNormal">Anyone else seeing issues with GoToMeeting?<p></p></p>
<p class="MsoNormal"><p>&nbsp;</p></p>
<p class="MsoNormal"><p></p></p>
<p class="MsoNormal"><p>&nbsp;</p></p>
</div></div>
Cal Leeming via Outages | 20 Jul 10:25 2016

[outages] BT Internet UK wide outage?

Hello,

Are there any known problems with BT Internet at the moment? Hundreds of complaints on Twitter and lots of issues with connectivity this morning.

Cal

<div>
<div>Hello,</div>
<div><br></div>
<div>Are there any known problems with BT Internet at the moment? Hundreds of complaints on Twitter and lots of issues with connectivity this morning.</div>
<div><br></div>
<div>Cal</div>
<br><div class="bloop_sign"></div>
</div>
Robert Peebles via Outages | 20 Jul 02:59 2016

[outages] Level(3) MPLS issue affecting Five9

Hello,

 

At 5pm PST I noted that my edge router facing Level(3)’s MPLS network stopped learning routes for the Five9 data center in Santa Clara. Five9 has acknowledged the Level(3) issue and sounded like it was affecting any customer that uses the Santa Clara data center over Level(3) MPLS. I was able to change routing and reach Five9 services over the internet.

 

Thanks,

Rob

 

Robert Peebles | Sr. Network Administrator

 

9820 Towne Centre Drive, San Diego, CA 92121

P: (844) 225-1381 | F: (888) 296-9260

rob <at> nationalfunding.com | www.nationalfunding.com

   

<div>
<div class="WordSection1">
<p class="MsoNormal">Hello,<p></p></p>
<p class="MsoNormal"><p>&nbsp;</p></p>
<p class="MsoNormal">At 5pm PST I noted that my edge router facing Level(3)&rsquo;s MPLS network stopped learning routes for the Five9 data center in Santa Clara. Five9 has acknowledged the Level(3) issue and sounded like it was affecting any customer that uses the
 Santa Clara data center over Level(3) MPLS. I was able to change routing and reach Five9 services over the internet.<p></p></p>
<p class="MsoNormal"><p>&nbsp;</p></p>
<p class="MsoNormal">Thanks,<p></p></p>
<p class="MsoNormal">Rob<p></p></p>
</div>
<p class="MsoNormal">
&nbsp;</p>
<p class="MsoNormal">
Robert Peebles&nbsp;|&nbsp;Sr. Network Administrator</p>
<p class="MsoNormal">
&nbsp;</p>
<p class="MsoNormal">
</p>
<p class="MsoNormal">
<span>9820 Towne Centre Drive, San Diego, CA 92121</span></p>
<p class="MsoNormal">
<span></span><span>P: (844) 225-1381 | F: (888) 296-9260</span></p>
<p class="MsoNormal">
<span></span><span><a href="mailto:rob@...m"><span>rob <at> nationalfunding.com</span></a></span><span>
 | <a href="https://www.nationalfunding.com/?utm_source=email%20signature&amp;utm_medium=email&amp;utm_content=RobertPeebles&amp;utm_campaign=IT%20email"><span>www.nationalfunding.com</span></a></span></p>
<p class="MsoNormal">
<span>&nbsp;<a title="Follow  <at> NationalFunding" href="https://twitter.com/nationalfunding"></a>&nbsp;<a title="Follow Us" href="https://plus.google.com/b/106539793886495590334/"></a>&nbsp;</span></p>
<span>
<p class="MsoNormal">
<span><p></p></span></p>
</span>
</div>
Grant Ridder via Outages | 19 Jul 20:24 2016

[outages] aws us-east-1 api errors

Seeing errors (503's) on the console web ui for us-east-1.  Other regions look fine.  Nothing on their status page yet (http://status.aws.amazon.com/)

-Grant
<div><div dir="ltr">Seeing errors (503's) on the console web ui for us-east-1.&nbsp; Other regions look fine.&nbsp; Nothing on their status page yet (<a href="http://status.aws.amazon.com/">http://status.aws.amazon.com/</a>)<div><br></div>
<div>-Grant</div>
</div></div>
jorgen mourton via Outages | 13 Jul 19:20 2016

[outages] Windstream outages

Windstream is having massive issues all through the South East, anyone know what's going on?
<div><div dir="ltr">Windstream is having massive issues all through the South East, anyone know what's going on?</div></div>
chris via Outages | 12 Jul 21:15 2016

[outages] Comcast Voice outage

multiple reports from multiple customers of ours who have comcast voice service. all inbound calls to affected customers dont reach our gear

tried to call 800 391 3000 and cant even get through to there, audible error message is played

anyone else seeing this?

chris
<div><div dir="ltr">multiple reports from multiple customers of ours who have comcast voice service. all inbound calls to affected customers dont reach our gear<div><br></div>
<div>tried to call 800 391 3000 and cant even get through to there, audible error message is played</div>
<div><br></div>
<div>anyone else seeing this?</div>
<div><br></div>
<div>chris</div>
</div></div>

Gmane