Showing posts with label Outage. Show all posts
Showing posts with label Outage. Show all posts

AMS-IX - Internet Exchange issue


Dear customers,

There is currently a connectivity issue towards AMS-IX. One of our internet exchange partners. This results in very slow traffic as it is being rerouted through our other partners.

This will affect all internet providers using AMS-IX.

Description: 
Start: 2015-05-13 12:40 PM*
End: 2015-05-13 13:10 PM*
Duration: Unknown
Impacted services: All internet services.

RFO:
A loop was created in the AMS-IX netwerk during a planned maintenance. This caused BGP sessions on all peering customers to drop. The loop was resolved and BGP sessions were restored.

We apologize for the inconvenience

The edpnet team

*All times are listed in CET, Central European Time

Explore lines outage


Dear customers,

We are currently experiencing issues with Explore lines. The issue is currently under investigation by our NOC team. Further updates will be released as soon as possible.

Description: 
Start: 11:15 AM 28/04/2015
End:
Duration:
Impacted services: All fiber lines.

Updates
14:21 - Proximus has sent an Engineer to replace a card, no further updates yet.
15:45 - A problem on one end of the fiber has been fixed, an secondary issue on the other end of the fiber has also been detected, a Proximus tech has been dispatched to locate and fix this problem. An ETR of 4 hours has been given.
16:59 - All lines have been brought back online, Proximus does not expect anymore downtime during the remainder of the repairs.

We apologize for the inconvenience

The edpnet team

*All times are listed in CET, Central European Time

Proximus Telephony Issues


Dear customers,

Proximus has a major issue with processing calls. Customers may have problems with outgoing calls.
We have a backup route for most destinations but some may still fail.

Proximus is working on a solution at this moment, this should be fixed soon.

Description: Intermittent issues with outgoing calls
Start: 2015-04-27 10:10 AM*
End: 2015-04-27 22:00 PM*

Impacted services: edpnet telephony (outgoing)

Update: Proximus has resolved the degradation and is monitoring the stability.

We apologize for the inconvenience

The edpnet team

*All times are listed in CET, Central European Time

Connectivity issues - General


Dear customers,

We currently have connectivity issues, our NOC team is investigating the problems and we hope to get this resolved as soon as possible.

More information will be available as we receive it.

Updates:
09:51 - There was a sudden congestion of the entire network causing enormous packetloss, we're investigating the source. 
10:02 - Everything has returned back to normal. We will communicate the reason soon. 
13:28 - The reason for outage was a short but heavy DDoS attack.
13:44 - Our services are being hit again. The NOC team is mitigating the attack.
14:07 - The attack has been mitigated. Some measures were taken to reduce the impact.

28/04 - Everything is running stable since the last impact.

It is possible that some customers have packetloss, causing issues on voip (bad quality) and VPN connections. Our Engineers are still locating the source of these attacks. 

We apologize for the inconvenience

The edpnet team

*All times are listed in CET, Central European Time

Fibercut between Liège and Charleroi


Dear customers,

Our fiber connection between Liège and Charleroi has been cut. All traffic has been rerouted.
We are currently investigating the latency issues.

Description: Fibercut between Liège and Charleroi
Start: 2014-04-21 10:00 AM*
End: ETR unknown.
Duration: N/A
Impacted services: Latency on internet services in the affected zones.
Impacted zones: 019, 04, 061, 063, 080, 081, 082, 083, 084, 085, 087

Updates
13:07:
The latency has been resolved. Fibercut has not been resolved yet.

We apologize for the inconvenience

The edpnet team

*All times are listed in CET, Central European Time

There is currently an issue with our telephone systems


Dear customers,

Edpnet is currently experiencing problems with a number of inbound calls. We are working on resolving the issue. We will keep you posted.

UPDATE: The issues are now fixed.

We apologize for the inconvenience

The edpnet team

24 November - EFM + Fiber outage information


Dear customers,

We had an outage on all the EFM and Fiber connections this morning. The cause was a defective connector card on the Proximus Backbone. The card was replaced at 7.25AM.

Description: 
Start: 2014-11-24 02:15 AM*
End: 2014-11-24 07:25 AM*
Duration: 05h 10m
Impacted services:  All services for our Fiber and EFM customers.

These customers have been informed by email.

Update: There was also an unannounced maintenance in Brussels last night. We had 2 interruptions between 2AM and 6AM

Start: 2014-11-24 02:00 AM*
End: 2014-11-24 06:00 AM*
Duration:
Impacted services:  All customers in the Brussels area.

We apologize for the inconvenience

The edpnet team

*All times are listed in CET, Central European Time

10 November - Vandalism in Proximus buildings


Dear customers,

Due to suspected vandalism on the Proximus network, 2 LEX's have been disconnected. Multiple copper and fiber cables were cut, causing a large impact on ADSL and VDSL customers.

Update: According to Proximus, the last connections should be up by tomorrow evening.
The affected customers are in zones 071, Gosselies and Montigny-le-Tilleul.

More info: standaard.be (Dutch Article)

Description: Cables cut in LEX's Wallonia
Start: 2014-11-08
Expected End: 2014-11-11 PM
Duration: /
Impacted services: All edpnet services for the affected customers

We apologize for the inconvenience

The edpnet team

*All times are listed in CET, Central European Time

21 October - Short interruption zone Ghent & West-Flanders

Dear customers,


Due to recent power issues in Belgacom locations preventive maintenance works are being held. Due to a human error this preventive maintenance caused a short interruption in the power causing a interruption in traffic in region Ghent & West-Flanders. The situation is now optimal with dual powerfeeds and new UPS equipment. We apologize for the problems caused.

Description:
Start: 2014-10-21 09:50 AM
End:2014-10-21 09:54 AM
Impacted services: All edpnet services in the mentioned regions.

We apologize for the inconvenience

The edpnet team

14 October - interuption DSL network in region Brussels

Update:  There was a second short outage at 20:40 until 20:50.

Dear customers,

due to a power outage we lost connectivity towards our Brussels DSL network.

Description:
Start: 14/10/2014 19:25

End:  14/10/2014 19:37
Impacted services: DSL lines in Brussels region

We appologize for the inconvenience

The edpnet team

25 September 2014 - Routing issues

Dear customers,

Due to a fiber cut some websites became unreachable, we are working on a solution.

Update: The fiber is restored, the problems should be gone

Description: Routing issues due to fiber cut
Start: 25/09/2014 16:05
End: 25/9/2014 19:11
Impacted services: some websites are unreachable


We appologize for the inconvenience

The edpnet team

11 September 2014 - Unreachable by phone

Dear customers,

UPDATE 11/09/2014 - 20h: Our telephony problem is solved.

We are currently not reachable by phone, we are working on a solution. There is no impact for our customers internet or telephony connections.

Description:
Start: 11/09/2014 08:40
End: 11/09/2014 20:00
Impacted services: There was no impact for our customers' internet and telephony connections.

We apologize for the inconveniences.

The edpnet team

08 September 2014 - Outage Antwerp

Dear customers,

There are issues with the connection between the Belgacom and Edpnet network. Alle customers in the Antwerp area will have issues with their internet connection. We are working ASAP on resolving this issue.

Please try rebooting your modem occasionally whilst our network is switching over onto the backup.

Description:
Start: 2014-09-08 11:20 AM
End: 2014-09-08 11:30 AM
Impacted services: All edpnet services (Internet, telephony, email...)

We appologize for the inconvenience

The edpnet team

30 June 2014 - Outage Liege area

Dear customers,

We currently have an outage in the Liege area. We are trying to resolve this issue as soon as possible.

Update 11:06: Our technician has arrived onsite.
Update 11:43: Power issue in the whole Belgacom colocation. Systems should be back online soon.
Update 11:49: Customers are coming back online.
Update 11:59: All systems are up and stable again.

If you still have no connection to the internet, please restart your modem and router first.

We appologize for the inconvience

16 May 2014 - Solved (Interruption DSL Brussels)

We had an outage in the Brussels Area. As a consequence all Internet & Telephony users in the big region of Brussels were disconnected.

A short circuit caused a power failure in the whole rack.

If you have no Internet after the outage we advise you to restart your modem first.

We apologize for the inconvenience.



29 April 2014 - Interruptions DSL Brussels

Dear customers,

We noticed 2 interruptions for all DSL customers region Brussels.

Down: Tue Apr 29 19:24:03
Up: Tue Apr 29 19:32:03

Down: Tue Apr 29 20:35:47
Up: Tue Apr 29 20:37:48 

We are investigating the cause and apologize for the inconvenience.

13 March 2014 - fiber cut london and rotterdam

A fiber cut in London and a planned maintenace in Rotterdam cause internet connectivity issues. We try to resolve these as soon as possible. Sorry for the inconvenience. 

Update 0:45
The maintenance could take up to 6 hours, and is not under control of edpnet.

Update 1:07
London doesn't seem to be a fiber cut after all, but an emergency maintenance, but it could also take several hours.  

Update 3:23
Traffic restored. 

23 January - Interruption in Antwerp

We had an outage this morning between 02:05AM and 03:45AM in the Antwerp Area. As a consequence all Internet users in the Region Antwerp and Limburg were temporary disconnected.

The cause of the failure is under investigation in dialogue with our supplier.

All services were restored automatically. If you have no Internet after the outage we advise you to restart your modem first.

We apologize for the inconvenience.

8 January 2014 - Mail Exchange Issue

Maintenance to improve stability.

Update 13 - 21/01 17:03
We schedule a maintenance, tomorrow morning at 05:00, to improve the performance and stability of our mail servers. During the maintenance all mail service will be temporary unavailable. No mail will be lost.

Maintenance will start on 22/01 around 05:00 and will take about 30 minutes.

Update 12 - 20/01 10:30
After the works of this weekend it seems that we have found the origin of the slow responsiveness of the mail servers. By replacing the defect disk controller in our main storage server the speed of our mail servers increased drastically. Monday morning we had our first real stress test by you as customer (Monday morning is the most busy time frame in the week for our mail servers) and the response time of our mail service stayed normal. We keep on monitoring our mail system but we presume this issue finally is solved.

Update 11 - 18/01 10:29
Yesterday evening we found another problem with the storage systems, we completely replaced one of the storage systems, this device is now replicating  data, and should be finished today. We also needed to replace a defective disk controller in another storage system, this night this controller started working as it should again. Due to the fact that the load is lower in the weekend and at night, everything should anyway work optimal. We need to wait until Monday to see if the problem rises again.  We are very sorry for the lack of communication yesterday, we were working very hard, but had no updates.

Update 10 - 17/01 10:57
The overnight monitoring didn't give the expected result. Therefore our technical team will perform another maintenance at 11h. We keep you up to date as soon as we have more feedback. For your information: meanwhile webmail is back online. Please clear your browser cache if you still arrive on the issues page when connecting to webmail.

Update 9 - 16/01 16:40
Together with our software supplier we are currently implementing a new possible solution. During the next hours and night we will monitor this new implementation to see if it gives the necessary speed gain. We keep you up to date as soon as we have more feedback.

Update 8 - 16/01 10:52
Meanwhile our technical team contacted our hardware supplier in order to find the possible cause and solution.  We keep you up to date as soon as we have more feedback.

Update 7 - 15/01 20:15
Our technical team had to bring webmail off line in order to continue to search for a solution for our e-mail delays. We keep you up to date as soon as we have more feedback.

20 January 2014

There is an outage on our network for the region of Antwerp & Limburg. All services of edpnet are down. We are currently investigating the origin of the problem. We will give you more feedback soon.

Update 12:25
Due to a power outage in our co-location for region of Antwerp, connections for Antwerp, Limburg and parts of Flemish Brabant en East-Flanders were disrupted. These connections came back online when the power was restored.

Our apologies for the inconvenience.