?

Log in

 
 
03 August 2009 @ 12:55 pm
Slow service for UK users  
Hi guys, just wondering if anyone else here has been experiencing extremely slow service on the site the past few days? Myself and a bunch of UK users on my flist have all noticed the site loading very slowly, embedded content and icons not loading at all, the site appearing in a sort of 'safe mode' style, etc.

I couldn't see anything in Known Issues so I entered a support request, and I think the peeps on my flist are going to do the same. Does anyone know anything more about this? Might be worth putting in a support request if you've been experiencing it too, or is there a better way to give a heads-up on this?

EDIT: Follow marta's instructions (in the comments) to provide a traceroute as part of your support request, to help LJ pinpoint the problem!
 
 
 
the adventures of Christinecdaae on August 3rd, 2009 12:09 pm (UTC)
I've found LJ appallingly slow for the last 4 or 5 days too.
r1cepudding on August 3rd, 2009 12:15 pm (UTC)
It's a mare, isn't it? Ugh.
The Stainless Steel Rat: LJ Animatedstainsteelrat on August 3rd, 2009 12:12 pm (UTC)
Apparently they were having some issues at the end of last week, and I found it very low. Definitely better over the weekend for me.

If you friend status apparently the service updates will appear in your friends list as they happen.
r1cepudding on August 3rd, 2009 12:15 pm (UTC)
Thanks! It is a little better this morning but still fairly excruciating.
(no subject) - stainsteelrat on August 3rd, 2009 12:31 pm (UTC) (Expand)
Maxhawkida on August 3rd, 2009 12:22 pm (UTC)
Been seeing this at home (via a Virginmedia connection) but it's okay from work. FWIW the "safe mode" you describe sounds like the stylesheets just aren't loading in for you.
h a n n a hthisglasnost on August 3rd, 2009 12:44 pm (UTC)
Yes, definitely having speed issues and have had for the past few days. People on my flist have also been having problems.
Steveakicif on August 3rd, 2009 01:00 pm (UTC)
Dunno if it's an LJ issue per se: we've been having DNS issues due to (allegedly) a damaged cable between London and Leeds - almost everything has been intermittent to some degree or other.
r1cepudding on August 3rd, 2009 01:04 pm (UTC)
Hmm, but I've had no problems with anything other than LJ. It's a mystery!
slw2004slw2004 on August 3rd, 2009 01:02 pm (UTC)
Yep. It's been really bad the last few days. I sent in a support request over the weekend but haven't heard anything more about it.
eleanoreleanorb on August 3rd, 2009 01:03 pm (UTC)
No, it's not been a problem for me. Perhaps you all share the same provider and they are having a problem.
r1cepudding on August 3rd, 2009 01:04 pm (UTC)
I know people with at least three different providers have had the same problem, so I doubt it. Hmm.
(no subject) - eleanorb on August 3rd, 2009 01:07 pm (UTC) (Expand)
Ayoub™ayoub on August 3rd, 2009 01:10 pm (UTC)
It was slow at the weekend while I was visiting my folks, but fine at home...

The only difference was ISP's...
[m]loveless on August 3rd, 2009 01:28 pm (UTC)
yeah. ridiculously slow, and i have a permanent account which is supposed to be on the fastest lj servers. load of rubbish.
buckle up, buttercupwithluckysevens on August 3rd, 2009 01:35 pm (UTC)
Been awful for me despite having 50 meg internet, so I know it's not me. Almost a week now.
You need to get drunk more often: deniedkidsxheroes on August 3rd, 2009 01:47 pm (UTC)
I mentioned in your journal its been a pissy little bitch with me since about friday. I thought it was better today but its really not :/

I can only see it being something with LJ as it is the only site giving me any problems at the moment. Everything else is fine and as quick as ever and loading correctly.

I too keep getting the pages loading (after about 5 minuets when they finally decide to show!) in that weird "safe mode" style that looks like its stuck in the early 90's.

At least if i need to post a journal i can cross post from DW but its frustrating i can't see others journals and comms and such not unless i've got the patience of a saint...which i don't.

That said, ontd is one of the fastest comms to load and i thought that would take about two weeks to do anything :/

God knows whats going on, i just hope they sort it out soon /o\

I've submitted a support request and will ask my other uk friends to do the same if they are getting this level of fail.
Carefully, Correctly Wrongdiffrentcolours on August 3rd, 2009 03:25 pm (UTC)
I haven't noticed any problems on Be and Bytemark up north.
Denny: Dreamwidthdennyd on August 3rd, 2009 04:30 pm (UTC)
It's quite amusing watching Dreamwidth load faster than LiveJournal. Obviously they don't have quite the same scale of viewers to cope with :) but even so, made me smile.
martamarta on August 3rd, 2009 04:37 pm (UTC)
For those experiencing slowness, it would be helpful for us to troubleshoot if you could provide a traceroute - the last several hops will show us what networks it's going through, which could affect speed.

You can do "tracert livejournal.com" and then provide the information after the first few lines, like this:

7 8 ms 7 ms 7 ms cr1.cgcil.ip.att.net [12.122.133.222]
8 7 ms 6 ms 6 ms ggr6.cgcil.ip.att.net [12.122.133.193]
9 31 ms 31 ms 31 ms att-gw.chicago.uu.net [192.205.35.182]
10 32 ms 30 ms 30 ms 0.so-6-1-0.XL4.CHI13.ALTER.NET [152.63.73.30]
11 45 ms 46 ms 46 ms 0.so-5-1-0.XL4.DEN4.ALTER.NET [152.63.89.110]
12 46 ms 47 ms 46 ms POS7-0.GW8.DEN4.ALTER.NET [152.63.88.177]
13 59 ms 59 ms 59 ms livejournalinc-gw.customer.alter.net [157.130.166.110]
14 59 ms 59 ms 59 ms livejournal.com [208.93.0.128]

Seven_Veilsseven_veils on August 3rd, 2009 05:12 pm (UTC)
Tracing route to livejournal.com over a maximum of 30 hops:

7 154 ms 155 ms 155 ms ash-bb1-link.telia.net [213.248.65.98]
8 154 ms 155 ms 155 ms qwest-119092-ash-bb1.telia.net [213.248.88.178]

9 * * * Request timed out.
10 241 ms 240 ms 240 ms bil-core-02.inet.qwest.net [205.171.8.154]
11 241 ms 240 ms 240 ms bil-edge-02.inet.qwest.net [205.171.154.22]
12 337 ms 240 ms 239 ms 65.121.112.210
13 241 ms 239 ms 241 ms livejournal.com [208.93.0.128]

Trace complete.

C:\Users\seven_veils>
(no subject) - marta on August 3rd, 2009 05:52 pm (UTC) (Expand)
Tracert from Gloucestershire (Virgin Media) - pbristow on August 3rd, 2009 06:58 pm (UTC) (Expand)
(no subject) - stainsteelrat on August 3rd, 2009 05:22 pm (UTC) (Expand)
(no subject) - r1cepudding on August 3rd, 2009 05:27 pm (UTC) (Expand)
(no subject) - marta on August 3rd, 2009 05:53 pm (UTC) (Expand)
Here's mine - - trialia on August 3rd, 2009 06:40 pm (UTC) (Expand)
this is mine - inpurity on August 3rd, 2009 09:12 pm (UTC) (Expand)
Seven_Veilsseven_veils on August 3rd, 2009 04:57 pm (UTC)
It's been dreadfully slow for several days now. I'm on Sky Broadband which is normally a very good connection with excellent speed. Livejournal has been horribly slow to load and going to the comments page of any post has been painfully slow. I hope they fix it soon.
Seven_Veilsseven_veils on August 3rd, 2009 05:04 pm (UTC)
Oh and this is in the Sheffield (South Yorkshire) area.
Heather: Aw/Tch :: Subaru + Kamui + Soelpiikyo on August 3rd, 2009 05:18 pm (UTC)
I've certainly had that, all of that, from around the weekend and still continuing today. I had thought that it was a bad connection on my part, having just returned from Wales where an unstable connection caused the same problems.

However, all other sites seem to work just fine. It's really irritating, especially since a lot of the people I talk to are in America with things going just fine.
gr00vygirl on August 3rd, 2009 05:37 pm (UTC)
its been really awfully slow for me for days now, no other site is like this.
Trialiatrialia on August 3rd, 2009 06:34 pm (UTC)
Yep, it's been driving me nuts for the last few days.
martamarta on August 3rd, 2009 06:47 pm (UTC)
UPDATE 7:44 p.m. GMT
Edit: Actually, we have more information. dwell, our manager of operations, is going to make a post here with all of the info. So you can ignore me for now :)

Edited at 2009-08-03 07:25 pm (UTC)
r1cepudding on August 3rd, 2009 07:26 pm (UTC)
Re: UPDATE 7:44 p.m. GMT
Thanks so much for keeping us updated!
btdwell on August 3rd, 2009 07:38 pm (UTC)
LJ ops dude here
Hello All,

Based on your collective traceroute reports and description of the behaviour, i.e., "safe mode" look, slow load times, it appears this is either a DNS problem or a problem with our CDN provider. Don't know what a CDN provider is? Click here for the Wiki entry.

Styles sheets are not loading for a large percentage of you, hence the weird formatting straight out of the early 1990's reminding people like me of our ill-gotten and misspent youth.

Slow load times sound like they are due to your browsers waiting for the various javascripts, style sheets and icons to load from "l-stat.livejournal.com" and "l-userpic.livejournal.com", where all of those goodies are located. These servers are actually part of our distributed CDN, which is designed to speed up delivery to our worldwide base of users and lessen the load on our actual origin servers -- hence speeding up the delivery in a secondary way! This obviously hasn't been working for the majority of you.

WHAT NOW?

So now that we have some strong leads, what are we going to do to make it better for you?
1) Will be opening a ticket with our CDN provider to see if they are aware of any issues.
2) We've already confirmed that our network and DNS servers are working properly. Unfortunately the problem reports seem to be limited to our UK LJers at this time so I'm fairly confident this is a scope-limited issue... for now.


NOTE ON WEIRD TRACEROUTE OUTPUT

We've been able to investigate this a little more and have found some salient points for those users using Qwest to reach us. If you see any traceroute output with hops with names similar to "bil-edge-02.inet.qwest.net", having one particular hop "star" out, or timeout, is ok. The reason is that that particular Qwest router does not respond to traceroute requests which only affects troubleshooting efforts like we're doing, not the healthy passing of traffic. In other words, EVERY router could disable tracerouting but the network could still be working 100%; these 2 things do not make up a causal relationship.

In other words, getting output like this is ok:
8 154 ms 155 ms 155 ms qwest-119092-ash-bb1.telia.net [213.248.88.178]
9 * * * Request timed out.
10 241 ms 240 ms 240 ms bil-core-02.inet.qwest.net [205.171.8.154]

That just means that hop number #9 has been programmed not to answer to traceroute probes for security or administrative reasons.

If you have any further questions, please feel free to leave me a comment here. Thank you for your patience.

bt
r1cepudding on August 3rd, 2009 07:48 pm (UTC)
Re: LJ ops dude here
Thanks so much for keeping us updated. Hope it can be resolved soon :)
Response from LJ network provider - dwell on August 3rd, 2009 09:28 pm (UTC) (Expand)
Re: Response from LJ network provider - eleanorb on August 4th, 2009 05:06 am (UTC) (Expand)
Re: Response from LJ network provider - black_wolf on August 4th, 2009 05:53 pm (UTC) (Expand)
Re: Response from LJ network provider - black_wolf on August 4th, 2009 06:07 pm (UTC) (Expand)
Re: Response from LJ network provider - r1cepudding on August 4th, 2009 06:43 pm (UTC) (Expand)
Re: Response from LJ network provider - blue_aeon on August 4th, 2009 09:08 pm (UTC) (Expand)
Re: Response from LJ network provider - shishmish on August 4th, 2009 10:29 pm (UTC) (Expand)
Re: Response from LJ network provider - eternalwings on August 4th, 2009 10:36 pm (UTC) (Expand)
Re: LJ ops dude here - shishmish on August 4th, 2009 10:28 pm (UTC) (Expand)
Re: LJ ops dude here - eternalwings on August 4th, 2009 10:37 pm (UTC) (Expand)
Re: LJ ops dude here - shishmish on August 4th, 2009 10:42 pm (UTC) (Expand)
Re: LJ ops dude here - eternalwings on August 4th, 2009 10:43 pm (UTC) (Expand)
Re: LJ ops dude here - dwell on August 4th, 2009 10:51 pm (UTC) (Expand)
Re: LJ ops dude here - shishmish on August 4th, 2009 10:55 pm (UTC) (Expand)
Re: LJ ops dude here - dwell on August 4th, 2009 11:04 pm (UTC) (Expand)
Re: LJ ops dude here - shishmish on August 4th, 2009 11:12 pm (UTC) (Expand)
A very groovy mutation.xrainbowcloud on August 3rd, 2009 09:49 pm (UTC)
It's been awful for me for the last week, I've hardly been able to do anything, but I thought it was my computer. And after I got a paid account as well, psh. But I'm glad it's not, it's just annoying that we're all having the same issue.
(Deleted comment)
Black Wolfblack_wolf on August 4th, 2009 06:14 pm (UTC)
Thank you for that tip. I've adblocked as well and while it look weird it works! Loaded in less than a second!
(Deleted comment)
The Tibetan Hatturk_diddler on August 4th, 2009 03:40 pm (UTC)
Tracing route to livejournal.com [208.93.0.128]
over a maximum of 30 hops:

1 2 ms 2 ms 1 ms www.routerlogin.com [192.168.0.1]
2 48 ms 47 ms 47 ms dr12.bllon.ov.easynet.net [89.200.128.53]
3 75 ms 73 ms 73 ms 5acfee32.bb.sky.com [90.207.238.50]
4 72 ms 73 ms 73 ms easynet-ic-121677-ldn.b4.c.telia.net [80.239.193
.110]
5 74 ms 85 ms 73 ms ldn-b4-link.telia.net [80.239.193.109]
6 75 ms 74 ms 74 ms ldn-bb1-link.telia.net [80.91.251.18]
7 150 ms 152 ms 149 ms ash-bb1-link.telia.net [213.248.65.210]
8 146 ms 154 ms 152 ms qwest-119092-ash-bb1.telia.net [213.248.88.178]

9 * * * Request timed out.
10 399 ms 331 ms 240 ms bil-core-02.inet.qwest.net [205.171.8.154]
11 * 310 ms 241 ms bil-edge-02.inet.qwest.net [205.171.154.22]
12 240 ms 236 ms 238 ms 65.121.112.210
13 239 ms 239 ms 240 ms livejournal.com [208.93.0.128]

Trace complete.




Not half improving my chess while I wait for LJ to load. Might be my imagination, seems slower this afternoon than last night.
btdwell on August 4th, 2009 10:47 pm (UTC)
UPDATE @ Tue Aug 4 22:34:20 UTC 2009
Hi All,

PLEASE POST TRACEROUTES TO l-stat.livejournal.com. Not "www.livejournal.com" or "livejournal.com". Per Marta's post here, we specifically need traceroutes to "l-stat.livejournal.com" only.


Thank you to all that are doing traceroutes and posting them up here, the more data points I have, the quicker we can fix this problem.


So far the problem is *not* reaching our main computers in USA but rather the problem appears to be reaching our distributed network (Limelight) from Easynet/Sky networks. I've escalated a call up with Limelight to see if we can get any help in that direction and will hopefully have different solutions in 1 hour.

bt
eternalwingseternalwings on August 4th, 2009 10:54 pm (UTC)
Re: UPDATE @ Tue Aug 4 22:34:20 UTC 2009
Here's my updated tracer then ^_^ though it seems to be timing out completely.

Microsoft Windows [Version 6.0.6001]
Copyright (c) 2006 Microsoft Corporation. All rights reserved.

C:\Users\Sam>tracert l-stat.livejournal.com

Tracing route to livejournl.vo.llnwd.net [87.248.210.253]
over a maximum of 30 hops:

1 2 ms 1 ms 1 ms 192.168.0.1
2 66 ms 65 ms 65 ms cr0.lvmag.uk.easynet.net [195.189.159.230]
3 61 ms 73 ms 61 ms 80.238.62.97
4 70 ms 69 ms 69 ms ip-89-200-130-5.ov.easynet.net [89.200.130.5]
5 68 ms 69 ms 69 ms ip-89-200-130-4.ov.easynet.net [89.200.130.4]
6 68 ms 69 ms 69 ms te0-0-0.er101.bllon.uk.easynet.net [87.86.72.19]

7 70 ms 69 ms 69 ms ge1-1-5.er3.bllon.uk.easynet.net [87.86.69.153]

8 70 ms 69 ms 69 ms ge0-1.ar8.bllon.uk.easynet.net [82.109.188.5]
9 * * * Request timed out.
10 * * * Request timed out.
11 * * * Request timed out.
12 * * * Request timed out.
13 * * * Request timed out.
14 * * * Request timed out.
15 * * * Request timed out.
16 * * * Request timed out.
17 * * * Request timed out.
18 * * * Request timed out.
19 * * * Request timed out.
20 * * * Request timed out.
21 * * * Request timed out.
22 * * * Request timed out.
23 * * * Request timed out.
24 * * * Request timed out.
25 * * * Request timed out.
26 * * * Request timed out.
27 * * * Request timed out.
28 * * * Request timed out.
29 * * * Request timed out.
30 * * * Request timed out.

Trace complete.

C:\Users\Sam>
Re: UPDATE @ Tue Aug 4 22:34:20 UTC 2009 - shishmish on August 4th, 2009 11:22 pm (UTC) (Expand)
Re: UPDATE @ Tue Aug 4 22:34:20 UTC 2009 - dwell on August 4th, 2009 11:59 pm (UTC) (Expand)
Re: UPDATE @ Tue Aug 4 22:34:20 UTC 2009 - blue_aeon on August 4th, 2009 11:23 pm (UTC) (Expand)
Re: UPDATE @ Tue Aug 4 22:34:20 UTC 2009 - dwell on August 5th, 2009 12:49 am (UTC) (Expand)