Oh How I Love...
Posted by: munk
Posted on: 2006-09-02 14:20:00
Seeing that spinning wheel in my Firefox tab as I try to load my sites.
w00t!
MaxiMunk
Posted by: munk
Posted on: 2006-09-02 14:20:00
Seeing that spinning wheel in my Firefox tab as I try to load my sites.
w00t!
MaxiMunk
Posted by: seiler
Posted on: 2006-09-02 15:31:00
The site in your sig is up for me. Are things better, or isn't that a site you're having trouble with?
Posted by: munk
Posted on: 2006-09-05 13:11:00
It was very sporadic that day...
Today is another wonderful day for my site...Looooooooong load times. And the text message I got this morning at 9:01 saying the "site is completely down, won't even load..."
amazing....
MaxiMunk
Posted by: munk
Posted on: 2006-09-06 14:47:00
Update for 9/6/2006 @ 14:46...
Same crap....slow to unresponsive. This is now the norm, and not the exception it would appear.
I think I'll just keep a running diary here, more for my benefit, but if anyone else wishes to report on their site being slow, or unresponsive, feel free.
It's hard enough trying to grow a site...thank you DH for making even harder. You're the best!
MaxiMunk
Posted by: seiler
Posted on: 2006-09-06 15:49:00
I just went to it and it loaded in 5.418 seconds. Not sure if it's part of your problem or not, but w3c's HTML validator shows over 160 problems on the page, 69 of which are actual error messages, with the rest being warning/info messages.
http://validator.w3.org/check?uri=http://www.maximunk.com
Posted by: munk
Posted on: 2006-09-06 17:38:00
It's possible, but wouldn't that effect the site at all times?
Also, the errors are mainly on the home page, I'm sure its mainly due to the bridge I'm using (joomla/SMF forum.) If I go direct to the forum url, I still get sporadic even though that site passes validation.
MaxiMunk
Posted by: munk
Posted on: 2006-09-06 19:25:00
And just to add, I do have two other sites, and they ALL experience this. Even with validated HTML.
MaxiMunk
Posted by: pavan
Posted on: 2006-09-07 12:13:00
my site has also been going slow for the past while. Definitely sporadic, sometimes fast, sometimes doesn't work at all. Same deal with webmail.
http://www.continulife.com
is a little sluggish right now.
Emailed support, got this response on August 30th:
"I'm sorry for the problems you've been experiencing. We've continued
to have intermittent network problems that we haven't been able to fully
resolve yet. We had Cisco out here yesterday to help troubleshoot one of
their routers that is causing the latency and we got some really good
feedback from them. We will be making some network changes and replacing
more hardware sometime next week. At that point, we hope everything will
be back to its normal speedy self. If you have any further questions,
please let us know.
Thanks!
Dan"
Hopefully it will be fixed in the next day or two.
Posted by: quanin
Posted on: 2006-09-07 13:09:00
I checked your site a total of 4 times, and 3 came up fairly fast. The one that didn't, though, wasn't all that slow... maybe 7-8 seconds? Considering the queries the site makes to the database just on the homepage, that probably isn't bad.
Yes, I have an opinion.
Get a minimum 50% off with the "haveadreamyday" promo code, and... have a dreamy day. Original, no?
Posted by: munk
Posted on: 2006-09-08 08:35:00
Todays issue, the site in my sig had an odd hiccup for a little bit. Error message about No SQL database exists...seems to re-exsist now though.
Another site was totally down this morning. "Index.php" not found accessing the main page, same message if I try to go in through the Administrator log in. This one lasted at least an hour...(from the time I first noticed...who knows how long beforehand.) That site isn't too important, as its not really public. Still, very annoying. (and yes, it's back up...)
Those that say you haven't any problems, you are blessed. But realize that there are people who do. Everyday there's a new thread, so we're not imagining these issues.
Hell, I can't even access the Status Blog to see what, if any excuse there is for today.
MaxiMunk
Posted by: julisana
Posted on: 2006-09-08 08:42:00
The problem I'm having with my site (http://www.julisana.com) isn't that it loads slowly, it's that FTP connections are unrelyable today and I cannot update anything on it. I've got two computers here at work (one is a mac that I was trying to connect via DreamWeaver, the other is a PC that I was just trying to use Putty on) and neither was having a successful time staying connected via FTP/sFTP.
Posted by: pavan
Posted on: 2006-09-08 09:07:00
Getting problems today too. Got a 'connection error', couldn't connect to the DB, site is loading slow and I can't access the DH status page. This is starting to piss me off.
Posted by: talz13
Posted on: 2006-09-08 09:10:00
I've been having problems with the site loading slow for quite a while now. It always takes at least 5-10 seconds to load the front page, where most every other site I visit comes up almost instantly. It's really more of an aggravation, but I still feel that it should be resolved. Hopefully the cisco router stuff getting fixed will speed things up again.
Posted by: forgotusername
Posted on: 2006-09-08 09:33:00
********* Critical Announcement *********
(posted 8 hours 0 mins ago)
Status Page Down
The server that hosts http://dreamhoststatus.com crashed and is not
coming back up. Since the server is hosted offsite, it will be awhile
before dreamhoststatus.com is back up.
All other services are operating normally, if you have a problem with
anything other than the accessibility of dreamhoststatus.com, please
submit a ticket.
Posted by: seiler
Posted on: 2006-09-08 10:16:00
Are you still having problems? Your site loads instantly for me.
Posted by: munk
Posted on: 2006-09-10 15:02:00
Whats todays excuse? Now I get 500 Internal Service Errors when trying to access my sites, and I can log in via FTP. This has been going on at least an hour now.
I know, it's all in my head... :(
(added: can't access MySQL either...)
MaxiMunkEdited by munk on 09/10/06 03:54 PM (server time).
Posted by: munk
Posted on: 2006-09-10 17:14:00
Sites back up, downtime at least 3 hours.
I will add that DH support was very nice during this, so I wish to thank them publically.
But still very discouraging...
MaxiMunk
Posted by: seiler
Posted on: 2006-09-10 18:32:00
What was the problem? Anything to do with the weekend problems, or something unrelated?
Posted by: munk
Posted on: 2006-09-10 19:03:00
"The problems are related to our ongoing networking issues. They are causing intermittent high loads (resulting in services crashing), from dropped network connections."
MaxiMunk
Posted by: seiler
Posted on: 2006-09-10 19:24:00
I suppose the good news there is that the problems you've been having should be gone after the upgrade tomorrow.
I did notice higher loads after everything came back up, but I'm on a light load server, so it was only 7 - 10, instead of the normal 1 - 2.
Right now:
19:23:53 up 1 day, 16:18, 2 users, load average: 11.90, 10.87, 10.40
Posted by: s9jeremiah
Posted on: 2006-09-11 06:28:00
for those of you keeping a close eye on dreamhoststatus today - check out the yahoo widget
http://widgets.yahoo.com/gallery/view.php?widget=40375
jeremiah
Posted by: dallas
Posted on: 2006-09-11 11:02:00
Here's some information I just posted on dreamhoststatus.com. Feel free to ask me for any clarification or additional information and I'll tell you what I know...
The router maintenance scheduled for tonight is essentially a complete replacement of our ailing router as well as upgrades of all of the key components. After several weeks of tracking down the issue we (and Cisco) have finally decided the problem is definitely hardware related. After replacing several of the components of the router over the past few weeks without improvement we will now be replacing the chassis itself (the box everything sits in) as well as upgrading several components. The new router will be several times more powerful than the current one and will be essentially brand-new.
After this maintenance we will be following up with an upgrade of the other router to get it in line performance-wise with this one. We are also discussing further upgrades of the network to add more throughput and allow us to scale ever farther. We will also be switching our core network equipment to a separate power feed with a more reliable UPS system. That process has been underway for a few weeks now.
If we could have done this upgrade sooner, we would have. We were not able to get the replacement parts we need any sooner. The problem seemed like it might be hardware related from very near the beginning of our series of problems but we were not able to convince Cisco support enough for them to provide us with the replacement equipment until now. The problems we have been seeing are very sporadic and difficult to isolate. One possible silver lining in all of this is we are now more experienced with Cisco’s support (this was our first major issue with our equipment) and we know better what we can actually expect from them. We will be reviewing our existing support contracts and investigating possible alternatives that may work better for our needs.
- Dallas
- DreamHost Head Honcho/Founder
Posted by: edalzell
Posted on: 2006-09-11 14:27:00
I await tomorrow with baited breath. One, to see if the networking problems are resolved. And two, to see what Steve Jobs pulls out of his magic hat.
Dallas, thanks for that informative post. While I have been frustrated with all the problem lately at DH, I have also been on the other side of the coin and realise how hard it can be to be on the receiving end of all the criticism.
I hope the upgrade goes smoothly.
Posted by: munk
Posted on: 2006-09-11 14:46:00
I'm waiting to see what happens as well...
Although for at least the past 15 mins., I have been unable to load any of my sites.
Posted by: munk
Posted on: 2006-09-11 14:54:00
One thing I'm curious about, Dallas.
Why tonight at 10pm? This seems to be a very critical issue, one that may make or break some peoples decision to stay. I can buy into the fact that perhaps you've been waiting on a part (or parts) to arrive. But I'm pretty sure UPS or FedEX delivers before 10PM. Probably before 5PM.
If you're holding onto the whatever parts are needed now, why the wait? I mean, if I'm subjected to downtime now as it is, may as well be for a good reason. No?
Posted by: rlparker
Posted on: 2006-09-11 15:15:00
Edit: "Bad Keyboard! Baaad!" - This was in relpy to "munk", I borked it and replied to the wrong poster - sorry!
Obviously, YMMV, and I'd be right there with you on that if my sites were down. But since they are *not*, I'd rather see the required down time later tonight when most of my "business" users are less likely to be impacted.
I think this is one of those times when you just can't please everyone; those whose sites are broken already need it ASAP while those still "online" are better served by a "dead of night" maintenance. I'm really not belittling your situation, and I'm sorry your sites are not working. I suspect that DH is trying to minimize the overall impact of the required down time - which I understand is not mcuh comfort if you are "down" *now*.
--rlparker
I am *NOT* a Dreamhost Employee
Edited by rlparker on 09/11/06 06:27 PM (server time).
Posted by: dallas
Posted on: 2006-09-11 15:26:00
The replacement parts have all arrived now. The second upgrade part (a cooling fan needed for the beefier hardware we're installing) arrived just a few minutes ago.
The upgrade requires taking down our entire network for some amount of time (the estimate is 30-45 minutes) and since a large portion of our network is working normally we've decided to wait until after prime time so the upgrade affects as few people as possible. In cases like this it's a matter of determining the lesser of the two bads... full downtime for everyone on one side and the current very annoying poor network performance for some people (not everyone is affected) on the other side.
The time from now to 10pm is going to be used to prepare everything as much as possible to keep the total downtime to a bare minimum. The work involved is basically removing a box the size of a small refrigerator that every bit of our network is wired into (lots of wires!) from a rack, swapping in another, and wiring it back up. There's bound to also be some sort of fallout with other equipment that will have to be dealt with afterwards. We're staffing an extra team of support techs tonight to help us catch any residual issues as fast as possible.
It makes the most sense for us to make sure we're ready to do this maintenance right and the extra few hours to 10pm is ultimately not going to matter much after the last several weeks of poor network performance. Believe me, we're very anxious to get this problem behind us so we can get back to business as usual!
- Dallas
- DreamHost Head Honcho/Founder
Posted by: munk
Posted on: 2006-09-11 15:38:00
Thank you for the reply. And as of now, I'm no longer getting the dreaded "500 Internal Server Error" messages...
Lastly, what server Gods must one pray and offer our first born to get onto whatever server rlparker is on?? My first born is my only, so I'd like to keep him around, but I have some tamales in my fridge I'm willing to part with...![]()
Posted by: rlparker
Posted on: 2006-09-11 15:45:00
In reply to:what server Gods must one pray and offer our first born to get onto whatever server rlparker is on?
Ha Ha! Be careful what you ask for, the server I am on has had it's share of problems too (i just happen to be "presently" running while you were sufferring - hopefully tomorrow that will be different for all of us
)
I'm glad your sites are "back".
--rlparker
Posted by: hiveminds
Posted on: 2006-09-11 22:33:00
It's up... it's down ... no, it's up .... wait no, it's down... looks like it's up again... but wait ... no, it's down and the the Firefox logo is spinning... looks like we have a support ticket folks... I'am wondering if it will hit before the site goes up again? You're right look it's up again ... I think your wrong... looks weak and slow ... yep it's down!...I think that was maintenance but we can't be sure can we... look it's up again!!!
Posted by: seiler
Posted on: 2006-09-11 22:53:00
You do know that now is the scheduled downtime, right?
Posted by: hiveminds
Posted on: 2006-09-11 23:27:00
Nope, I didn't. I got the low down from the support ticket though.
There was no mailout on this? I get mail from Bluehost, HostPC and Site5. Mostly from HostPC (including hurricane watches) about every little change in their system or scheduled maintenance...but nothing from Dreamhost.
Is there a newsletter or something that I have missed?
Posted by: rlparker
Posted on: 2006-09-11 23:37:00
In reply to:There was no mailout on this?...Is there a newsletter or something that I have missed?
Depending on when you joined, you may have not received the newsletter where DH announced they would no longer be mailing announcments, opting instead to make a series of RSS feeds of the data on dreamhoststatus.com available instead.
You can check for planned downtimes at that site, or subscribe to any/all status related RSS feeds to stay "up-to-date".
--rlparker
Posted by: hiveminds
Posted on: 2006-09-12 00:17:00
Hmm,
I hope they will re-think this. RSS feeds do me absolutely no good if I am away especially since they are linear. They should have made this optional.
Posted by: iansealy
Posted on: 2006-09-12 04:12:00
Maybe you could try out something like http://www.rssfwd.com/ or http://rss2email.infogami.com/?
Cheers,
Ian
Posted by: rlparker
Posted on: 2006-09-12 04:56:00
Ian's solutions sound promising, but I'm not sure I understand:
In what situation could you get email while you are away, but not be able to get the rss feed?
--rlparker
Posted by: rlparker
Posted on: 2006-09-12 04:59:00
Ian,
Thanks for the rss2email link. Very nice tool, that!
--rlparker
Posted by: s9jeremiah
Posted on: 2006-09-12 05:59:00
Posted by: hiveminds
Posted on: 2006-09-12 08:27:00
"In what situation could you get email while you are away, but not be able to get the rss feed?"
I all situations mostly. If I am in stockholm I stop at the internet cafe in the subway and log into my gmail account. I just check this to make sure that there is no emergency situation like a site being down and such. I don't sit and surf to RSS aggregators and in all cases the terminals only have a web browser installed nothing else.
If I am on the train for hours then I will use my mobile phone to check my email. I don't have an internet account on this phone. The mail is forwarded the mobile phone email account to gmail.
I may go days or weeks without reading a RSS but I read email every few hours.
Having RSS is a convenience but should not be a replacement for email. Especially when it is something that directly effects me as an account holder or user.
Posted by: rlparker
Posted on: 2006-09-12 11:07:00
Ah, I see! Though it *does* sound like in the Internet Cafe example, a browser could check dreamhoststatus.com in about a minute ![]()
It also sounds like the rss2mail program that Ian suggested would accomplish the "email notification" of these announcements for when you are browserless. Since you may go for days without browsing, I think having the "status" rss converted to email and sent to you, where it is accessible from your phone should be ideal.
I understand that it seems to be less convenient for you; but I find the rss to be a *big* improvement over email in that it is much more reliable than email transport. I actually felt the same way you do, and missed the emails, immediately after they made the change, but now i have adapted and I actually lilke it better (for one thing, the announcements don't get buried in/amonst spam).
Maybe you should visit the Control Panel and make a suggestion that you would like the email notifications to return?
I suspect that Dh having grown to over 300,000 domains hosted had something to do with their decision - that would be a *lot* of mail to send, and then the question is always ,"Is this important enough to send to the general membership?"
--rlparker
Posted by: munk
Posted on: 2006-09-12 13:01:00
No spinning wheels, and no 500 errors all day. Pages load almost instantly. So far, so good DH!
(if I'm going to bash them, it's only fair to praise them.)
Posted by: norm1037
Posted on: 2006-09-13 01:28:00
Well done.
So many dive in to criticise as soon as there is a momentary blip in the network, but only a few pipe up to give praise where praise is due.
--
Norm
Opinions are my own views, not DreamHosts'.
I am NOT a DreamHost employee OK!! ![]()
You act on my advice at your own risk!
Posted by: rlparker
Posted on: 2006-09-13 03:15:00
I sure am glad to see that you are finally getting some decent performance! I'm hoping it continues for you! ![]()
--rlparker
Posted by: rlparker
Posted on: 2006-09-13 07:31:00
Jerimiah,
That is a very nicely done widget! Good job, and thanks for sharing it.
--rlparker
Posted by: dallas
Posted on: 2006-09-13 13:03:00
We switched away from using email announcements due to a couple of reasons.
1. The emails were taking too long to send. It was taking several hours for announcements to go out and people were getting them long after the problem had actually been sent.
2. Sending email announcements was increasing our workload because of all of the people responding to the emails. The idea of announcements is to keep customers informed of situations and also hopefully lower our overall support load. Combined with #1, our email announcement system was failing on both counts.
The concept of the dreamhoststatus blog was to allow people to subscribe to the RSS feeds they are most interested in and to be able to immediately find out about problems whenever they.
I have questions about our current setup, though... Is the current topic-based category approach working? Does anyone subscribe to individual topics or does everyone just get the main feed? Would severity-based categories (System-Wide, Single Server, etc) work better? For instance, an inidividual server crashing is less critical.
Also, would it be better to do something to keep the most critical announcements near the top at all times?
Does the organization of posts even matter much?
- Dallas
- DreamHost Head Honcho/Founder
Posted by: scjessey
Posted on: 2006-09-13 13:41:00
In reply to:Is the current topic-based category approach working? Does anyone subscribe to individual topics or does everyone just get the main feed? Would severity-based categories (System-Wide, Single Server, etc) work better?
I actually think the categorization is a waste of time, and I'm pretty sure most people are likely to be accessing the main feed. If you are going to categorize at all, I would limit it to "system-wide" and "local" otherwise folks are just going to get confused.
Posted by: norm1037
Posted on: 2006-09-13 14:08:00
I prefer the single category RSS rather than individual ones. In fact I much preferred the text only layout of the temporary DreamHostStatus blog we had recently.
--
Norm
Opinions are my own views, not DreamHosts'.
I am NOT a DreamHost employee OK!! ![]()
You act on my advice at your own risk!
Posted by: rlparker
Posted on: 2006-09-13 15:33:00
Thanks, Dallas, for sharing the reasoning behind the change from email notifications to dreamhoststatus.com and RSS.
For me, the current set-up is fine. I grab the "whole" feed and that works for me, though if the posts ever became too many to quickly skim, I would probably only grab "outages".
I think one possible disadvantage to having all the "sub-categories" is that, God forbid, someone forget to assign a post to one of the relevant catagories (and many posts properly belong to many categories), a user relying on only the "omitted" category's feed would complain that they didn't see it. That said, though I only generally use the "whole feed", having it the way you do lets a user tailor it to the way they want it.
I think "severity-based" categories might be problematic, as that "less critical" single server outage is actually *very* critical to those on that server, and I can forsee "squabbling" among users over that - different folks will likely have different definitions of what is "critical" than will you, or I, or your support employee making the post.
Making "active" critical announcments that are still likely to impact a large group of users "stickey" (up top) in some way is a good thought.
--rlparker
Posted by: munk
Posted on: 2006-09-18 15:17:00
Here we go again...
Down this morning....down again right now.
(and I am not on "pizarro")
Posted by: seiler
Posted on: 2006-09-18 16:43:00
It's up for me -- or is this a problem that already came and went?
Posted by: munk
Posted on: 2006-09-19 12:07:00
Here we go again...
Sites down, ftp down, mysql down...
Sent in a support ticket, according to DH, this was first reported nearly TWO HOURS ago...
So much for the $300,000 worth of whatever it was they installed.
Posted by: seiler
Posted on: 2006-09-19 13:22:00
It loads for me - are you still having problems?
It's might not be a bad idea to send DH a traceroute when you can't connect.
Posted by: munk
Posted on: 2006-09-19 13:40:00
Came back to life about 1/2 hour ago (sometime around 1PM PDT)
Posted by: seiler
Posted on: 2006-09-19 13:46:00
Since it seems to come and go... and I seem to see your posts after it comes back up -- you might want to try one of those offsite uptime monitors to see if their reports/times line up with when you can't reach it.
Then you'd also have the records as a reference when dealing with support, if that would be helpful.
Posted by: munk
Posted on: 2006-09-19 14:08:00
I may do that. Though the last two times this happened (today and yesterday,) when I'd report it through the CP, DH would return a verified System Outage.
I was hoping things would return to normal, and for about a week, things did go smoothly. Now I'm trigger shy again everytime I go to load one of my sites...
At this point, with my 1 year contract set to expire in a week, I'm not sure what to do. For 10 months things were great, but the past two have been agonizing.
Posted by: munk
Posted on: 2006-09-21 12:34:00
Yet another morning/afternoon of the "As The Wheel Spins..."
According to the status blog, "Snagglepuss is down" and "We are having problems with the machine that your database is hosted on."
(I didn't know my database was on that machine.)
I'm not going to solicit other hosts here, so please don't offer suggestions. But I've decided to leave DH. I can't take this anymore. How does one go about trying to grow a site, especially a forum based "community" when your site is routinely down?
I want to thank DH for 10 months of good service. Unfortunately, the past two have been horrible.
Posted by: sjtryon
Posted on: 2006-09-21 18:15:00
I too am getting pretty fed up. I've kept silent for several weeks as it has been obvious that DreamHost has been dealing with some unusual Cisco-related issues. However, as that issue resolves and I look deeper into specifically what is happening to my sites, I'm thinking there are other, perhaps bigger issues that need to be addressed.
All of the static pages on my sites are fine. Anything that connects to mySQL is slow - and has become increasingly worse over the past 4-6 weeks. Today, things are practically useless. Products impacted which have been 'one-click' installed include:
- Joomla;
- phpBB;
- Gallery Image Album;
- activeCollab Collaboration;
- WordPress.
Products impacted that were installed manually include:
- Simple Machines Forums;
- PHP-Fusion.
Hit something that is just static HTML and you get expected and reasonable performance. Hit something connected to mySQL and you better plan to grab a chair and a cup of coffee (although it is now to the point that I have moved from coffee to bourbon).
Really frustrated...
sjt