• Security incident: ISF was recently accessed by intruders. Please change your password, and change it anywhere else you used it. Read more

Recent server issues

The Bad Astronomer

Muse
The Bad Astronomer
Joined
Feb 19, 2002
Messages
828
Folks-

I know that some of you are unhappy with the problems we've been having with the forum/website server. Jeff has been working closely with our webhost to isolate and solve the problem... which is, simply put, too many people accessing the site! Yes, we're a victim of our own success. We've been trying different incremental fixes to relieve the pressure, and we still have some ideas up our sleeves.

Let me assure you, we've been taking this issue very seriously. I live my life online, and I am personally aware of how important this forum is to the JREF. I read the forum as often as I can, though of course my time is limited (helping plan TAM 7 and TAM London turns out to be somewhat time-intensive). Jeff, of course, is also very busy trying to get this thing solved, so feel free to ask questions, but I'm asking that you please be patient with us.

I assure you that getting these problems solved is a top priority. At some point eventually we may need help from you, our community, but we'll work that out when the time comes.

For now, please be aware -- and this is coming straight from me, a guy who owes his career to the internet and the people who use it -- this forum and this community are highly prized by the JREF, and the problems will be fixed as quickly as we can make it happen.
 
Last edited:
Can I humbly suggest significantly over-engineering your next solution point. Plan for, say, twice or three times as much traffic per unit time and concurrent logins and visitors, etc.

Otherwise you will be right back here again very soon, doing this all again.

I hear Deep Blue is currently inactive. Make a bid! :)
 
Phil -- sorry I didn't see this thread before I responded on the other thread!!

Apologies, Miss Kitt
 
Just added the slow forum tag to this thread and another thread. If you look at the threads you will see
- Every few months a new thread has been created to discuss the issue.
- The problem started about the start of 2008 (13 months ago)
- If you read the threads Darat and Terry have spent a lot of time on the issue.

Other notes.
The forum has not grown at all over this period. This is partly due to the CT sub forum shrinking (maybe due to its success?). Shrinking means the number of threads created per month has gone down since the start of 2008. I suggest the lack of growth of this forum is also due to the topic at hand.

How much and how fast this forum will grow when the performance issues have been fixed can only be guessed at. I am eagerly looking forward to that date.
 
Thanks for the update Phil. It's good to know the organisation values the forums highly. What (else) can we do to help?
 
The Bad Astronomer said:
Overengineering -- what web hosts call "room to grow" -- is in the plan.
Click to expand...
From an old computer scientist: ...why stop there?! :)

Seriously, I could arrange for a relatively monster server with Kenworth powered CPUs, mountains of RAM and heaps-o-disk to be made available solely for JREF, for possibly little or no money at all. But if the software ain't efficient and rugged, and the ISP network connection flows slower than treacle at the South Pole, there's no point. The forum will still seem like it is on a 486DX16 with 16MB RAM, Windows ME and terminal asthma.

As has been asked previously, Terry, what's the real problem? And is there anything we can possibly assist with?
 
Zep said:
From an old computer scientist: ...why stop there?! :)

Seriously, I could arrange for a relatively monster server with Kenworth powered CPUs, mountains of RAM and heaps-o-disk to be made available solely for JREF, for possibly little or no money at all. But if the software ain't efficient and rugged, and the ISP network connection flows slower than treacle at the South Pole, there's no point. The forum will still seem like it is on a 486DX16 with 16MB RAM, Windows ME and terminal asthma.

As has been asked previously, Terry, what's the real problem? And is there anything we can possibly assist with?
Click to expand...
...please?
 
As chillzero pointed out in the other thread, if you want Terry to see a question it might be best to PM him to point him here!

Re: the server size issue, it's clear to see what the requirements are if you look at the size of this forum relative to the rest of the internet.

From a forum ranking website (by metric), this forum is the 362nd largest forum on the internet. 362 out of hundreds of thousands. That's a big forum.

Compare this to the Bad Astronomy forum at number 1264, the Richard Dawkins or Skeptic Society forums which don't even rank (ETA the latter two may be because they haven't been submitted or crawled but if you visit them you can see the member and post counts for yourselves), and you can see just how huge it actually is.

Heck, this forum is bigger than the Penny Arcade forum. It's bigger than Mozillazine. It's just below the Doctor Who forum. It's massive.

http://rankings.big-boards.com/?p=all

Some of the biggies carry proper banner and skyscraper advertising, but not all do. I wonder, therefore, if it would be worth contacting the admins of some of those forums to ask then what their server spec is or what their costs are. They're meeting those costs somehow, so their knowledge might be useful.
 
Last edited:
arthwollipot said:
How the heck do you find out statistics like that???
Click to expand...

I gave a link in my post :D

(the answer is, I believe they pull data from each forum's own measuring tools. There's an FAQ but it's not hugely detailed).
 
Last edited:
I do not think that the total number of posts ever made is the best measure of how big a board is. For example we would be much bigger if we had not lost heaps of posts in the past. Forums grow or shrink over time.

A better measure is how many posts were made in a week. This is the link from the same site. Here is the link for that from the same site http://rankings.big-boards.com/?sort=week&filter=all,all&p=12. It shows we are 235 out of 1176 listed with 20,883 posts last week (subject to change over time). Compare that with the 14th biggest with 211,332 posts last week. 10 times bigger. In short we got potential to grow. On the other hand there are not too many other forums with a large general science sub forum or related subjects that are bigger than us.

I have been keeping stats of this over time.
 
rjh01 said:
I do not think that the total number of posts ever made is the best measure of how big a board is.
Click to expand...

Well, it depends. It isn't an unreasonable thing to look at if you're concerned about database performance.
 
Zep said:
As has been asked previously, Terry, what's the real problem? And is there anything we can possibly assist with?
Click to expand...

vBuilletin makes some very inefficient queries, for one thing. Particularly it doesn't deal well with huge threads or members with huge numbers of posts. The other thing is the server needs more RAM (and ideally to be a 64-bit kernel so that a single process can grab a larger amount of RAM too). Almost invariably when the "no DB connections left" messages start, it's because we're thrashing swap. I've tried various things to tune the db to use VM better, but once one of those giant "runs for several hundred seconds" queries kicks in, we usually end up dropping people.

ETA: if we didn't drop people, it probably wouldn't recover on its own, and it would be hung until rebooted (or until someone restarted Apache and/or the database, at least).
 
You could try shoving a weiner in the warp drive. That sometimes helps...
 
You must log in or register to reply here.

Share this page

ISF - Join now!

Every member here is approved by hand. No bots, no spam, just people who care about evidence and honest debate.

Membership is free!

Create your free account

Back
Top Bottom