View previous topic :: View next topic |
Author |
Message |
OPENSTEP The One
Joined: May 25, 2003 Posts: 4752 Location: Santa Barbara, CA
|
Posted: Mon Feb 23, 2004 8:12 pm Post subject: NeoJ 0.8.1 bandwidth spike |
|
Just a note for all those running mirrors to expect traffic loads from Patrick's 0.8.1 release. The traffic on the activity light to hub for trinity & the web server has been pretty steady all day, so the binary mirrors may be hit fairly hard . If you're mirroring binaries and have a monthly transfer cap, keep an eye on your stats.
ed |
|
Back to top |
|
|
pluby The Architect
Joined: Jun 16, 2003 Posts: 11949
|
Posted: Mon Feb 23, 2004 9:40 pm Post subject: |
|
I have seen the bandwidth usage at www.planamesa.com spike very high. Just yesterday, the bandwidth usage was 23 gigabytes and I didn't even post the binary until the evening.
Today, ssh access to my server has been extremely slow so I suspect that today's bandwidth usage will be astronomical. I think that NeoJ is a victim of its own success!
One thing that I have noticed is that many sites (e.g. VersionTracker) are linking to my binary instead of the download page. This means that very few people are seeing the list of mirror sites.
Does anyone know how to configure Apache to redirect based on the Referrer header?
Patrick |
|
Back to top |
|
|
OPENSTEP The One
Joined: May 25, 2003 Posts: 4752 Location: Santa Barbara, CA
|
Posted: Tue Feb 24, 2004 1:23 am Post subject: |
|
Dude, we all know you kick ass
Hmm...this may be way too far out there, but might it be possible to somehow trick apache into running a CGI at your binary download URL? I'm not sure how to do it based on referrer only with apache configs, but you may be able to get access to the referrer from a server side script and generate an HTTP redirect. I'm just unsure if it'd work if the URL already has a non-html extension on it without mucking with the mime types on the server.
Also...who's keeping track of VersionTracker? You should file a request with versiontracker to point to the mirror page instead of directly to your URL.
ed |
|
Back to top |
|
|
pluby The Architect
Joined: Jun 16, 2003 Posts: 11949
|
Posted: Tue Feb 24, 2004 8:51 am Post subject: |
|
Ed,
I put an link update request yesterday and it looks like they properly switched it to http://www.planamesa.com/neojava/download.php this morning.
I also made my error page and directory index page for the download directory point to the above URL to help funnel people back to the download page.
BTW, yesterday's bandwidth usage was 45 GB and today's is already at 12 GB.
Patrick |
|
Back to top |
|
|
OPENSTEP The One
Joined: May 25, 2003 Posts: 4752 Location: Santa Barbara, CA
|
Posted: Tue Feb 24, 2004 11:45 am Post subject: |
|
Yup, it's sufficient to say that there's a bandwidth spike. Do you think your ISP will notice? My web server here has been into the hundreds of unique requests per hour, but aside from insanely great I haven't seen any other referrers. I don't know bandwidth useage from the other machines.
ed |
|
Back to top |
|
|
pluby The Architect
Joined: Jun 16, 2003 Posts: 11949
|
Posted: Tue Feb 24, 2004 12:17 pm Post subject: |
|
My ISP has definitely noticed, they keep chmoding selected directories and files with no read permissions.
Right now, I am putting in a hacky cron script that will swap in a "maximum number of connections exceeded" error page if it appears that I am hogging all of the web servers processes.
Hopefully, that will help.
Patrick |
|
Back to top |
|
|
OPENSTEP The One
Joined: May 25, 2003 Posts: 4752 Location: Santa Barbara, CA
|
Posted: Tue Feb 24, 2004 10:48 pm Post subject: |
|
While the binaries are of course still a problem...
If you need to offload images or static pages feel free to dump them onto the web server here. Thus far it's been able to survive just about everything except a full on slashdotting, mostly because all the pages are static.
Another trick I've thought of using is to actually just do an http redirect into the google cache, but it takes a long time for changes to get incorporated into it.
ed |
|
Back to top |
|
|
Luke Captain
Joined: Sep 08, 2003 Posts: 63 Location: Teesside, UK
|
Posted: Fri Feb 27, 2004 6:03 pm Post subject: |
|
I wrote
This is now superseeded by schlum_macbidouille's torrent, see
http://perso.wanadoo.fr/schlum/NeoOfficeJ-0.8.1.dmg.torrent
Whether this gives any relief to the main download sites depends, of course, on people using it. So long as normal downloads are avalable at reasonable rates, no-one is gong to use BitTorrent. With only me uploading, the best a single downloader is going to get is about 30k/sec. But each additional downloader adds (most of) their upload capacity to the system, so a few people wth fast links downloading the file would make it fast for everyone.
If you already have the .dmg file and would like to help others to get it, make a copy of it in case of trouble, then get the .torrent file and start a new download, making as if to overwrite the file you already have. It will NOT be overwritten, though, just checksummed against the info in the .torrent file and then uploaded. If you have a firewall up, you will need to open ports 6881-6889 for TCP
If you want to find out about BitTorrent, look at
http://bitconjurer.org/BitTorrent/
OSX version can be downloaded from Sourceforge
http://prdownloads.sourceforge.net/bittorrent/BitTorrent_OSX_3.3a.dmg?download
Happy downloading - the more the better!
Luke
Last edited by Luke on Sun Mar 07, 2004 4:42 pm; edited 2 times in total |
|
Back to top |
|
|
schlesi Oracle
Joined: Jun 07, 2003 Posts: 234 Location: near Cologne, Germany
|
Posted: Sat Feb 28, 2004 7:12 am Post subject: |
|
Luke,
I'm the guy who has started the second Bittorrent-client.
Thomas |
|
Back to top |
|
|
OPENSTEP The One
Joined: May 25, 2003 Posts: 4752 Location: Santa Barbara, CA
|
Posted: Sat Feb 28, 2004 10:49 pm Post subject: |
|
OK, torrent dudes, trinity's on a static IP so I should be able to host any .torrent files for us. Do you know of a good link where I could read up on how to configure apache to host .torrent files?
Next time we do a major link I'd love to have that torrent link ready and can let one of my spare computers run the initial client connection, even if on a slow link
ed |
|
Back to top |
|
|
schlesi Oracle
Joined: Jun 07, 2003 Posts: 234 Location: near Cologne, Germany
|
|
Back to top |
|
|
|