Welcome to NeoOffice developer notes and announcements
NeoOffice
Developer notes and announcements
 
 

This website is an archive and is no longer active
NeoOffice announcements have moved to the NeoOffice News website


Support
· Forums
· NeoOffice Support
· NeoWiki


Announcements
· Twitter @NeoOffice


Downloads
· Download NeoOffice


  
NeoOffice :: View topic - NeoJ 0.8.1 bandwidth spike
NeoJ 0.8.1 bandwidth spike
 
   NeoOffice Forum Index -> Mirrors
View previous topic :: View next topic  
Author Message
OPENSTEP
The One
The One


Joined: May 25, 2003
Posts: 4752
Location: Santa Barbara, CA

PostPosted: Mon Feb 23, 2004 8:12 pm    Post subject: NeoJ 0.8.1 bandwidth spike

Just a note for all those running mirrors to expect traffic loads from Patrick's 0.8.1 release. The traffic on the activity light to hub for trinity & the web server has been pretty steady all day, so the binary mirrors may be hit fairly hard Shocked. If you're mirroring binaries and have a monthly transfer cap, keep an eye on your stats.

ed
Back to top
pluby
The Architect
The Architect


Joined: Jun 16, 2003
Posts: 11949

PostPosted: Mon Feb 23, 2004 9:40 pm    Post subject:

I have seen the bandwidth usage at www.planamesa.com spike very high. Just yesterday, the bandwidth usage was 23 gigabytes and I didn't even post the binary until the evening.

Today, ssh access to my server has been extremely slow so I suspect that today's bandwidth usage will be astronomical. I think that NeoJ is a victim of its own success!

One thing that I have noticed is that many sites (e.g. VersionTracker) are linking to my binary instead of the download page. This means that very few people are seeing the list of mirror sites.

Does anyone know how to configure Apache to redirect based on the Referrer header?

Patrick
Back to top
OPENSTEP
The One
The One


Joined: May 25, 2003
Posts: 4752
Location: Santa Barbara, CA

PostPosted: Tue Feb 24, 2004 1:23 am    Post subject:

Dude, we all know you kick ass Wink

Hmm...this may be way too far out there, but might it be possible to somehow trick apache into running a CGI at your binary download URL? I'm not sure how to do it based on referrer only with apache configs, but you may be able to get access to the referrer from a server side script and generate an HTTP redirect. I'm just unsure if it'd work if the URL already has a non-html extension on it without mucking with the mime types on the server.

Also...who's keeping track of VersionTracker? You should file a request with versiontracker to point to the mirror page instead of directly to your URL.

ed
Back to top
pluby
The Architect
The Architect


Joined: Jun 16, 2003
Posts: 11949

PostPosted: Tue Feb 24, 2004 8:51 am    Post subject:

Ed,

I put an link update request yesterday and it looks like they properly switched it to http://www.planamesa.com/neojava/download.php this morning.

I also made my error page and directory index page for the download directory point to the above URL to help funnel people back to the download page.

BTW, yesterday's bandwidth usage was 45 GB and today's is already at 12 GB.

Patrick
Back to top
OPENSTEP
The One
The One


Joined: May 25, 2003
Posts: 4752
Location: Santa Barbara, CA

PostPosted: Tue Feb 24, 2004 11:45 am    Post subject:

Yup, it's sufficient to say that there's a bandwidth spike. Do you think your ISP will notice? Shocked My web server here has been into the hundreds of unique requests per hour, but aside from insanely great I haven't seen any other referrers. I don't know bandwidth useage from the other machines.

ed
Back to top
pluby
The Architect
The Architect


Joined: Jun 16, 2003
Posts: 11949

PostPosted: Tue Feb 24, 2004 12:17 pm    Post subject:

My ISP has definitely noticed, they keep chmoding selected directories and files with no read permissions.

Right now, I am putting in a hacky cron script that will swap in a "maximum number of connections exceeded" error page if it appears that I am hogging all of the web servers processes.

Hopefully, that will help.

Patrick
Back to top
OPENSTEP
The One
The One


Joined: May 25, 2003
Posts: 4752
Location: Santa Barbara, CA

PostPosted: Tue Feb 24, 2004 10:48 pm    Post subject:

While the binaries are of course still a problem...

If you need to offload images or static pages feel free to dump them onto the web server here. Thus far it's been able to survive just about everything except a full on slashdotting, mostly because all the pages are static.

Another trick I've thought of using is to actually just do an http redirect into the google cache, but it takes a long time for changes to get incorporated into it.

ed
Back to top
Luke
Captain


Joined: Sep 08, 2003
Posts: 63
Location: Teesside, UK

PostPosted: Fri Feb 27, 2004 6:03 pm    Post subject:

I wrote
Quote:
I've set up a BitTorrent for the Neo/J 8.1 .dmg. The page for it is
http://www.torrentz.com/torrents/view_1402

The direct link to the .torrent file is
http://www.torrentz.com/torrents/download_1402


This is now superseeded by schlum_macbidouille's torrent, see

http://perso.wanadoo.fr/schlum/NeoOfficeJ-0.8.1.dmg.torrent

Whether this gives any relief to the main download sites depends, of course, on people using it. So long as normal downloads are avalable at reasonable rates, no-one is gong to use BitTorrent. With only me uploading, the best a single downloader is going to get is about 30k/sec. But each additional downloader adds (most of) their upload capacity to the system, so a few people wth fast links downloading the file would make it fast for everyone.

If you already have the .dmg file and would like to help others to get it, make a copy of it in case of trouble, then get the .torrent file and start a new download, making as if to overwrite the file you already have. It will NOT be overwritten, though, just checksummed against the info in the .torrent file and then uploaded. If you have a firewall up, you will need to open ports 6881-6889 for TCP

If you want to find out about BitTorrent, look at

http://bitconjurer.org/BitTorrent/

OSX version can be downloaded from Sourceforge

http://prdownloads.sourceforge.net/bittorrent/BitTorrent_OSX_3.3a.dmg?download

Happy downloading - the more the better!

Luke


Last edited by Luke on Sun Mar 07, 2004 4:42 pm; edited 2 times in total
Back to top
schlesi
Oracle


Joined: Jun 07, 2003
Posts: 234
Location: near Cologne, Germany

PostPosted: Sat Feb 28, 2004 7:12 am    Post subject:

Luke,

I'm the guy who has started the second Bittorrent-client. Wink

Thomas
Back to top
OPENSTEP
The One
The One


Joined: May 25, 2003
Posts: 4752
Location: Santa Barbara, CA

PostPosted: Sat Feb 28, 2004 10:49 pm    Post subject:

OK, torrent dudes, trinity's on a static IP so I should be able to host any .torrent files for us. Do you know of a good link where I could read up on how to configure apache to host .torrent files?

Next time we do a major link I'd love to have that torrent link ready and can let one of my spare computers run the initial client connection, even if on a slow link Smile

ed
Back to top
schlesi
Oracle


Joined: Jun 07, 2003
Posts: 234
Location: near Cologne, Germany

PostPosted: Sun Feb 29, 2004 1:19 am    Post subject:

Ed,

configuring Apache for Bittorrent is very easy. Put this line to your httpd.conf: AddType application/x-bittorrent .torrent

A website with more information is here, for example: http://userpages.umbc.edu/~hamilton/dessentgooglecache61.html .

Thomas
Back to top
Display posts from previous:   
   NeoOffice Forum Index -> Mirrors All times are GMT - 7 Hours
Page 1 of 1

 
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You cannot download files in this forum

Powered by phpBB © 2001, 2005 phpBB Group

All logos and trademarks in this site are property of their respective owner. The comments are property of their posters, all the rest © Planamesa Inc.
NeoOffice is a registered trademark of Planamesa Inc. and may not be used without permission.
PHP-Nuke Copyright © 2005 by Francisco Burzi. This is free software, and you may redistribute it under the GPL. PHP-Nuke comes with absolutely no warranty, for details, see the license.