Welcome to NeoOffice developer notes and announcements
NeoOffice
Developer notes and announcements
 
 

Download or installation problems? Try these steps
Problems after upgrading to NeoOffice 2017? Try these steps


Support
· NeoOffice Support
· NeoWiki


Announcements
· Twitter @NeoOffice


Downloads
· Download NeoOffice


RSS Feeds
· Announcements Only
· All Posts


  
NeoOffice :: View topic - NeoJ 0.8.1 bandwidth spike
NeoJ 0.8.1 bandwidth spike
 
This forum is locked: you cannot post, reply to, or edit topics.   This topic is locked: you cannot edit posts or make replies.    NeoOffice Forum Index -> Mirrors
View previous topic :: View next topic  
Author Message
OPENSTEP
The One
The One


Joined: May 25, 2003
Posts: 4752
Location: Santa Barbara, CA

PostPosted: Mon Feb 23, 2004 8:12 pm    Post subject: NeoJ 0.8.1 bandwidth spike Reply with quote

Just a note for all those running mirrors to expect traffic loads from Patrick's 0.8.1 release. The traffic on the activity light to hub for trinity & the web server has been pretty steady all day, so the binary mirrors may be hit fairly hard Shocked. If you're mirroring binaries and have a monthly transfer cap, keep an eye on your stats.

ed
Back to top
View user's profile Send private message Visit poster's website AIM Address
pluby
The Architect
The Architect


Joined: Jun 16, 2003
Posts: 11856
Location: California, USA

PostPosted: Mon Feb 23, 2004 9:40 pm    Post subject: Reply with quote

I have seen the bandwidth usage at www.planamesa.com spike very high. Just yesterday, the bandwidth usage was 23 gigabytes and I didn't even post the binary until the evening.

Today, ssh access to my server has been extremely slow so I suspect that today's bandwidth usage will be astronomical. I think that NeoJ is a victim of its own success!

One thing that I have noticed is that many sites (e.g. VersionTracker) are linking to my binary instead of the download page. This means that very few people are seeing the list of mirror sites.

Does anyone know how to configure Apache to redirect based on the Referrer header?

Patrick
Back to top
View user's profile Send private message Visit poster's website
OPENSTEP
The One
The One


Joined: May 25, 2003
Posts: 4752
Location: Santa Barbara, CA

PostPosted: Tue Feb 24, 2004 1:23 am    Post subject: Reply with quote

Dude, we all know you kick ass Wink

Hmm...this may be way too far out there, but might it be possible to somehow trick apache into running a CGI at your binary download URL? I'm not sure how to do it based on referrer only with apache configs, but you may be able to get access to the referrer from a server side script and generate an HTTP redirect. I'm just unsure if it'd work if the URL already has a non-html extension on it without mucking with the mime types on the server.

Also...who's keeping track of VersionTracker? You should file a request with versiontracker to point to the mirror page instead of directly to your URL.

ed
Back to top
View user's profile Send private message Visit poster's website AIM Address
pluby
The Architect
The Architect


Joined: Jun 16, 2003
Posts: 11856
Location: California, USA

PostPosted: Tue Feb 24, 2004 8:51 am    Post subject: Reply with quote

Ed,

I put an link update request yesterday and it looks like they properly switched it to http://www.planamesa.com/neojava/download.php this morning.

I also made my error page and directory index page for the download directory point to the above URL to help funnel people back to the download page.

BTW, yesterday's bandwidth usage was 45 GB and today's is already at 12 GB.

Patrick
Back to top
View user's profile Send private message Visit poster's website
OPENSTEP
The One
The One


Joined: May 25, 2003
Posts: 4752
Location: Santa Barbara, CA

PostPosted: Tue Feb 24, 2004 11:45 am    Post subject: Reply with quote

Yup, it's sufficient to say that there's a bandwidth spike. Do you think your ISP will notice? Shocked My web server here has been into the hundreds of unique requests per hour, but aside from insanely great I haven't seen any other referrers. I don't know bandwidth useage from the other machines.

ed
Back to top
View user's profile Send private message Visit poster's website AIM Address
pluby
The Architect
The Architect


Joined: Jun 16, 2003
Posts: 11856
Location: California, USA

PostPosted: Tue Feb 24, 2004 12:17 pm    Post subject: Reply with quote

My ISP has definitely noticed, they keep chmoding selected directories and files with no read permissions.

Right now, I am putting in a hacky cron script that will swap in a "maximum number of connections exceeded" error page if it appears that I am hogging all of the web servers processes.

Hopefully, that will help.

Patrick
Back to top
View user's profile Send private message Visit poster's website
OPENSTEP
The One
The One


Joined: May 25, 2003
Posts: 4752
Location: Santa Barbara, CA

PostPosted: Tue Feb 24, 2004 10:48 pm    Post subject: Reply with quote

While the binaries are of course still a problem...

If you need to offload images or static pages feel free to dump them onto the web server here. Thus far it's been able to survive just about everything except a full on slashdotting, mostly because all the pages are static.

Another trick I've thought of using is to actually just do an http redirect into the google cache, but it takes a long time for changes to get incorporated into it.

ed
Back to top
View user's profile Send private message Visit poster's website AIM Address
Luke
Captain


Joined: Sep 08, 2003
Posts: 63
Location: Teesside, UK

PostPosted: Fri Feb 27, 2004 6:03 pm    Post subject: Reply with quote

I wrote
Quote:
I've set up a BitTorrent for the Neo/J 8.1 .dmg. The page for it is
http://www.torrentz.com/torrents/view_1402

The direct link to the .torrent file is
http://www.torrentz.com/torrents/download_1402


This is now superseeded by schlum_macbidouille's torrent, see

http://perso.wanadoo.fr/schlum/NeoOfficeJ-0.8.1.dmg.torrent

Whether this gives any relief to the main download sites depends, of course, on people using it. So long as normal downloads are avalable at reasonable rates, no-one is gong to use BitTorrent. With only me uploading, the best a single downloader is going to get is about 30k/sec. But each additional downloader adds (most of) their upload capacity to the system, so a few people wth fast links downloading the file would make it fast for everyone.

If you already have the .dmg file and would like to help others to get it, make a copy of it in case of trouble, then get the .torrent file and start a new download, making as if to overwrite the file you already have. It will NOT be overwritten, though, just checksummed against the info in the .torrent file and then uploaded. If you have a firewall up, you will need to open ports 6881-6889 for TCP

If you want to find out about BitTorrent, look at

http://bitconjurer.org/BitTorrent/

OSX version can be downloaded from Sourceforge

http://prdownloads.sourceforge.net/bittorrent/BitTorrent_OSX_3.3a.dmg?download

Happy downloading - the more the better!

Luke


Last edited by Luke on Sun Mar 07, 2004 4:42 pm; edited 2 times in total
Back to top
View user's profile Send private message
schlesi
Oracle


Joined: Jun 07, 2003
Posts: 234
Location: near Cologne, Germany

PostPosted: Sat Feb 28, 2004 7:12 am    Post subject: Reply with quote

Luke,

I'm the guy who has started the second Bittorrent-client. Wink

Thomas
Back to top
View user's profile Send private message AIM Address
OPENSTEP
The One
The One


Joined: May 25, 2003
Posts: 4752
Location: Santa Barbara, CA

PostPosted: Sat Feb 28, 2004 10:49 pm    Post subject: Reply with quote

OK, torrent dudes, trinity's on a static IP so I should be able to host any .torrent files for us. Do you know of a good link where I could read up on how to configure apache to host .torrent files?

Next time we do a major link I'd love to have that torrent link ready and can let one of my spare computers run the initial client connection, even if on a slow link Smile

ed
Back to top
View user's profile Send private message Visit poster's website AIM Address
schlesi
Oracle


Joined: Jun 07, 2003
Posts: 234
Location: near Cologne, Germany

PostPosted: Sun Feb 29, 2004 1:19 am    Post subject: Reply with quote

Ed,

configuring Apache for Bittorrent is very easy. Put this line to your httpd.conf: AddType application/x-bittorrent .torrent

A website with more information is here, for example: http://userpages.umbc.edu/~hamilton/dessentgooglecache61.html .

Thomas
Back to top
View user's profile Send private message AIM Address
Display posts from previous:   
This forum is locked: you cannot post, reply to, or edit topics.   This topic is locked: you cannot edit posts or make replies.    NeoOffice Forum Index -> Mirrors All times are GMT - 7 Hours
Page 1 of 1

 
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You cannot download files in this forum

Powered by phpBB © 2001, 2005 phpBB Group

All logos and trademarks in this site are property of their respective owner. The comments are property of their posters, all the rest © Planamesa Inc.
NeoOffice is a registered trademark of Planamesa Inc. and may not be used without permission.
PHP-Nuke Copyright © 2005 by Francisco Burzi. This is free software, and you may redistribute it under the GPL. PHP-Nuke comes with absolutely no warranty, for details, see the license.
Page Generation: 0.03 Seconds