kiboze.pl - a news archiving 'bot
kiboze.pl [-hvd] [-V] [-Q] [-n newsrcfile] [-s newsserver]
This script connects to a news server (or set of servers) and archives the newsgroups specified in a newsrc file. This can be used to save entire newsgroups for later searches, just message archiving.
Without any options, kiboze.pl will connect to each of the news servers specified in turn, and attempt to download up to 1000 articles (or whatever the current value of $MAXARTS is).
After configuration, set up your crontab to run the script periodically. A sample crontab line, which runs every four hours:
# Run kiboze.pl 0 0,4,8,12,16,20 * * * /home/tskirvin/news/kiboze/kiboze.pl
Disk space requirements will vary depending on how many groups you're archiving; I've been archiving a local hierarchy (cmi.*) for about four years now and have saved a few hundred megabytes worth of articles, but it would be a lot worse to get a large hierarchy.
If you want to use NNTP authentication to connect to your news servers, create a file ~/.nntpauth that has lines like this:
news.server.com.invalid username password news.server2.com2.invalid username2 password2
Requires Perl 5.004 or better, News::Newsrc, and News::Article. All other requirements should be included automatically with Perl5.
Make some default newsrc files if one doesn't exist. Start using an active-file type dealie, to increase efficiency by a whole lot and allow the various servers to work together. Make some more scripts to search the cache file by message-id. Add locking stuff.
Note that most of this stuff should be taken care of in Version 2.
Tim Skirvin <tskirvin@killfile.org>
http://www.killfile.org/~tskirvin/software/kiboze/
Copyright 1999-2004 Tim Skirvin <tskirvin@killfile.org>. This code may be distributed under the same terms as Perl itself. =cut