Discussion:
Howto add 1000 newsgroups at a time ?
(too old to reply)
Jeffrey M. Vinocur
2003-07-11 11:33:28 UTC
Permalink
can anybody tell me how i add 1000 newsgroups at a time ?
I'm not sure exactly which "how" you mean, but:

- You can generate `ctlinnd newgroup` commands yourself in any fashion
you like, or you may prefer to use actsync (which can use files to
sync against).

- Large quantities of newgroups at once can make the load spike, I
think you can send those commands while the server is throttled
(with ctlinnd) and get it to go faster.


--=20
Jeffrey M. Vinocur
***@litech.org
Pavel V. Knyazev
2003-07-11 11:38:16 UTC
Permalink
Doesn't ctlinnd newgroup work for you? :-)

#!/bin/sh
for group in `cat /path/to/new/newsgroups/toadd`
do
{
ctlinnd newgroup $group y ***@domain;
}
done

Run "ctlinnd throttle System paused" before adding newsgroups.
Here, toadd is the list of newsgroups, just the names.

If you are about of adding 10000 newsgroups and more,
try this out instead of using ctlinnd, it'll save up your time:

awk '{ print $1 " 0000000000 0000000001 y" }' newsgroupslist >> active

Also, don't forget to throttle your server before doing that.
Reload active when finished.

The second way is less correct, thought (think about duplicates).
Don't use it unless you know what are you doing.

--
Pavel V. Knyazev


----- Original Message -----
From: "Ingo Eisenkrämer" <***@hsl.com>
To: <inn-***@isc.org>
Sent: Friday, July 11, 2003 5:16 PM
Subject: Howto add 1000 newsgroups at a time ?
Hello,
can anybody tell me how i add 1000 newsgroups at a time ?
Ingo
bill davidsen
2003-07-14 20:06:31 UTC
Permalink
In article <***@exchange.serv01.hsl.com>,
Ingo Eisenkrämer <***@hsl.com> wrote:
| Hello,
|
| can anybody tell me how i add 1000 newsgroups at a time ?

1 - throttle
2 - add groups with ctlinnd
3 - unthrottle

You can get away with pause on small bunches, you can try it if your
peers don't get upset with hung connections on big batches like this.
--
bill davidsen <***@tmr.com>
CTO, TMR Associates, Inc
Doing interesting things with little computers since 1979.
bill davidsen
2003-07-17 18:09:45 UTC
Permalink
In article <***@isc.org>,
Katsuhiro Kondou <***@isc.org> wrote:
| In article <bev201$p88$***@gatekeeper.tmr.com>,
| ***@tmr.com (bill davidsen) wrote;
|
| } 1 - throttle
| } 2 - add groups with ctlinnd
| } 3 - unthrottle
| }
| } You can get away with pause on small bunches, you can try it if your
| } peers don't get upset with hung connections on big batches like this.
|
| I'd use actsync, since it may take so much time to wait
| for the completion if newsfeeds includes a lot of wildmat
| patterns.

Unfortunately I don't always really sync things ;-( I have a group list
on the master, but various reader machines have subsets. I wrote a ittle
perl script to read the master active, the current active, and a
"blocked groups" list, then generate a shell script to do the changes.
It actually generates one script for INN, and another active.control for
Twister and family.
--
bill davidsen <***@tmr.com>
CTO, TMR Associates, Inc
Doing interesting things with little computers since 1979.
Jeffrey M. Vinocur
2003-07-17 18:57:50 UTC
Permalink
Post by bill davidsen
Unfortunately I don't always really sync things ;-( I have a group list
on the master, but various reader machines have subsets. I wrote a ittle
perl script to read the master active, the current active, and a
"blocked groups" list, then generate a shell script to do the changes.
It sounds like actsync with an appropriate ignore file would be just fine
for this purpose. Did you find it didn't meat your needs somehow?
Post by bill davidsen
It actually generates one script for INN, and another active.control for
Twister and family.
Ok, well, that might be a litter harder to do! (Although, I bet you could
get actsync to generate the list of changes, and just have a little work
to massage the format.)
--
Jeffrey M. Vinocur
***@litech.org
Loading...