[TUHS] TUHS: Maintenance, Succession and Funding

[Steffen Nurpmeso via TUHS]

Arnold Robbins via TUHS wrote in
 <202604190850.63J8oPJE013164 at freefriends.org>:
 |I'm still working my way through this thread. I do want to point out
 |that it's trivial for any individual to mirror TUHS; you just need
 |rsync and about 13 Gig of space.  I've been running a script to do
 |so, weekly, for decades.
 |
 |----------- cut here -----------------------
 |for i in Applications Distributions Documentation Tools Unix_Usenet
 |do
 |        if [ ! -d $i ]
 |        then
 |                mkdir $i
 |        fi
 |done
 |
 |rsync -avz minnie.tuhs.org::UA_Root   .
 |rsync -avz minnie.tuhs.org::UA_Applications     Applications
 |rsync -avz minnie.tuhs.org::UA_Distributions    Distributions
 |rsync -avz minnie.tuhs.org::UA_Documentation    Documentation
 |rsync -avz minnie.tuhs.org::UA_Tools            Tools
 |rsync -avz minnie.tuhs.org::Unix_Usenet         Unix_Usenet
 |----------- cut here -----------------------

I actually wrap it all in git, too

  #!/bin/sh -
  cd $(dirname $0)/tuhs.rsync/tuhs || exit 11
  su tuhs -s /bin/sh -c '
  umask 0002
  rsync -avz www.tuhs.org::UA_Root                .
  rsync -avz www.tuhs.org::UA_Applications        Applications
  rsync -avz www.tuhs.org::UA_Distributions       Distributions
  rsync -avz www.tuhs.org::UA_Documentation       Documentation
  rsync -avz www.tuhs.org::UA_Tools               Tools
  rsync -avz www.tuhs.org::Unix_Usenet            Unix_Usenet
  cd ..
  git add .
  git commit -m $(date +%FT%T)
  git gc
  '

I had asked Warren -- many programs use snapshot approach to go
git, Dickey with lynx and vile and more, and you did too, if
i recall correctly, with pcc, before Anders Magnusson went from
CVS to git directly -- but he was not interested.

It would surely add a layer of confidence into the mirrors, as the
commit hash could be tested (not to talk about signatures).
I would be astonished if it wouldn't reduce network traffic for
"serious" mirror syncs.

And with (even easily scriptable) confidence the load of TUHS
itself could or would be distributed a bit -- i myself would stop
pushing minnie if i had such a "second tier" available, but when
i started mirroring, like you, most addresses of Warren's mirror
list were dead or broken, until i stopped looking.

And not to end that it saves quite some space, since duplicates
(for example the entire of BSD 2.11 happens twice, plus even more
traces here and there, *if* i saw that right once i looked) would
go down the Plan9 venti (fossil?) road.

  /dev/vda20               19.5G     11.8G      6.7G  64% /media/tuhs

^ "checkout"

  /dev/vda21               19.5G      8.7G      9.8G  47% /media/tuhs/tuhs.git

^ .git "DB" (note we have seen massive new entries plus BSD 2.11
duplication, which is not yet "gc --aggressive"'ite away ever
since i did the original git checkin).

  /dev/vda12                1.9G    954.1M    892.3M  52% /media/tuhs/tuhs.rsync/bin
  /dev/vda12                1.9G    954.1M    892.3M  52% /media/tuhs/tuhs.rsync/lib
  /dev/vda12                1.9G    954.1M    892.3M  52% /media/tuhs/tuhs.rsync/usr/bin
  /dev/vda12                1.9G    954.1M    892.3M  52% /media/tuhs/tuhs.rsync/usr/lib

I was about to offer

  Match User tuhs
        DisableForwarding yes
        PasswordAuthentication yes
        AuthenticationMethods any
        PermitEmptyPasswords yes
        PermitTTY yes
        ChrootDirectory /media/tuhs/tuhs.rsync
        ForceCommand internal-sftp -d tuhs -R

and such, but it surely was a stupid idea.  Anyhow, rsync not me,
i also thought about

  Match User tuhsrsync
        DisableForwarding yes
        PasswordAuthentication yes
        AuthenticationMethods any
        PermitEmptyPasswords yes
        PermitTTY no
        ChrootDirectory /media/tuhs/tuhs.rsync
        ForceCommand /usr/bin/rsync $SSH_ORIGINAL_COMMAND

but do not think that flies.

--steffen
|
|Der Kragenbaer,                The moon bear,
|der holt sich munter           he cheerfully and one by one
|einen nach dem anderen runter  wa.ks himself off
|(By Robert Gernhardt)