On Tue, Jun 23, 2020 at 11:12:40AM -0400, Clem Cole wrote:
Rusty and team did the VFS layer Sun @ (Larry will
have to tell
you who actually built it, I never knew).
Steve Kleiman is the only author on the VFS paper so I'm guessing that
Rusty was NFS.
Joe Moran (sun!mojo if I remember correctly) did the VM implementation,
it was co-designed by Joe, Shannon, and Gingell.
Side story: part of the reason I wanted to go to Sun was because when
I was a CS student at UW-Madison, Joe was a little older than me, and
I sat and watched him do a BSD port to a 68K (I think) in a little more
than 24 hours (sketchy on the time, I think that's right, almost positive
it was more than 20 hours, it was a chunk of time). As a guy who wanted
to be next to the metal, it was impressive.
In the end, early NFS was
notorious for putting 'holes' in the files because of the automatic seek in
every operation and errors not coming until close(2) time.
You have no idea how many of those holes that 16 bit SCCS checksum has
found (BitKeeper kept it).
EFS used an RPC and a RUDP layer that Perry and Alan
Atlas built, but it
was not nearly as flexible as what Sun built [which had a crude interface
generator], although until years later when Mike Leibensger built PIG (the
Paceline Interface Generator) NFS RPC was always a PITA and not much better
in practice than what we had at Masscomp.
Oh, I don't know if I agree. I took the RPC mechanism and vectorized it.
I probably have the code somewhere. It was pretty neat, 10Mbit was the
common networking and I did RPC Vector calls to the rstatd on literally
every machine in the Mountain View campus. It was thousands of machines
and it worked. The code split the RPC back into send and receive and
the code had to start gathering up answers before it was finished
sending the questions or the packets would be dropped.
It worked surprisingly well. Ron Minnich and Gene Kim made an NFS client
that worked as demo-ware. There is a paper about below, note that I'm
co-author only because I wrote the RPC vector code, I believe Gene did
the in kernel code, it was Ron and Gene's project.
In fact, the point of the EFS paper was it's all
about the recovery when
there is a failure/error. If you read his paper, Rusty's point was who
cares if there is an error (I've always felt vindicated that while I lost
the war, over time everyone came to our way of thinking and now NFS
V4 looks a whole lot like EFS did).
Yeah, they were sort of cavalier about errors in public. The weird
thing is Sun ran their entire network on Sun machines. Everything was
NFSv2 when I got there, the routers were Sun workstations, the servers
were Sun servers, the clients were Sun workstations. They ate their own
dogfood and NFS just worked, it was pretty unheard of to hear about NFS
issues other than performance tuning (stupid biods etc).
Having a DFS as a feature was an incredible advance
and proved we needed
something (and it needed to be standard in all systems). NFS really lead
the market with that advance, although it sort of took a few years to make
it really good. The fact is that others had the same idea before or at
least contemporary with it.
NFS was solid in v2 at Sun. I went to SGI and NFS was complete garbage.
SGI's networking principle engineer told me, when I complained about
NFS not being reliable, "That's what rcp is for". I was flabbergasted,
the networking group generated $18M/year in NFS sales.
It wasn't just SGI, every vender other Sun had a crappy NFS implementation.
I'm surprised NFS didn't have a worse rep because while NFS worked on Suns,
it really didn't work anywhere near as well elsewhere.
That said, and to give the NFS team* a huge amount of
credit *(and great
applause), the VFS layer was better thought out than the FSS and in fact
made it possible to add a lot of different file systems into UNIX later.
FSS was much more ad hoc.
The VFS layer was Steve, NFS was Rusty.
At LCC, when we built VPROC for TNC a few years later,
we used some of the
same ideas from VFS and of course used VFS for the file system layer since
TNC had to have full POSIX semantics. (It's a shame VPROC never caught on
the way VFS did).
VPROC was very cool and a requirement for any sort of distributed single
system image OS. I agree it is a shame that it didn't catch on.