[TUHS] block operations in editors, was My EuroBSDcon talk
Jon Steinhart
jon at fourwinds.com
Wed Sep 18 14:52:24 AEST 2019
Steve Johnson writes:
> This is one of my pet peeves. "Random Access" memory is far from random when
> you look at the time it takes to do the accesses. With modern memories,
> accessing a column can be 20 to 40x slower than accessing a row. This is
> particularly irritating when doing AI training, where training reuses 4-d
> tensors transposed, a very painful operation.
>
> In FORTRAN days, I once used a vector package in which you described a vector
> by giving the first element, the second element, and a count. So you could
> describe rows, columns, a matrix diagonal, and even rows and columns from back
> to front. Fortran passed arguments by address, which made the whole thing easy
> and fast.
>
> Steve
Remember the words of that great performance pioneer Jimmy Durante: ras-a-ma-cas.
More information about the TUHS
mailing list