You are reading content from Scuttlebutt
@Dominic %Vq60k4fWMn6mNq62LLw0pzTf4EmLSHHmvumTti6g5Bc=.sha256
Re: %Gs2NhjWxb

@keks the high perf "stream" measurement actually parses the same flumeview-offset format. The problem is that the main implementation isn't very good. mmap or seek and read. I read into fixed size, aligned blocks. (hence why I could parameterize the block size) and then read the records out of that. In the current format sometimes a record overlaps two blocks.

I do have an idea for a format that always aligned records to the start of the block (with a empty gap at the end). This would probably be easier to implement than dealing with overlaps, anyway.

But the main thing here, is just creating a lighter implemenation than the current one.

Join Scuttlebutt now