update: wrote a script to convert currently base64 ids into buffers. I know @aljoscha is planning to give these types, so I added placeholders for that.
my full json format log.offset
is 503 mb. converted to bipf, keeping ids as base64 strings is 440mb (takes 34 seconds), and converting them to buffers is 355 mb (but takes 48 seconds).