This matches very much my experience when delving into flume.

The code also didn't have a fast path for the normal case where the data you need has already been read, but that that could be obscured by JSON parsing and block size, as you pointed out.

I'll have a look at the code tomorrow. Very good progress! I'm excited.