Flumeview-reduce

a first pass sketch

Sttory: as new messages are added to the main database, they are passed to any 'flume views' attached to the database. A flumeview of the reduce type allows you to open up each message as it it passed in, and select relevant parts (the map) and then add those to some big data strucutre (the reduce). Later you can get the current state of that big data structure back, or stream it (if you need to have live updates)

You can extend this story by adding:

• examples of good uses for flumeview-reduce
• what the type of view excells at / is weak at
• exmaples of where it's used right now

cc #flume #flumedb

cc @aljoscha