I think we need to go as far as to implement a 'delete feed' option for scuttlebutt to handle these trolling episodes in a complete way.

I'm not familiar enough with flume to implement this myself right now, but I'll start poking around in the code and see if I can get closer to understand how to implement it. Do you have any idea how to do a 'delete feed and reindex' quickly @dominic?

We're going need to be able to clean up our scuttlebutt databases in the future, for legal reasons as well as personal.

@ev yes, this would be great. The simple way would be to pipe the flumelog into another instance of the log, but filtering out the feeds to be deleted. put that into another flume instance, and when it completes, move all the new flume files over the original (easy since it's all in one directory) then reload the scuttlebot instance (which will regenerate the indexes). It would help a lot if more people understood flume in detail, so I'd be very happy to advise someone working on this.

The simple way would be to pipe the flumelog into another instance of the log, but filtering out the feeds to be deleted. put that into another flume instance, and when it completes, move all the new flume files over the original (easy since it's all in one directory) then reload the scuttlebot instance (which will regenerate the indexes). It would help a lot if more people understood flume in detail, so I'd be very happy to advise someone working on this.

@dominic, yes I think I fall into the camp of not understanding flume very well yet.

How long do you think it'd take you to knock out the 'delete feed and reindex' feature? Is this a five minute project for you, or would it take a few weeks?