What is the time complexity of your algorithm?

As for your problem, without having fully understood the details, maybe you can split the graph into nodes that can never be touched by unfollow/block and the ones that can, and only run your algorithm on the path that can be affected. That would work well, unless the block is in a central part of the graph, but still should be much better than doing the whole graph.