You might trust your immediate peers not to keep track of when they received new messages from you [...]
I just realized that sbot does track exactly that, as it provides methods to query based on receive order. Or does it only store the relative order instead of local timestamps (local timestamps are a completely fine thing to use btw, it's only global ones that are problematic)?