Can I filter leads or conversations by tag?

Absolutely. Just use the filter option in the leads or inbox view, then select the tag(s) you want to filter by.