Multi-Modal Manipulation via Multi-Modal Policy Consensus