Wormhole Memory: A Rubik's Cube for Cross-Dialogue Retrieval