This paper aims to implement a system that continuously adapts to changing environments and tasks in continuous learning robots. Unlike existing approaches, we present a generative framework that improves model alignment by transforming planned actions themselves, rather than navigating using misaligned models. This framework utilizes flow matching to align robot dynamics models online. This allows the robot to more efficiently gather information-rich data, accelerate learning, handle evolving and potentially incomplete models, and reduce reliance on replay buffers or existing model snapshots. Experimental results using unmanned ground vehicles and quadrotors demonstrate the adaptability and efficiency of our method, achieving a task success rate 34.2% higher than existing methods.