Hybrid Decision Making via Conformal VLM-generated Guidance