Points-to-3D: Structure-Aware 3D Generation with Point Cloud Priors