This paper addresses the planning problem of mobile robots, which requires the temporal and logical execution of multiple high-level subtasks expressed in natural language. We present an LTL-NL framework that formally defines tasks by treating subtasks as atomic predicates in linear temporal logic (LTL) formulas. To achieve this, we propose HERACLEs, a hierarchical neural symbolic planner that solves natural language-based atomic predicate problems that cannot be solved by existing LTL planners. HERACLEs uniquely integrates (i) a conventional symbolic planner that generates high-level task plans, (ii) a pre-trained large-scale language model (LLM) that designs robot motion sequences based on these plans, and (iii) a consensus prediction that serves as a formal interface between (i) and (ii) and manages uncertainty due to the incompleteness of the LLM. We demonstrate theoretically and experimentally that HERACLEs can achieve a user-defined mission success rate, outperform LLM-based planners, and offer improved user-friendliness compared to existing symbolic approaches.