This paper presents a four-channel bidirectional control system for high-speed remote manipulation using a low-cost manipulator. While conventional one-way control methods have difficulty in high-speed or contact-intensive tasks due to the lack of force feedback, the system in this paper provides force feedback through nonlinear term compensation, velocity and external force estimation, and variable gain control according to inertia change based on the manipulator dynamics model without force sensors. In addition, it shows performance improvement by integrating force information into the input and output of reinforcement learning policy using collected data. Through this, we emphasize the practicality of high-precision remote manipulation and data collection with low-cost hardware.