The purpose of this paper is to discuss path search of robots by reinforcement learning in the variable environment. Conventional reinforcement learning is assumed that the environment on where a robot works does not change. Therefore, a robot has to learn from scratch if it encounters new environments. An empirical study on the process of reinforcement learning is method.