"The technique of shaping is used in training animals; a
teacher presents very simple problems to solve first, then gradually
exposes the learner to more complex problems. Shaping has been used in
supervised-learning systems, and can be used to train hierarchical
reinforcement-learning systems from the bottom up, and to alleviate
problems of delayed reinforcement by decreasing the delay until the
problem is well understood." (Kaelbling, Littman, and Moore, 1996)
publications