One well-known approach to solving reinforcement learning problems is
to search in value function
space; this usually accomplished with temporal difference methods.
Evolutionary algorithms, on the other hand, search in policy space and
can be applied
to reinforcement learning problems as well.
publications