Complexity and Cooperation in Q-Learning