New Algorithms and Analysis Techniques for Reinforcement Learning