From Hot Jupiters to Super-Earths: An Exploration of Exoplanet Atmospheres with Space-Based Telescopes