Making Semiconductor Single Photon Emitters Faster And Brighter