Using ejected stars to constrain the initial conditions of young star-forming regions