Efficient Adaptation of Deep Vision Models