Analysis Of Data Efficient And Budget Restricted Model Sparsity Training With Mixture Of Experts