At level 50 you're only taking 250 mafia into battle, so you could get rid of half your mob if you really want to and your stats shouldn't be affected.