Looks like this feature does not vault your cash. If you hit the button and collect everything that money does not immediately show up in your vault screen sometimes. There can be a delay of several seconds so if you go merrily off thinking you cash is safe it is not.
Also, this feature will collect all your money buildings including raided ones even though if you manually collect leaving raided buildings the button will disappear after you have collected your last raided building. For those leaving their buildings raided beware.