People in poverty must not pay the price for Brexit, say charities