Cutting safety inspections 'puts millions at risk' say unions