By default, Holiday is the only Leave Type which is deducted from holiday allowances.
However, if you need to also deduct from allowances for Public Holiday, you can change this in your Account settings.
Click the Cog icon and go to Settings. Scroll down to Leave, and tick the box labelled "Public Holiday will be deducted from holiday allowances". Then click Save.