Is it safe to give Power of Attorney to your broker to operate demat a/c?

I am about to open a new trading account with a broker and see that there is a form of PoA in nearly all account opening filling forms.

Is this a norm? Is it safe? If I give PoA to broker then he can debit my shares whenever he wants!