Disabling external access, general users to ECP

I want to disable internet access to ECP.

Can I simply remove the external URL in the virtual directory to turn off external access?

How can I turn off access to general users so only a handful of accounts can access the ECP?

Thanks