I want to switch CallerID on and off with just one click.

Go to your device’s Widget menu, and drag the CallerID icon to one of your home screens. With one click you can turn Caller ID on or off. For advanced options it is necessary to go into the app.