You can wire it up so the power is only on when the input jack is inserted, just copy one of the wiring diagrams at General Guitar Gadgets or whatever. I never bother doing that though because I only ever use a power supply and that is only really useful for batteries.
Like all pedals, the power is supplied all the time whether it is bypassed or not.