. . .
Note that removing your Web History also pauses it. Web History will remain off until you enable it again.
[UPDATE 2/22/2012]: Note that disabling Web History in your Google account will not prevent Google from gathering and storing this information and using it for internal purposes. It also does not change the fact that any information gathered and stored by Google could be sought by law enforcement.
With Web History enabled, Google will keep these records indefinitely; with it disabled, they will be partially anonymized after 18 months, and certain kinds of uses, including sending you customized search results, will be prevented. If you want to do more to reduce the records Google keeps, the advice in EFF's Six Tips to Protect Your Search Privacy white paper remains relevant.
If you have several Google accounts, you will need to do this for each of them.
There's more at the link, including detailed instructions on how to clear your Google search history. I highly recommend that anyone who's security-conscious and/or concerned about online privacy should follow them.
I think we owe a vote of thanks to the EFF for bringing this matter to our attention.