Your phone's microphone can be turned on remotely and tapped. Only removing the battery seems to be able to prevent this from happening.