Its not really attached by anything. Like I said it's just a rubber-like tube around the metal handbrake itself. I suppose when they first put it on it was greased or something to make it slide on, but I found it very difficult to get it off without cutting it. Someone else might have a better idea.
I replaced mine with an aftermarket one anyway, so I wasn't bothered.