I think that you have got it all wrong. When he took his hand off the wheel he was just reaching for his harpoon. Whale season is coming up didn't you know?
Seriously though, I've had a similar thing happen to me. There was no reason for it, just felt like I was being baited. As long as you do the right thing and take down the details like you have you should be sweet. Hopefully this is the only time it happens to you otherwise you end up looking over your shoulder everytime you take the car out.