I'm sure it's not this way for everyone, but for me, violence isn't really worth it. Not when the opposing party is against me personally, anyway. If people try to belittle me, hurt me, or whatever in any way, I usually try to find other solutions to the problem. Verbal assault, reporting it, or running like hell being just a few examples. I could never be taunted into a fight because, frankly, I know I'm a coward and I'm proud of it. The risk of getting myself physically hurt is more important to me than others' opinions, words, and actions, because I'm a pretty self-centered individual for the most part.
Now, when someone's messing with the people I care about, it becomes a different issue altogether. I'm not trying to sound all chivalrous and crap, but seriously; you got a problem with me, fine, but don't get others involved into the mess. Cowardly as I am, I tend to get really mad when my friends are in trouble, and my rationality is replaced with a fist or two.
For me, it's a matter of a 'better solution' than violence instead of an opposition to violence. I frown upon those who get into needless fights and hurt others for no good reason, however if there really was no alternative or if I understand how they feel, I would agree with their decision.