It's important to realise that bullies are actually fearful people. Sure, on the outside they may appear tough, but inside they are full of self-doubt. It's likely that whatever they are trying to get you to do they are afraid to tackle themselves. Their defencees can make them abrasive, rude and inconsiderate.
Recognising their weakness allows you to support them, without being exploited in the process. Think of ways to build their own self-confidence, perhaps by suggesting you work together. Praise their efforts and acknowledge their success. As you help them you will discover your own self-confidence growing.
Of course, if matters have got out of hand, you may need to involve others to deal with antisocial or worse behaviour. There is no way anyone should put up with violence, whether physical or verbal. If those responsible are unwilling to deal with the situation or incapable of taking appropriate action, you can seek professional advice. The law is on your side.
Be aware that there's no point in simply complaining. You are not a powerless victim - unless you choose to be. Tackle the problem with those who are responsible. It's OK to stand up for yourself. If you don't, who will?