You obviously haven't given enough information for anyone to give an informed opinion, so I'll tell you a bit about my brother.
My brother used to treat me like crap most of the time. I understood why, and that it had nothing to do with me, but it hurt, just the same.
There came a point when I'd had enough, and cut off all contact with him. Almost a year later I heard his voice on my answering machine. He said he had melanoma, an almost always fatal cancer. He died three years later.
While I'll never miss the crap he put me through, even at the very end of his life, I miss him so much it's unbearable. If I could have I would have given up my life so that he could have lived.
Try calling your brother on it whenever he does something that hurts you. Don't let things slide. He can't know he hurt you unless you tell him. When I finally made myself talk to my brother about some of the things he did, I discovered that he had no idea that he was hurting me.
Only you can decide how important having a relationship with your brother is to you, but I would urge you to try to work things out with him so you won't have regrets later.
.

