not the dye...THE BLEACH!!!
I use dyes that are more like stains not chemical box dyes...those ones are what REALLY kill your hair. The dyes I use are like a conditioner with color in it.
As long as I don't bleach too often and condition my hair I'm generally fine. My hair is naturally kinda course and thick so it usually recovers well from everything =)