I had the same problem with my pear tree until I actually pruned the darn thing back. Unfortunately I don't know much about plants lol. I should learn more :P
Ivy