So say if people decided to boycott one of the voting bots and their activity dropped to 0 then the APR would also drop to 0.

Yep. But the STEEM/SBD price still matters because it determines the vote value and some services are more profitable for vote buyers and some less. Also the important factor is how much in fees the services takes.