The more instruments you take on, the harder it gets. There's only so many hours a day, and it can be real tricky to balance a practice schedule across multiple instruments.
With that said, drums are the best one, so you're making the right move :-D
I'm just dabbling. I'm more interested in guitar but I want to experience them all as I have some ideas about making music so getting the basic and understanding is important for me. who knows I might just drop music all together in a few years who knows :D