It's interesting how two different perceptions of the same event will change one's opinion. I don't like baseball's free agency because it involves so many moving parts, which is exactly why it seems to intrigue you. I definitely prefer the NBA and NFL's trade markets as they are much easier to follow.
I grew up pretty heavily invested in baseball playing it in high school and working to earn a scholarship in college. When that dream didn't materialize I pretty much stopped paying attention to the game. I can't remember the last time I watched an entire baseball game on TV.
It's a lot to sit through unless good teams are playing, but a lovable game nonetheless.