You can buy older hardware online and save money while still upgrading. As the new stuff comes out the older stuff usually gets it's prices adjusted.
One thing to never buy used though is graphics/GPU cards and memory.