Perhaps, though evolution has a way of dealing with this too. Testosterone plummets among less fit males who are overlooked by women. Instead of becoming more aggressive against women they usually become less. It's the alpha males who have the highest testosterone levels. Lessor males usually submit.