I agree, it very much has to do with a mental, emotional, physical and spiritual connection. For me, I believe that you should get to a super strong connection with your partner to the point where you don't need anyone else before considering to go the poly route. That's just my perspective.
Thanks so much for the kind words @anamena92!