It could do if you let it, definitely. It would be easy for one or both people to get fixated on the enjoyment of sex with strangers. Time together, alone, is vitally important and keep swinging as an extra.
It can sometimes feel like it's taking over when you first start, always on here always going to clubs etc. But with all good things in life there must be balance.