People just enjoy cycling as a hobby and I don't think it is ruing the relationship of people. I ride a lot as it is my passion but I always find the time for my family members. I enjoy spending time with my kids and my wife. You just have to manage the time for maintaining a perfect relationship.
Creating time for the family is really necessary and making them realize that you truly care is the best way to make things work out. I've been riding for some years now and it's been great for me.