I am fully understand what is the case as my wife also complained me about my attitude to her families. If you think your families is more important than your husband then go. No one can stop your action but be considerated and never regret afterward.