Your duty is to be as happy as possible in this life. Invariably we get entangled with people that don't bring happiness lightness and joy for various reasons like not like being alone.