You're not inconveniencing others if you say no. You're actually doing yourself a favour. Set boundaries and never feel guilty about doing so.