Your pastor is functioning as a servant of God’s Word.  He is at all times to convey what God’s Word says to you.  According to the Bible, Jesus will hold him accountable if he wrongfully advises you about what God says. Your pastor is not worthy of your faith (they are sinful humans), but they represent the God who is worthy of your faith.