As you grow and improve in your sport or your performance, the more difficult it becomes to improve.  The more elite you are, the smaller the gains are.