I think it was Sir Alf Ramsey who once said 'It is better to have loved when lost than to have never lost anything at all'. 

Well, I'm not sure what he was talking about specifically there, but it sounds like he was suffering from some level of Regret. 

Regrets are not your fault, and they will get in you in the end. So accept it, and move on.