Ben

I would say Garp and Roger are the only real one on this list, half of which was just Luffy and most that were so one sided that calling it a rivalry is a stretch at best...