The source material which RoP draws from is Tolkiens manuscripts, which weren't finalised into a finished book.
The story of the Istari differ over time. Tolkiens earlier writing have 5 wizards arriving in Middle Earth all in the 3rd Age, later writing have the blue wizards first appear in the 2nd Age. For example.
