No, you don't need to go to NG+ to improve your sword to maximum level. I'm at the beginning of the game and I have 1 level left for the longbow and 1 level for the katana, 1 level just to get them to maximum. I practically have the entire game to get enough resources to improve what's left.
