Another thing you need to mention is that you should do this side quest ASAP. I progressed my story up until the quest to Old Lumiere. I had decided to back track a bit to see if I missed anything and do some XP farming. Once I found the blue mushroom (by accident), which spurred my memory that someone was looking for it. When I arrived in the village to give Karatom the mushroom, and I'm trying to keep this spoiler free, he did not even acknowledge the quest. I had progressed too far in the game.
