As soon as he left the Calgroth's shop, Kenji immediately went back to the inn briefly. He decided to drop the children there, as he no longer wanted to take them on any of his dangerous quest, especially one like this one, where he would be facing humans with powers!
The situation of the last quest had already left a small scar in his heart and he knew that he could never let such happen again, for him to see them crying over him again.
No! That must never happen again!
So the moment he arrived back at the inn, Kenji dropped them and promised to be back as soon as possible.
And as he left them sitting at home with a game board that he had bought while passing through the market, so as they wouldn't get too bored without him.