We mostly skip over those details because we’re working to catch up to the current state of the stories, but he would be a little older each time. 

Everyone regains their memories of the Lounge when they reenter it, and loses them when they leave.