Exactly, multiple people can be in a dream town it doesn't really matter because you're not going to meet anyone there besides the people who actually live in that town.
My sister lives in a different town than me, and we sometimes visit the same dream towns at the same time. We can't see eachother, but it's kind of fun to talk about the town ( through our ds) while we explore.