I wouldn't say they talk about the second character all the time, but yeah, they do a good amount. It's not too bad if the other character is actively played, because you'll get to hear interesting things sometimes. Like if the villagers ask you what your favorite food is and you tell them, then the second character will end up hearing about that at some point.