I love him! His songs are really cute & funny, and I look forward to them every time. I think he is certainly the whimsical old sailor, and he does love his wife.
I think it's flattery, and playful--because your character design is meant to be aged somewhere between a kid & young adult--the "older" characters call you a whippersnapper & such...I think you are meant to be quite young.
And NO...before people use that as an excuse to paint a creepy figure out of him..."oh quite young, that makes it WORSE!" blah, blah, blah...
I reminds me of NORMAL older family members who boost their daughter/niece self esteem by saying how pretty she grew up to be & jokes that don't translate well written down, but in the context of self-confidence boosting it's actually quite normal and nice.
But thanks to real creeps, people these days are ultra paranoid that everything is creepy, even an innocent sea-turtle.

It's truly reading too much into a G-rated game, where all the characters are designed to put a smile on your face.
I understand as I've known some horrible men in my life, but it doesn't mean all perspective has to be warped to make any affection from a male, even an animated turtle suddenly creepy.
But I can understand, if something makes you uncomfortable, it makes you uncomfortable, and that's completely valid.