However, how can Superman remember when he lived on Krypton?
Definitely explanation intended for the reader, and I think you're right, it's a bit clunky to have Superman himself do the explaining here. I think that bit of dialog needs to be chalked up to speculation on his part, as everything clicks together in his mind.