Great question! Not really, no. You only get the points if you're in your own body or, if you want to gain your own memories that's relevant. Like if you're swapped with someone and confess to murder, and you also committed a murder, why not get the murder memory point?