At first glance, the two photos you've chosen do look like good donors for each other. The trouble is, you can't swap then enlarge - the swapped bit gets blurry. So you can swap from the first to second photo, but not from second to first.
The only way you could swap from 2nd to 1st is if you were prepared to add fake background blur to the whole photo afterwards, to disguise the issue, you know?