Phew.
As it happens, you got lucky this time, because we do need that duplicate layer. You need to apply some Gaussian Blur to it - just enough to get rid of the distinct fabric lines, eg around your hand. I think about 0.6 will do.
Then mask that layer too.