Orwell is using the phrase "a puny wisp of a man" to describe someone who is weak, small, and insignificant. It suggests that the person is physically and perhaps also mentally frail, lacking in strength and presence. Orwell may be using this phrase to emphasize the person's lack of power or influence in a particular situation.