The “one man” here refers to the poet as he is different from the others who loved the woman only for her external beauty but he loved her for her inner beauty and for her soul not for physical beauty. He proved that his love is true by waiting for her for a long time.