All Vertebrates have notochord during embryonic development. Later it is replaced by the vertebral column. But in lower chordates like prochordates, vertebral column is not present. They have only notochord in the adult or larval stage. Hence it is said that all vertebrates are chordates but all chordates do not have vertebrate characters
