The defining characteristic of gymnosperms is the presence of naked seeds. They are vascular plants and include forms like conifers, cycads, ginkgo, and gnetophytes.