It is argued that the evolution of the genetic apparatus must have required the abiotic formation of macromolecules capable of residue-by-residue replication. This suggests that polynucleotides were present even in the most primitive ancestors of contemporary organisms. Models which explain the evolution of the association between polynucleotide and polypeptide sequences are discussed.