The most active class of platinum group metal-free (PGM-free) oxygen reduction reaction (ORR) electrocatalysts in acidic electrolytes are those synthesized by heat treatment of iron, carbon, nitrogen precursors (Fe-N-C). Due to the large number of possible precursor compounds, a small fraction of the synthesis variable space has been explored. Correlation of synthesis variables with Fe speciation and ORR activity has been limited. In this work, an automation platform and a multi-port ball-milling were utilized to evaluate the effects of synthesis variables, such as identity of iron precursor, iron loading, and carbon and nitrogen sources on the ORR activity of iron-nitrogen-carbon catalysts in acidic electrolyte. The ORR activity is correlated with catalyst Fe speciation determined using Fe K-edge X-ray absorption spectroscopy (XAFS).