In hafnia-based thin-film ferroelectric devices, chemical phenomena during growth and processing, such as oxygen vacancy formation and interfacial reactions, appear to strongly affect device performance. However, the correlation between the structure, chemistry, and electrical potentials at the nanoscale in these devices is not fully known, making it difficult to understand their influence on device properties. Here, we directly image the composition and electrostatic potential with nanometer resolution in the cross section of a nanocrystalline W/Hf0.5Zr0.5O2−δ (HZO)/W ferroelectric capacitor using multimodal electron microscopy. This reveals a 1.4 nm wide tungsten suboxide interfacial layer formed at the bottom interface during fabrication, which introduces a potential dip and leads to asymmetric switching fields. Additionally, we compare the measured potentials to DFT calculations and find it is nearly 3 V lower than expected in the HZO, which appears to be caused by oxygen vacancies and a resulting negative built-in potential. These chemical and electrostatic details are important to characterize and tune to achieve high-performance ferroelectric devices.