Compared to the lithium-ion batteries using organic liquid electrolytes, all-solid-state lithium batteries (ASLBs) have the advantages of improved safety and higher energy density. Multilayered bipolar stacking in ASLBs can further improve the energy density by minimizing the use of inactive materials. However, it is highly challenging to fabricate bipolar stacked ASLBs because of lacking vigorous laminated electrodes and electrolyte, especially for sulfide solid electrolytes. This work successfully assembled bipolar stacked ASLBs with high voltage by facilely stacking freestanding and robust cathode, electrolyte, and anode sheets. More specifically, interface stabilized single-crystal LiNi0.8Mn0.1Co0.1O2, Li6PS5Cl, and nano Si act as cathode, electrolyte, and anode individually. Amphipathic ethyl cellulose plays a role as a disperser during ink preparation and further as a binder in the freestanding membranes. The doubly stacked ASLB delivers a high voltage of 8.2 V and cell-level energy density of 204 Wh kg−1 higher than the 189 Wh kg−1 of the mono cell.