In this paper, a post-earthquake damage assessment method for 11 different structural systems is proposed. The method is mainly based on residual inter-story drift ratios of all structural elements in the building, an important response parameter due to its simplicity of measure after the earthquake. nearly 2000 test specimens representing structural elements characterized by different structural systems (walls, frames, etc.) and materials (masonry, reinforced concrete, and steel) which were tested under quasi-static cyclic loading provided more than 100,000 data points that were used to correlate the residual drift ratio and damage states in structural elements. The damage severity of each structural element was then determined based on the weighted average of each damage state's exceedance probabilities given a residual drift ratio. The method also considers the damage propagation among different structural elements by considering the weighted average overall damage scores in structural elements concerning their load-bearing contribution. The pre-earthquake condition of the building and the level of experienced earthquake intensity is the other input parameters for the proposed method, which finally leads to the building's overall damage score. To verify the accuracy of the proposed method's results, an example building hit by the Ezgeleh earthquake is evaluated, and the results are compared with those of other post-earthquake damage assessment methods.