A graphene-Au nano-pyramid hybrid system that enables label-free single molecule detection is demonstrated. The bio-compatible graphene-based SERS platform boosts a high density of hot spots with local SERS enhancement factor over 1010. We demonstrate that graphene can play a key role in quantitative study of SERS mechanisms, and can also serve as a promising building block in SERS active structures especially for biosensor applications.