The evidence of climate variability among developing countries has stressed agriculture sector. Promoting sustainable development will create an opportunity to enhance the rural livelihoods that are prone to frequent climate shocks. The present study estimates the climate change impact on three crop yields (Rice, Maize and Finger Millet) using fine scale climate dataset constructed at regional context for 20 districts over 21 years (1992–2012). Fixed effect panel regression method was used to examine change in crop yields to climate response. The results indicate consistently negative impact of temperature on crop yields. The regional dimension specified in the study suggested special attention for semi-arid and arid region as the magnitude of impact is significantly large.