In order to exactly identify the variation and the controlling factors of shallow groundwater over-exploitation in North China Plain, we collected and analyzed the shallow groundwater depth distribution and regime data in North China Plain. The representative year was selected to analyze the distribution of groundwater depth in North China Plain based on the data of hydrological factors of the typical shallow groundwater observation stations from 2005 to 2015, and by combining with the national water resources bulletin. The controlling factor affecting the variation of shallow groundwater in overdraft areas was identified by the Back-Propagation (BP) neural network analysis method. The results indicates that most areas of North China Plain show a continuous increase in buried depth except for a few areas. Artificial groundwater exploitation is the controlling factor affecting shallow groundwater in North China Plain.