Under the background of rapid urbanization, the pollution of water quality of urban areas is becoming more and more serious. In order to effectively diagnose the current situation of water quality in typical urban areas of northern China, this research puts forward universal countermeasures for water pollution control. The single-index evaluation method, comprehensive pollution index and fuzzy mathematics method were adopted. The results showed that the overall surface water quality is heavily polluted, and the main polluted rivers are concentrated in the built areas of central and eastern region. The water quality categories are inferior V and the main organic pollution factors are NH3—N, COD, CODMn, BOD5 and TP. Groundwater quality indicators are mainly total hardness, total bacteria, nitrate nitrogen, total coliform bacteria, soluble solids and sulphate. In the eastern part of the research area, total hardness, nitrate nitrogen and total soluble solids are the main indicators. In the western mountainous and rural areas, total bacteria and total coliform bacteria are the main indicators. Based on the results of current situation evaluation, the chemical composition of pollution indicators of surface water and groundwater are correlated. The main sources of pollution are point source pollution of industrial and domestic wastewater, non-point source pollution of urban and rural rainfall runoff. This paper proposes a new idea to apply the reduction and purification of non-point source pollution by sponge facilities to the treatment of water pollution in rivers and groundwater.