Contradiction between supply and demand of water resource is increasingly severe. How to characterize individual and group water use behaviors and establish effective adaptive management strategies have become the common concerns of water managers and researchers. In this paper, we briefly introduce the agent-based modeling from the perspective of the theoretical methods and technical tools. We then take water resource use that transferring from agricultural to non-agricultural sectors in Miyun Reservoir Basin as a case, analyze the response behavior patterns of agricultural water resources utilization subjects under different climatic conditions, and proposed an adaptive agricultural water use model in accordance with ODD protocol, which established a roadmap from watershed system at the macro-level to individual water use behaviors at the micro-level. The proposed model includes the framework of water resource allocation model coupling human-natural system and highlights the rural-urban linkage, which provides a decision analysis tool to optimize water resource allocation for a watershed.