With the importance attached to issues of agriculture by China, there are more and more infrastructure construction projects in the countryside. Water conservancy project is an important one. Such infrastructure can not only promote sustained and stable development of the countryside, but also guarantee food security of China correspondingly and improve rural economic development and incomes of peasants. However, small water conservancy projects in the countryside of China have some problems which might cause the failure of rural development to keep up with the step and demand of the era. Therefore, it is required to take corresponding measures specific to these problems so as to promote the development of China. This paper analyzes problems of small water conservancy projects in the countryside of China and strives to improve the work efficiency of engineering construction management.