Human alteration of the land surface hydrologic cycle is substantial. Recent studies suggest that local water management practices including groundwater pumping and irrigation could significantly alter the quantity and distribution of water in the terrestrial system, with potential impacts on weather and climate through land-atmosphere feedbacks. In this study, we incorporated a groundwater withdrawal scheme into the Community Land Model version 4 (CLM4). To simulate the impact of irrigation realistically, we calibrated the CLM4 simulated irrigation amount against observations from agriculture census at the county scale over the conterminous United States (CONUS). The water used for irrigation was then removed from the surface runoff and groundwater aquifer according to a ratio determined from the county-level agricultural census data. Based on the simulations, the impact of groundwater withdrawals for irrigation on land surface and subsurface fluxes were investigated. Our results suggest that the impacts of irrigation on latent heat flux and potential recharge when water is withdrawn from surface water alone or from both surface and groundwater are comparable and local to the irrigation areas. However, when water is withdrawn from groundwater for irrigation, greater effects on the subsurface water balance were found, leading to significant depletion of groundwater storage in regions with low recharge rate and high groundwater exploitation rate. Our results underscore the importance of local hydrologic feedbacks in governing hydrologic response to anthropogenic change in CLM4 and the need to more realistically simulate the two-way interactions among surface water, groundwater, and atmosphere to better understand the impacts of groundwater pumping on irrigation efficiency and climate.