Background: Detection of mild cognitive impairment (MCI) is essential to screen high risk of Alzheimer’s disease (AD). However, subtle changes during MCI make it challenging to classify in machine learning. The previous pathological analysis pointed out that the hippocampus is the critical hub for the white matter (WM) network of MCI. Damage to the white matter pathways around the hippocampus is the main cause of memory decline in MCI. Therefore, it is vital to biologically extract features from the WM network driven by hippocampus-related regions to improve classification performance. Methods: Our study proposes a method for feature extraction of the whole-brain WM network. First, 42 MCI and 54 normal control (NC) subjects were recruited using diffusion tensor imaging (DTI), resting-state functional magnetic resonance imaging (rs-fMRI), and T1-weighted (T1w) imaging. Second, mean diffusivity (MD) and fractional anisotropy (FA) were calculated from DTI, and the whole-brain WM networks were obtained. Third, regions of interest (ROIs) with significant functional connectivity to the hippocampus were selected for feature extraction, and the hippocampus (HIP)-related WM networks were obtained. Furthermore, the rank sum test with Bonferroni correction was used to retain significantly different connectivity between MCI and NC, and significant HIP-related WM networks were obtained. Finally, the classification performances of these three WM networks were compared to select the optimal feature and classifier. Results: (1) For the features, the whole-brain WM network, HIP-related WM network, and significant HIP-related WM network are significantly improved in turn. Also, the accuracy of MD networks as features is better than FA. (2) For the classification algorithm, the support vector machine (SVM) classifier with radial basis function, taking the significant HIP-related WM network in MD as a feature, has the optimal classification performance (accuracy = 89.4%, AUC = 0.954). (3) For the pathologic mechanism, the hippocampus and thalamus are crucial hubs of the WM network for MCI. Conclusion: Feature extraction from the WM network driven by hippocampus-related regions provides an effective method for the early diagnosis of AD.