The Landscape Reconstruction Algorithm (LRA) is regarded as the soundest approach for quantifying taxon-specific plant cover from pollen data. The reliability of relative pollen productivity (RPP) estimates is fundamental in the accuracy of quantitative vegetation reconstruction using the LRA approach. Inconsistent RPP estimates produced by different studies can cast doubt on the reliability and applicability of quantitative vegetation reconstruction. Therefore, it is crucial that the RPP estimates are evaluated before being applied for quantitative vegetation reconstruction. We have tested two alternative approaches, namely, a leave-one-out cross-validation (LOO) method and a splitting-by-subregion strategy, using surface pollen assemblages and the REVEALS model-the first step in the LRA-to evaluate the reliability of RPPs estimates of 10 target taxa obtained in the cultural landscape of Shandong. We compared the REVEALS estimates (RVs) with observations of regional vegetation abundance (OBVs) and pollen proportions (PPs). The RVs of all taxa are generally closer to OBVs than PPs, and the degree of similarity depends strongly on the abundance of individual taxa in plant and pollen; taxa dominant in the region show the highest similarity between RVs and OBVs, such as Artemisia, Poaceae, and Humulus. The RVs of all herb taxa except Humulus and Asteraceae SF Cichorioideae are slightly overrepresented, and the RVs of all tree taxa are underrepresented except for Castanea. The comparison of RVs with OBVs collected from different spatial extents shows that the RVs of all herb taxa are more similar to OBVs collected from shorter distances (100 km and 75 km for the entire region and the subregion, respectively), whereas the RVs of all tree taxa are more similar to OBVs collected from longer distances (150 km and 100 km for the entire region and the subregion, respectively). Furthermore, our findings highlight the importance to test different sizes of area for vegetation surveys for evaluation of the RVs given that the appropriate size of vegetation survey may vary between low pollen producers (mainly herbs) and high pollen producers (mainly trees). We consider that the LOO strategy is the best approach in this case study for evaluating the RPP estimates from surface moss polsters. The evaluation confirms the reliability of the obtained RPP estimates for their potential application in quantitative reconstruction of vegetation abundance in temperate China.