Quantitative adult plant resistance (APR) to stem rust (Puccinia graminis f. sp. tritici) is an important breeding target in wheat (Triticum aestivum L.) and a potential target for genomic selection (GS). To evaluate the relative importance of known APR loci in applying GS, we characterized a set of CIMMYT germplasm at important APR loci and on a genome-wide profile using genotyping-by-sequencing (GBS). Using this germplasm, we describe the genetic architecture and evaluate prediction models for APR using data from the international Ug99 stem rust screening nurseries. Prediction models incorporating markers linked to important APR loci and seedling phenotype scores as fixed effects were evaluated along with the classic prediction models: Multiple linear regression (MLR), Genomic best linear unbiased prediction (G-BLUP), Bayesian Lasso (BL), and Bayes Cπ (BCπ). We found the Sr2 region to play an important role in APR in this germplasm. A model using Sr2 linked markers as fixed effects in G-BLUP was more accurate than MLR with Sr2 linked markers (p-value = 0.12), and ordinary G-BLUP (p-value = 0.15). Incorporating seedling phenotype information as fixed effects in G-BLUP did not consistently increase accuracy. Overall, levels of prediction accuracy found in this study indicate that GS can be effectively applied to improve stem rust APR in this germplasm, and if genotypes at Sr2 linked markers are available, modeling these genotypes as fixed effects could lead to better predictions.