Despite the agronomical and environmental advantages of the cultivation of legumes, their production is limited by various environmental constraints such as water or nutrient limitation, frost or heat stress and soil salinity, which may be the result of pedoclimatic conditions, intensive use of agricultural lands, decline in soil fertility and environmental degradation. The development of more sustainable agroecosystems that are resilient to environmental constraints will therefore require better understanding of the key mechanisms underlying plant tolerance to abiotic constraints. This review provides highlights of legume tolerance to abiotic constraints with a focus on soil nutrient deficiencies, drought, and salinity. More specifically, recent advances in the physiological and molecular levels of the adaptation of grain and forage legumes to abiotic constraints are discussed. Such adaptation involves complex multigene controlled-traits which also involve multiple sub-traits that are likely regulated under the control of a number of candidate genes. This multi-genetic control of tolerance traits might also be multifunctional, with extended action in response to a number of abiotic constraints. Thus, concrete efforts are required to breed for multifunctional candidate genes in order to boost plant stability under various abiotic constraints.