Soybean [Glycine max (L.) Merr.] provides a rich source of plant protein and oil worldwide. The commercial use of transgenic technology in soybean has become a classical example of the application of biotechnology to crop improvement. Although genetically modified soybeans have achieved commercial success, hybrid soybean breeding is also a potential way to increase soybean yield. Soybean cytoplasmic malesterile (CMS) lines have been used in three-line hybrid breeding systems, but their application to exploiting soybean heterosis has been limited by rare germplasm resource of sterile lines. The generation of various genetic diversity male-sterile soybean lines will help to overcome the shortcoming. In this study, we used targeted editing of AMS homologs in soybean by CRISPR/Cas9 technology for the first time to generate stable male-sterile lines. Targeted editing of GmAMS1 resulted in a male-sterile phenotype, while editing of GmAMS2 failed to produce male-sterile lines. GmAMS1 functions not only in the formation of the pollen wall but also in the controlling the degradation of the soybean tapetum. CRISPR/Cas9 technology could be used to rapidly produce stable male-sterile lines, providing new sterile-line materials for soybean hybrid breeding systems.