Defects in the structure or motility of cilia and flagella may lead to severe diseases such as primary ciliary dyskinesia (PCD), a multisystemic disorder with heterogeneous manifestations affecting primarily respiratory and reproductive functions. We report that CFAP61 is a conserved component of the calmodulin- and radial spoke-associated complex (CSC) of cilia. We find that a CFAP61 splice variant, c.143+5G>A, causes exon skipping/intron retention in human, inducing a multiple morphological abnormalities of the flagella (MMAF) phenotype. We generated Cfap61 knockout mice that recapitulate the infertility phenotype of the human CFAP61 mutation, but without other symptoms usually observed in PCD. We find that CFAP61 interacts with the CSC, radial spoke stalk and head. During early stages of Cfap61−/− spermatid development, the assembly of radial spoke components is impaired. As spermiogenesis progresses, the axoneme in Cfap61−/− cells becomes unstable and scatters, and the distribution of intraflagellar transport proteins is disrupted. This study reveals an organ-specific mechanism of axoneme stabilization that is related to male infertility.