Crews were called to the dam located near Searcy Street around 6 p.m. after a swimmer became trapped in rushing water.
Upon their arrival, officials said the man was standing to the side of the dam.
Emergency personnel were able to wade out to the man and provide him with a personal floatation device and lead him to safety.
Following Monday evening's rescue the fire department reminded swimmers to use extreme caution when in the water.
"Anytime the river is up you don't need to be in it, firefighter Matt Young said, adding, "It's dangerous, there's logs floating in the river, there's barbed wire, there's things underneath that water line that you can get snagged in and caught in."
The Murfreesboro Fire Department is producing a public service announcement warning of the danger. The PSA will begin airing this week on City TV.