The ACLU believes nothing is being done because most of the residents are undocumented immigrants.
The apartment complex, which is located across the street from Glenview Elementary on Patricia Drive, was raided by federal officials last Wednesday.
At least 20 residents were taken into custody.
"There are a million protocols on how these things are suppose to happen and they don't include banging down doors, knocking out windows and dragging people out at gun point in front of their children," Tricia Herzfeld of the ACLU said.
Remziya Suleyman with the Tennessee Immigrant and Refugee Rights Coalition told News 2 that residents have complained to management for months about conditions.
Suleyman said those conditions included "black mold, insect infestations such as bed bugs, roaches, rats and water leaking from ceilings."
She also said there was a lack of hot water in some homes.
Neighbors said instead of management repairing the complaints, they vacated the apartment offices.
The management office of the complex had no comment.
On Thursday night, Metro police commented on the immigration raid.
They said the Metro gang unit had been investigating people at the apartment complex throughout the month.
In their investigation, they found Sureno 13 gang members and MS 13 gang members residing in the complex.
Police also said the apartment management moved from the complex earlier in October for safety reasons.
The ACLU is continuing their investigation in the living conditions of the apartment and the immigration raid.