About 50 families have started legal action over “odour problems” coming from Faccenda chicken-processing plant in Brackley.
According to the BBC a meeting in Brackley on Wednesday, organised by Hugh James solicitors, was attended by about 40 people.
The Environment Agency said it was aware of “odour and noise” complaints. Faccenda is yet to comment.
Lee James, who has lived opposite the factory for six years, told the BBC the smell made him “feel sick”.
“It smells like dead meat,” he said. “Sometimes we have to leave the house just to get away from it.
“We’ve put up with it for a very long time.”
Hugh James solicitors, which organised Wednesday’s meeting to discuss the issue with residents, said the company had been instructed to act in the case.
A spokesman said: “People living near to the factory report serious odour problems which have meant that they have been unable to open their doors and windows, or enjoy being outside in their gardens during the summer months.”
A Pollution Prevention Control (PPC) permit was issued against the factory in 2005, the Environment Agency said.
The permit sets the level of emissions the company is allowed to release into the atmosphere.
A spokesman said: “The Environment Agency is aware that there have been historical odour and noise complaints, and have previously worked closely with both the operator and a local action group about the concerns.
“We have also received considerably fewer complaints about the site this year than in previous years.”