The primary issue wasn't the factories - it was houses burning coal!

The Clean Air Act 1956 mandated "smokeless" coal, and that helped a lot. Also central heating (either natural gas or electric) started to become popular.