Owing to the fundamental importance and potential applications, a lot of theoretical and experimental work is ongoing to control the light-matter coupling. Many significant quantum effects can be observed in stronger coupling regimes which give a better efficiency and control over the system. This thesis presents a multi-level atom in a non-equilibrium cavity quantum electrodynamics (QED) system considering dipole-dipole interactions in different coupling regimes. The influence of coherent and incoherent pumping are included to study the quantum coherence phenomena. The proposed model can be applied to QED chemistry, circuit QED, microcavities consisting of organic molecules, and quantum information processing.