The plugs in my outlet are very loose. Can this be fixed?

No, you should replace them … immediately. Loose contacts can lead to arcing, which can cause a fire.