I was researching what Swedenborg's Writings say about the spirits that are with us and was glad to find a great New Church Life article about it from 1906 (by searching on NewSearch4). In "Our Attendant Spirits" (PDF) Rev. C. Th. Odhner covers a lot of different topics. He talks about ancient ideas of attendant spirits; he makes sense of some seemingly contradictory statements in the Writings about how many spirits are with us and whether or not the spirits with us are angels and devils. He also talks about Deja Vu (or second memory) and guardian angels.
It's not a short article (19 pages at 1.5 spacing as I've formatted it) but it's definitely worth reading and I'm sure you'll learn something new if you do.