Honestly, look into the Breeze litter boxes. They’re not automatic or anything crazy expensive, but it really does make a HUGE difference. I’ve been told by multiple strangers “I thought you had a cat?” after being in my house a while because she hides and the box generally cannot be smelled. If you change the pads regularly (i.e. before they are full), replace the pellets 2-3 times a year, and clean the box itself when replacing the pellets, the only smell you will have is from poop. I personally buy the bioplastic dog poop bags in bulk, and just use those to quickly grab and dispose of it.
When we used regular litter the cats tracked it everywhere, flung it out of the box, and it always had a smell, even when cleaned daily. I have none of those things with the Breeze boxes. We were using two when we had 3 cats and I had to replace the pads every 3 days. Now with one cat I replace the pads every week to two weeks depending on whether she divides her usage or fixates on one. We pick up the poop as soon as we notice it, which is usually very quickly because they can’t really bury it as well. I will never go back to traditional litter.
Part of why cats like you is probably because you don’t like them and seek them out. Most cats are wary of people directly trying to approach them without invitation or greeting. In general cats will find the person ignoring them the least threatening and most approachable.
It never fails that cats tend to flock toward the person that is allergic to them, because that person is typically entirely disinterested in them lol. Not being interested in the cats is likely why you make friends with them so quickly!