Should I be freaking out that my pupils are two different sizes?

I went to the emergency room last week and one of the nurses said that my pupils were two different sizes ...which they never had been before. I went there because I'd been having a lot of headaches and stuff (I also have severe anxiety). They did a CT scan and said that there was nothing emergent and that everything looked great with the scan and my blood work. I noticed again this morning that they were uneven, and it's just kind of freaking me out. I understand that doctors know what they're doing, but would a CT scan read something like an aneurysm and stuff? I need to go see my primary care doctor but I can't get in for a couple weeks. I've also had eye exams in the past and wear glasses, so I feel like if this didn't happen recently, my optometrist would have noticed. Does anyone know anything more about this?