Do I have to be good at math to be an astrophysicist?

I have always loved astronomy, astrophysics, even quantum physics, basically anything to do with the stars or the unknown. I even took a course on it in college, but it didn't require much math. I was pretty good at math in high school up until calculus, but perhaps I would be better at it now. Can I still pursue being a scientist, or do I need to be a math phenom?