Should I study Physics?

I have recently become interested in physics, namely astrophysics. The problem is that I am entering my third year in college and have been studying business up until now. I am not TOO proficient in math and plan on getting a tutor so that I can master calculus. I am VERY interested in space and would like to major in something related to this field. Astrophysics seems like the subject for me. Am i too late to decide to take on this physics endeavor?