I never seriously considered a math degree. But I was inducted into Mu Alpha Theta (a college level math honor society) when I was 16 and in 11th grade. I had NO CLUE in high school how unusually good I was in math nor how valuable that is. Nearly 17 years later, I did a little review and CLEPed Algebra, scoring in the 80th percentile (or better -- I can't remember exaclty), to complete my Associate's Degree. That fall, I got waivered into Statistics based on my 17 year old SAT scores.
Math is an awesome skill to have and it can be hard to study later if you get married, have kids, and are going to school while working. Every math heavy class I take is an easy A because I have a solid background. Hydrology is all mathematical modeling, some GIS classes require a good grasp of math, and a lot of people who can supposedly work the formulas don't understand the concepts well enough to make good decisions about what data to use, etc. So a lot of stuff that can be relevant to what planners do can be pretty math intensive -- and most folks are ill equipped to do well at such things. I think if you went into planning and went into something supposedly not math heavy, it would make you better able to talk to the engineers and people like that -- folks seem to be The Bane of a lot of planners lives.
I was a history major for a time. My husband is presently a history major. If you have a serious interest in history, you are probably reading "for fun" stuff that is way beyond most of what you would be exposed to at the undergrad level. But most folks don't do math "for fun". Your knowledge of history is likely to grow simply out of interest in it, whether you take classes in it or not. Your knowledge of math is unlikely to grow much without rigorous study. I would suggest you go for the statistics degree.
"just my 2 cents/ hope that helps"
