It really depends on what you want to do. If you're mainly interested in working with/installing/fixing hardware then it's not a huge issue, it could be if you were more interested in programming, but even there I don't think it would necessarily be a disqualifying issue.
I'm not a computer programmer, but my best friend is one and I've taken some programming courses, so I don't have in-depth knowledge but a little bit of experience and exposure. From what I've seen the need for math skills in programming is largely dependent on the types of projects you want to do and the programming languages you use. Something that's not mentioned often that a lot of the early computer programmers weren't mathematicians or engineers but rather English and Philosophy majors as a lot of programming is manipulating a controlled syntax and vocabulary within a logical system.
Some languages require little to no math (html, php, etc), but generally if you want to do deeper programming, get behind the curtain sort of stuff, then it becomes more valuable. Depending on the language Logic (big L is intentional, logic as field of philosophy is different from what most people think--again peeking behind the curtain) and the ability to effectively use language can be more important. Places where mathematics would take precedence is likely in computer modeling/simulation and graphics.