Learn how canceling a credit card affects your credit score, which factors matter most, and steps to minimize any hit.