Refinancing your home loan can temporarily lower your credit score due to a hard inquiry, but it doesn’t have to hurt long-term. If you use it to reduce debt or lower payments, your score can actually improve. Here’s what really matters.