When you refinance at a lower interest rate, you usually pay refinancing costs including points, fees, and closing costs.