You are free to go anywhere, but give your original lender the first shot. They are often the most motivated party at the table. When you take a loan with no points, the lender is compensated through the rate, earning a premium when the loan is sold. If you pay that loan off very quickly by refinancing with a different company, the original lender typically has to give the premium back. So they have a real incentive to keep your business, and they will often compete hard, sometimes lowering your rate or payment before the first payment is even due. Jeb saw this on one of his own loans: the original lender proactively cut his payment early rather than risk losing the loan to a competitor. That is the leverage you hold, and the original lender already has your file, which means less friction on a quick refinance. The practical sequence: get your current lender's best refinance offer first, then compare it against one or two outside quotes. If someone genuinely beats them, you are free to move. Just do not assume you have to switch, and do not skip the lender with the strongest reason to fight for you.