Even without fees this idea is not a good one. Unless the scenario is “I am retired and need money to live” taking loans from and cashing out your retirement are always bad ideas. Tighten up your budget, sell some stuff, go without on a few “nice to haves” and get rid of the loan that way.