No! You do not need to repay the loan as long as you or one of the borrowers continues to live in the house and keeps the taxes and insurance current. You can never owe more than your home's value.