You don't need to keep your ATM card since the debit card acts as both a debit/signature card and an access card for any ATM or PIN transaction.

To prevent unauthorized use, you should destroy your ATM card if you choose to only keep your debit card.