Withdrawing delegated funds

Hi, I recently tried withdrawing my ADA from my Daedalus wallet and it would not allow me to do so. Note that I have a ledger nano x connected, so it prompted me to launch Cardano on my device and confirm the transaction. However everytime I try doing this, the Cardano app does not prompt me to confirm any transaction. I’m wondering if this has anything to do with all my ADA being staked, and if so could this causing the issue? Any thoughts would be appreciated