so when we create digital derivatives of them this is much easier to manipulate because it's all theoretical.

This is a non sequitor. The physical nature of gold and silver does not make their derivatives any more or less 'theoretical' than Bitcoin derivatives.

What ultimately matters is how much people take personal delivery, and just like with gold and silver, the vast majority of Bitcoin and cryptocurrencies remain on exchanges, without people taking them into their own wallets.