This might be an unpopular opinion but I think this is only true if you are knowledgeable and super secure with your keys and backups. Most people are probably less likely to lose their money in a bank than with a self custody wallet.