Coinbase doesn't give you a wallet, it gives you an account.

Well, there was some discussion on the help pages that you could do some trades on chain, if only you have the maximum account level.

What really sucks is that Coinbase doesn't describe the hoops they will want you to jump through before signing up.