That's right, it's a lot of fun with friends. When you visit your friend's island, the progress you make is only recorded in their world, so if you want to progress in your own world, your friend will have to accompany you, with you as the host.