Yes, but no cargo trains came over it. Just passenger trains and they were more silent. We did get used to it.
Going on a holiday or staying somewhere else is different, it will disturb your sleep for sure. When we book, we never know exactly where we end up all the time 😇