In town though, there's a good Mexican restaurant that's about 70 feet from where they are turning. Now that is LOUD! Not quite as loud as the horn, but more annoying.
So, I think that as long as you're not by a turn, or by where they are blowing their horn, you'll get used to it.
I do remember a buddy of mine that's a vet and I were drinking beer/throwing darts in the garage, and even though he knew about the tracks, it startled him. All of a sudden he stops out of the garage, wild eyed, and looks for a plane or something in the sky...eyes as big as saucers. I wasn't aware of the train and I ask him what's wrong, and he asks what is that sound coming in....then it occurs to me what he's hearing.

Overnight guests do the same thing, but not quite as dramatic as that one.