You can absolutely get into the hobby this way, and there’s nothing wrong with it, especially if all you want to do is run trains.
For most of us, though, I believe that the journey is as rewarding as the destination. Personally, I get as much satisfaction out of building my layout as I do running it.