I would recommend the harem path personally. But you're fine with going with only one if you want. Most of the content will look the same. The only thing that would be different is some of the dialogue with the other girls, and sex scenes. And obviously you would miss out on some dates and so on. Some main story moments may also look a bit different. But nothing major.