The OP clarified that the trees are nowhere near the neighbor's house, so they are not at risk of causing damage. Disputes over trees along property lines are common. Some people have even come home ...
Identifying a dominant leader and cutting away any competing leaders when a tree is young will allow it to grow more robustly ...