Follow the below suggestion if you want to add or remove the vertical tabs button in the toolbar. Go to the start menu and open the Microsoft Edge browser ... icon and select Hide from toolbar ...
Even Microsoft Edge, the default browser on Windows PCs, isn’t too bad. I’ve been using it for work for quite some time now ...