Unless you own it, assume a tower at the lot line and feel lucky if you get something smaller. Everybody wants to control what their neighbour does with their land. If you own it, you get to pick what happens. Otherwise, just enjoy your patch.An example, real world, at the north end of our hood developers bought up the land along the main road that is currently all commercial low rise. No subway there but not far away. SFHs back onto this land. The zoning says six stories with a set-back from the property line between the fhouses and buildings. Still plenty of room to build large buildings... Developers bought the land knowing the rules... For all but the long term people the SFH people all bought under those same rules.
Developers are going to battle now wanting to build 18 stories basically on the fence line. So are the people that own those homes evil NIMBYs for not wanting an 18 story building at their back yard fence, when zoning is six with set-backs? This exact things is going on over and over. It delays the builds, delays housing and the developers are just playing games as they knew the rules when they bought. In the end they will waste years and build seven with the correct set-back.... BUT why not do this when they are hoarding the land and do not have the resources to even build six today (too many on the go), they might as well screw around and play the game for comparably pittance in lawyer fees.
I intentionally bought in the centre of a development as it will be more stable and predictable than the edges.
On a mostly unrelated note, I was talking to a guy on the weekend. He owns a small house with a decent size lot. Grandma lives in the basement, he has finally got approval for a detached ADU for his parents to live in (took years). Full committee of adjustment application, hearing, etc was required. At CoA, one of the members was challenging the owner and questioning what if he rented out the basement and ADU to third-parties in the future. A municipal employee stood up and had to explain to the member that was the end-result that the municipality was hoping for. More dwelling units, varying size and cost, minimal destruction of green space. When CoA doesn't even understand priorities and policy, they are just an obstructionist waste of money.