Understanding Fence Code for New Fence
You don't say where you are located but based on my experience and looking at your code, I would say you have problems with the fence in your drawing. Your fence exceeds 4 feet where it extends beyond the front of both houses on either side. To be sure, you should show your plan to your local building department (you probably need to do that anyway to obtain a building permit). They are the ones you need to convince.