BINGO !!!
However as in any situation there are exceptions. If that boat is outside all by himself fishing, and you see his net go a couple times and you move into the area he is working then the responsibility is on you to give up the room. Just a little common sense as well as a little common courtesy. The two go a long way in making for an enjoyable day.
Happy fishing.