Thats actually not your personal decision, it just is.
A lot of golfers (IMO most of them) fail to recognise that no other golfer, including their marker or opponent is a referee. Of course this doesn't mean a golfer cant consult with other persons.
The only responsibility a marker has is to write down the score that the player said he had, and to certify that at the end. If the marker disagrees on any matter the right thing to do is to tell the player he will report to the committee for adjudication.
Support your main theme here, but will draw out some additional nuance. If the marker disagrees on any matter he/she also needs to certify the holes agreed with as well as report to the Committee on any issues disagreed.