Interviewers can view public notes in the candidate's Activity Feed. Additionally, you can give interviewers special permission to view scorecards under Configure > Permission Policies > All Interviewers. 

Screenshot-of-interviewer-visiblity-options.png