That dotted line is to show that there are more relationships with that person that can not be readily shown. This is usually due to the fact that there is no way for the computer, and maybe a person too, to figure out how to show the relationships without having one line cross over another. If you click on the person with the dotted line, it will shift the display to showing those boxes that would be impossible to display otherwise.