Does the fact that our knowledge about other people comes from our own umptions...?

Well, you're tackling one of the most complex and interesting topics of philosophy, epistemology is the branch of philosophy that tries to answer this question...There is a really good and short book which is about this topic and tries to explain common people this and other problems, it's titled "The Problems of Philosophy" by Bertrand Russell...