Problem in Identifying relevant documents to evaluate Precision in Information Retrieval (IR) Systems
Yes, the client needs to figure out which of the results are actually relevant. For obfuscation reasons the server returns irrelevant documents and also cannot know which documents are irrelevant so the client has to make that distinction.