An approach is provided in which a system transforms a set of embedding approximation values corresponding to a set of knowledge graph nodes into a set of binary valued embedding vectors. The system evaluates the set of binary valued embedding vectors against a query and a selects one of the binary valued embedding vectors based on the evaluation. The system then identifies one of the knowledge graph nodes that corresponds to the selected binary valued embedding vector and in turn, provides a result to the query based on the identified knowledge graph node.