[spark/deduping] adding geo context TFIDF model to Spark deduper. Pair similarity is defined as a linear combination of Soft-TFIDF under the geo-specific index and Soft-TFIDF using the global index. This is similar to the idea in Facebook's presumed implementation from the FB Research paper Deduplicating a Places Databsase (https://research.fb.com/publications/deduplicating-a-places-database/)
[spark/deduping] adding geo context TFIDF model to Spark deduper. Pair similarity is defined as a linear combination of Soft-TFIDF under the geo-specific index and Soft-TFIDF using the global index. This is similar to the idea in Facebook's presumed implementation from the FB Research paper Deduplicating a Places Databsase (https://research.fb.com/publications/deduplicating-a-places-database/)

openvenues/lieu