-
Notifications
You must be signed in to change notification settings - Fork 102
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
hash calculate in ray deduplicator #286
Comments
This issue is marked as stale because there has been no activity for 21 days. Remove stale label or add new comments or this issue will be closed in 3 day. |
Hi, thanks for your attention! We are working on the distributed version of minhash & simhash for Ray mode, which is not very easy though. Please stay tuned. For now, we already added a dedicated tool for distributed deduplication based on PySpark here. You can try it first. Feel free to discuss with us if you have any further issues or suggestions! |
This issue is marked as stale because there has been no activity for 21 days. Remove stale label or add new comments or this issue will be closed in 3 day. |
Close this stale issue. |
Before Asking 在提问之前
I have read the README carefully. 我已经仔细阅读了 README 上的操作指引。
I have pulled the latest code of main branch to run again and the problem still existed. 我已经拉取了主分支上最新的代码,重新运行之后,问题仍不能解决。
Search before asking 先搜索,再提问
Question
Additional 额外信息
No response
The text was updated successfully, but these errors were encountered: