Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Compare Executors to joblib #63

Open
itaitzruia4 opened this issue May 31, 2023 · 0 comments
Open

Compare Executors to joblib #63

itaitzruia4 opened this issue May 31, 2023 · 0 comments
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@itaitzruia4
Copy link
Collaborator

itaitzruia4 commented May 31, 2023 •
edited

As far as we know, ThreadPoolExecutor isn't very efficient for computing fitness scores due to python's GIL.
Some packages (e.g. sklearn) use joblib for parallelization.
I tested both joblib and ProcessPoolExecutor on a single fitness function and received minimal difference in runtime.
Both options should be tested at least once on additional examples.
@itaitzruia4 itaitzruia4 added enhancement New feature or request help wanted Extra attention is needed labels May 31, 2023
@ZvikaZ ZvikaZ mentioned this issue Jun 25, 2023
Open
@itaitzruia4 itaitzruia4 mentioned this issue Jul 5, 2023
Open
@itaitzruia4 itaitzruia4 mentioned this issue Jul 17, 2023
Closed
@itaitzruia4 itaitzruia4 changed the title Try replacing Executors with joblib Compare Executors with joblib May 13, 2024
@itaitzruia4 itaitzruia4 changed the title Compare Executors with joblib Compare Executors to joblib May 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@itaitzruia4