Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

spacy is very slow #463

Open
bigabig opened this issue Nov 12, 2024 · 0 comments
Open

spacy is very slow #463

bigabig opened this issue Nov 12, 2024 · 0 comments

Comments

@bigabig
Copy link
Member

bigabig commented Nov 12, 2024

not sure what is wrong, but with config_gpu.yaml for ray, spacy is really very slow:

(ProxyActor pid=4714) WARNING 2024-11-12 07:47:54,469 proxy 172.22.0.7 a38241d9-02d7-4425-b158-179ff5ff9206 /spacy/pipeline pow_2_scheduler.py:698 - Failed to schedule request after 50 attempts over 44.29s. Retrying. Request ID: a38241d9-02d7-4425-b158-179ff5ff9206.
(ProxyActor pid=4714) WARNING 2024-11-12 07:47:54,470 proxy 172.22.0.7 02448f51-75fe-4e75-a787-4b847f76d498 /spacy/pipeline pow_2_scheduler.py:698 - Failed to schedule request after 50 attempts over 44.19s. Retrying. Request ID: 02448f51-75fe-4e75-a787-4b847f76d498.
(ProxyActor pid=4714) WARNING 2024-11-12 07:48:44,804 proxy 172.22.0.7 02448f51-75fe-4e75-a787-4b847f76d498 /spacy/pipeline pow_2_scheduler.py:698 - Failed to schedule request after 100 attempts over 94.52s. Retrying. Request ID: 02448f51-75fe-4e75-a787-4b847f76d498.
(ProxyActor pid=4714) WARNING 2024-11-12 07:48:44,804 proxy 172.22.0.7 a38241d9-02d7-4425-b158-179ff5ff9206 /spacy/pipeline pow_2_scheduler.py:698 - Failed to schedule request after 100 attempts over 94.62s. Retrying. Request ID: a38241d9-02d7-4425-b158-179ff5ff9206.
(ProxyActor pid=4714) WARNING 2024-11-12 07:49:35,151 proxy 172.22.0.7 a38241d9-02d7-4425-b158-179ff5ff9206 /spacy/pipeline pow_2_scheduler.py:698 - Failed to schedule request after 150 attempts over 144.97s. Retrying. Request ID: a38241d9-02d7-4425-b158-179ff5ff9206.
(ProxyActor pid=4714) WARNING 2024-11-12 07:49:35,151 proxy 172.22.0.7 02448f51-75fe-4e75-a787-4b847f76d498 /spacy/pipeline pow_2_scheduler.py:698 - Failed to schedule request after 150 attempts over 144.87s. Retrying. Request ID: 02448f51-75fe-4e75-a787-4b847f76d498.
(ServeReplica:spacy:SpacyModel pid=6557) INFO 2024-11-12 07:49:44,883 spacy_SpacyModel sao8g1p6 5cca3e2c-bb3a-4db1-a570-b85a36ab79ee /spacy/pipeline replica.py:373 - PIPELINE OK 157582.6ms
(ServeReplica:spacy:SpacyModel pid=6557) INFO 2024-11-12 07:49:44,891 spacy_SpacyModel sao8g1p6 7e4bf8bb-7d1c-4800-bd64-8d9983f81c48 /spacy/pipeline replica.py:373 - PIPELINE OK 157590.0ms
(ServeReplica:spacy:SpacyModel pid=6557) INFO 2024-11-12 07:49:44,919 spacy_SpacyModel sao8g1p6 cb979184-9ce2-4d60-b76a-3539d389b53d /spacy/pipeline replica.py:373 - PIPELINE OK 157617.2ms
(ServeReplica:spacy:SpacyModel pid=6557) INFO 2024-11-12 07:49:45,042 spacy_SpacyModel sao8g1p6 6a4747f2-0054-4698-b2a0-a5fb412d5d02 /spacy/pipeline replica.py:373 - PIPELINE OK 157740.1ms

at least on ltdwise. i tested with normal news articles

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant