Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

deviantart simply does not work #6694

Open
whitestkaffir opened this issue Dec 19, 2024 · 3 comments
Open

deviantart simply does not work #6694

whitestkaffir opened this issue Dec 19, 2024 · 3 comments

Comments

@whitestkaffir
Copy link

no matter hjow closely i follow the instructions it just says 429 too many requests and tells me to paste the output here... pls help u guise ;(

[04:34 PM] ham@sylvie> gallery-dl -v https://www.deviantart.com/vandamcbtl/gallery
[config][error] JSONDecodeError when loading '/Users/ham/.config/gallery-dl/config.json': Expecting value: line 330 column 25 (char 7627)
[gallery-dl][debug] Version 1.26.5 - Git HEAD: 3001afe881
[gallery-dl][debug] Python 3.11.7 - macOS-12.6.6-arm64-arm-64bit
[gallery-dl][debug] requests 2.31.0 - urllib3 2.0.4
[gallery-dl][debug] Configuration Files []
[gallery-dl][debug] Starting DownloadJob for 'https://www.deviantart.com/vandamcbtl/gallery'
[deviantart][debug] Using DeviantartGalleryExtractor for 'https://www.deviantart.com/vandamcbtl/gallery'
[deviantart][debug] Using default API credentials (client-id 5388)
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.deviantart.com:443
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/user/profile/vandamcbtl HTTP/1.1" 429 105
[deviantart][debug] {"error":"application_api_threshold","error_description":"Client request limit reached.","status":"error"}
[deviantart][warning] API responded with 429 Too Many Requests. Using 1s delay.
[deviantart][debug] Sleeping 1.00 seconds (api)
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/user/profile/vandamcbtl HTTP/1.1" 429 105
[deviantart][debug] {"error":"application_api_threshold","error_description":"Client request limit reached.","status":"error"}
[deviantart][warning] API responded with 429 Too Many Requests. Using 2s delay.
[deviantart][debug] Sleeping 2.00 seconds (api)
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/user/profile/vandamcbtl HTTP/1.1" 429 105
[deviantart][debug] {"error":"application_api_threshold","error_description":"Client request limit reached.","status":"error"}
[deviantart][warning] API responded with 429 Too Many Requests. Using 3s delay.
[deviantart][info] Register your own OAuth application and use its credentials to prevent this error: https://github.com/mikf/gallery-dl/blob/master/docs/configuration.rst#extractordeviantartclient-id--client-secret
[deviantart][debug] Sleeping 3.00 seconds (api)
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/user/profile/vandamcbtl HTTP/1.1" 200 1451
[deviantart][debug] Sleeping 2.00 seconds (api)
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/gallery/all?username=VanDamCbtl&offset=0&limit=24&mature_content=true HTTP/1.1" 429 105
[deviantart][debug] {"error":"application_api_threshold","error_description":"Client request limit reached.","status":"error"}
[deviantart][warning] API responded with 429 Too Many Requests. Using 3s delay.
[deviantart][debug] Sleeping 3.00 seconds (api)
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/gallery/all?username=VanDamCbtl&offset=0&limit=24&mature_content=true HTTP/1.1" 429 105
[deviantart][debug] {"error":"application_api_threshold","error_description":"Client request limit reached.","status":"error"}
[deviantart][warning] API responded with 429 Too Many Requests. Using 4s delay.
[deviantart][debug] Sleeping 4.00 seconds (api)
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/gallery/all?username=VanDamCbtl&offset=0&limit=24&mature_content=true HTTP/1.1" 200 None
[deviantart][debug] Switching to private access token
[deviantart][debug] Sleeping 3.00 seconds (api)
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/gallery/all?username=VanDamCbtl&offset=0&limit=24&mature_content=true HTTP/1.1" 429 105
[deviantart][debug] {"error":"application_api_threshold","error_description":"Client request limit reached.","status":"error"}
[deviantart][warning] API responded with 429 Too Many Requests. Using 4s delay.
[deviantart][debug] Sleeping 4.00 seconds (api)
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/gallery/all?username=VanDamCbtl&offset=0&limit=24&mature_content=true HTTP/1.1" 200 None
[deviantart][error] An unexpected error occurred: KeyError - 'category'. Please run gallery-dl again with the --verbose flag, copy its output and report this issue on https://github.com/mikf/gallery-dl/issues .
[deviantart][debug]
Traceback (most recent call last):
File "/opt/homebrew/lib/python3.11/site-packages/gallery_dl/job.py", line 127, in run
for msg in extractor:
File "/opt/homebrew/lib/python3.11/site-packages/gallery_dl/extractor/deviantart.py", line 129, in items
self.prepare(deviation)
File "/opt/homebrew/lib/python3.11/site-packages/gallery_dl/extractor/deviantart.py", line 231, in prepare
deviation["da_category"] = deviation["category"]
~~~~~~~~~^^^^^^^^^^^^
KeyError: 'category'

@sarma-tyrant
Copy link

The first line of the log output indicates there's a syntax error in your JSON config, so nothing in that file is actually getting used, which tends to be very bad for Deviantart. Try uploading your config.json file to a site like this one: https://codebeautify.org/jsonvalidator and edit it until it doesn't have any errors & paste it back into config.json.

If the issue persists & you're using any VPN or proxy, I would suggest trying a different server (or disabling it). For my VPN provider, Deviantart always returns 429 status codes for most of the servers available.

@whitestkaffir
Copy link
Author

ok thank you so much. so i fixed the syntax error (literally just deleting and replacing a space???) but now it still craps its pants and gives me this output:

[11:41 PM] ham@sylvie> gallery-dl --verbose https://www.deviantart.com/vandamcbtl/gallery
[gallery-dl][debug] Version 1.26.5 - Git HEAD: 3001afe881
[gallery-dl][debug] Python 3.11.7 - macOS-12.6.6-arm64-arm-64bit
[gallery-dl][debug] requests 2.31.0 - urllib3 2.0.4
[gallery-dl][debug] Configuration Files ['${HOME}/.config/gallery-dl/config.json']
[gallery-dl][debug] Starting DownloadJob for 'https://www.deviantart.com/vandamcbtl/gallery'
[deviantart][debug] Using DeviantartGalleryExtractor for 'https://www.deviantart.com/vandamcbtl/gallery'
[deviantart][debug] Using custom API credentials (client-id 33801)
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.deviantart.com:443
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/user/profile/vandamcbtl HTTP/1.1" 200 1452
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/gallery/all?username=VanDamCbtl&offset=0&limit=24&mature_content=true HTTP/1.1" 200 None
[deviantart][debug] Switching to private access token
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/gallery/all?username=VanDamCbtl&offset=0&limit=24&mature_content=true HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://www.deviantart.com:443 "GET /api/v1/oauth2/deviation/metadata?deviationids%5B0%5D=C97FF231-AC16-8F8B-FBF6-F0579858577A&deviationids%5B1%5D=16BC8951-DBD5-1443-D4C0-396EB558595B&deviationids%5B2%5D=1BC1D036-9881-C696-F977-D16B4E985FFD&deviationids%5B3%5D=43970C14-4693-2FA2-E487-CA349DC03188&deviationids%5B4%5D=81EE8301-482F-964C-4A6E-1AEB9238FE38&deviationids%5B5%5D=C0CE1518-1612-619B-83B8-6188066EF667&deviationids%5B6%5D=4BB9011A-E601-D931-577A-96BA2A793BD8&deviationids%5B7%5D=1A555BF2-2B90-5E5E-7AF0-223616BBBB7C&deviationids%5B8%5D=EC67079D-07C3-B4D7-06C7-F67BCF028151&deviationids%5B9%5D=6E20BA67-A0F6-9561-47FA-B242E7D22EBD&deviationids%5B10%5D=DF8BDF16-3BDB-8B36-937C-0654BC19813F&deviationids%5B11%5D=EBBD9670-DCF7-8158-768B-617161E0E12F&deviationids%5B12%5D=CAB2AD35-BD76-CC17-8D27-69B929F006D7&deviationids%5B13%5D=4E7E93F3-2329-48B8-945A-F6BE61CDD47D&deviationids%5B14%5D=160839AF-BDF1-B8AC-473C-7E6116C85B0B&deviationids%5B15%5D=550B96BF-9E67-B12C-B7CD-41A2804B7FD4&deviationids%5B16%5D=9D31933B-0EC9-54C1-8129-840CF8E2441D&deviationids%5B17%5D=360AEF3D-6ABC-BE24-C966-A26C41E793D3&deviationids%5B18%5D=DA64B619-0286-0D69-9329-8E6249FE1C24&deviationids%5B19%5D=91D825ED-ECD2-2D38-15EC-E9801899BF8D&deviationids%5B20%5D=C1ADDFBA-4820-EEF8-E62C-BD292BC6EC96&deviationids%5B21%5D=1212B658-0C90-D30F-1776-8DFC92E25742&deviationids%5B22%5D=B3AAB067-3E24-E073-0521-0E09841896BD&deviationids%5B23%5D=9C63504E-0D80-4711-D0E5-FDE30C392A8E&mature_content=true HTTP/1.1" 200 1562
[deviantart][error] An unexpected error occurred: KeyError - 'category'. Please run gallery-dl again with the --verbose flag, copy its output and report this issue on https://github.com/mikf/gallery-dl/issues .
[deviantart][debug]
Traceback (most recent call last):
File "/opt/homebrew/lib/python3.11/site-packages/gallery_dl/job.py", line 127, in run
for msg in extractor:
File "/opt/homebrew/lib/python3.11/site-packages/gallery_dl/extractor/deviantart.py", line 129, in items
self.prepare(deviation)
File "/opt/homebrew/lib/python3.11/site-packages/gallery_dl/extractor/deviantart.py", line 231, in prepare
deviation["da_category"] = deviation["category"]
~~~~~~~~~^^^^^^^^^^^^
KeyError: 'category'

@mikf
Copy link
Owner

mikf commented Dec 20, 2024

[gallery-dl][debug] Version 1.26.5 - Git HEAD: 3001afe881

You might want to git pull to get the latest code.
"KeyError: 'category'" was fixed in commit 269b280 in version v1.27.3 .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants