Lorenzo Bolla
|
551a370c13
|
Basic tests for Grab downloader
|
2022-01-31 10:32:54 +01:00 |
|
Lorenzo Bolla
|
1afcd68e01
|
Make downloader type configurable
|
2022-01-31 10:32:54 +01:00 |
|
Lorenzo Bolla
|
cc30ef3ee2
|
Remove vendor directory
We use go modules now.
|
2022-01-31 10:32:54 +01:00 |
|
Lorenzo Bolla
|
235e35a2f3
|
Rate limit 0 effectively disables rate limiting
|
2022-01-31 10:32:54 +01:00 |
|
Lorenzo Bolla
|
4c54f967b7
|
Fix error checking
|
2022-01-31 10:32:54 +01:00 |
|
Lorenzo Bolla
|
8925949be3
|
Support rate limiting in grab downloader
|
2022-01-31 10:32:54 +01:00 |
|
Lorenzo Bolla
|
e96372c999
|
Implement ignore checksum mismatch
Also, update "pkg/errors" library.
|
2022-01-31 10:32:54 +01:00 |
|
Lorenzo Bolla
|
e5d9d27069
|
Wrap errors with more context
|
2022-01-31 10:32:54 +01:00 |
|
Lorenzo Bolla
|
853c990b6e
|
Handle checksums
|
2022-01-31 10:32:54 +01:00 |
|
Lorenzo Bolla
|
86c1ffab2a
|
Add logs for checksum
|
2022-01-31 10:32:54 +01:00 |
|
Lorenzo Bolla
|
952287a787
|
Reenable checksums
|
2022-01-31 10:32:54 +01:00 |
|
Lorenzo Bolla
|
b5d90b7b13
|
Add more logging
|
2022-01-31 10:32:54 +01:00 |
|
Lorenzo Bolla
|
3e06af8515
|
Disable checksum for now
|
2022-01-31 10:32:54 +01:00 |
|
Lorenzo Bolla
|
eff2e56d0d
|
Specify output filename instead of directory
"temp" downloader uses its own naming for downloaded files.
|
2022-01-31 10:32:54 +01:00 |
|
Lorenzo Bolla
|
eaac04ccf6
|
Improve logging in grab downloader
|
2022-01-31 10:32:54 +01:00 |
|
Lorenzo Bolla
|
894192851e
|
Grab downloader
|
2022-01-31 10:32:54 +01:00 |
|