1aa88701fb
Merge pull request #688 from smira/686-race-fix
...
Fix race in API related to `LoadComplete()`
2017-12-13 15:49:37 +03:00
43ddcd27cb
Fix race in API related to LoadComplete()
...
LoadComplete() modifies object, so it would cause issues if it runs
concurrently with other methods. Uprage mutex locks to write
locks when LoadComplete() is being used.
2017-12-13 12:40:06 +03:00
9cb2a302f8
Merge pull request #683 from smira/545-download-contxt
...
Use Go context to abort gracefully mirror updates
2017-12-01 00:27:26 +03:00
d836334767
Merge pull request #682 from tirolerstefan/remove-buildinfo
...
#679 : added *.buildinfo file to processedFile list (will be removed)
2017-12-01 00:23:49 +03:00
565fcf4390
Merge pull request #664 from sliverc/acquire-by-hash
...
Support Acquire-By-Hash for index files
2017-12-01 00:19:07 +03:00
b7490fe909
Refactor to embed gocontext.Context into aptly context
2017-11-30 23:44:04 +03:00
b2bf4f7884
Adjust FileExists to differentiate between error and actual file existence
2017-11-30 09:46:02 +01:00
e504fdcd54
Build src path on basis of storage prefix when symlinking
2017-11-30 09:46:02 +01:00
3efa1052fa
Implement FileExists in files storage as simple stat to improve performance
2017-11-30 09:46:02 +01:00
2e488608ca
Simplify packaging indexing by hash and stop when there is an error
2017-11-30 09:46:02 +01:00
674a0e84be
Order publish parameters in bash completion
...
This makes it easier maintainable.
2017-11-30 09:46:02 +01:00
f5e1e194b3
Update man page and bash completion
2017-11-30 09:46:02 +01:00
b4f3573d11
Add acquire by hash when updating publish
2017-11-30 09:46:02 +01:00
4718625388
Avoid exception when failing tests doesn't have a doc string
2017-11-30 09:46:02 +01:00
d6b4b795a5
Fix linting errors
2017-11-30 09:46:02 +01:00
2bd0b786ea
Extend publish snapshot test with acquire by hash
2017-11-30 09:46:02 +01:00
092a7ed8f3
Rename AccessByHash to AcquireByHash for consistency with other flags
2017-11-30 09:46:02 +01:00
438e206b3d
Extend swift storage with link and file exists methods
2017-11-30 09:46:02 +01:00
7498fd8fc8
Extend s3 storage with link and file exists methods
2017-11-30 09:46:02 +01:00
e07912770e
Extend PublishedStorage interface for Acquire-By-Hash
...
Signed-off-by: André Roth <neolynx@gmail.com >
2017-11-30 09:46:02 +01:00
bb2db7e500
Support Acquire-By-Hash for index files
...
The added "aptly publish repo" option "-access-by-hash" publishes
the index files (Packages*, Sources*) also as hardlinked hashes.
Example:
/dists/yakkety/main/binary-amd64/by-hash/SHA512/31833ec39acc...
The Release files indicate this with the option "Acquire-By-Hash: yes"
This is used by apt >= 1.2.0 and prevents the "Hash sum mismatch" race
condition between a server side "aptly publish repo" and "apt-get update"
on a client.
See: http://www.chiark.greenend.org.uk/~cjwatson/blog/no-more-hash-sum-mismatch-errors.html
This implementation uses symlinks in the by-hash/*/ directory for keeping
only two versions of the index files and deleting older files
automatically.
Note: this only works with aptly.FileSystemPublishedStorage
Closes : #536
Signed-off-by: André Roth <neolynx@gmail.com >
2017-11-30 09:46:02 +01:00
c94e048198
Merge branch 'master' into remove-buildinfo
2017-11-30 06:34:50 +01:00
3b4c06d28d
gofmt
2017-11-30 06:31:50 +01:00
15618c8ea8
Use Go context to abort gracefully mirror updates
...
There are two fixes here:
1. Abort package download immediately as ^C is pressed.
2. Import all the already downloaded files into package pool,
so that next time mirror is updated, aptly won't download them
once again.
2017-11-30 00:49:37 +03:00
a037615962
Merge pull request #677 from sliverc/edit_mirror_archive_url
...
Allow editing of mirror archive url
2017-11-29 23:23:08 +03:00
5d301fb1b7
Prepare archive root when editing it
2017-11-27 11:08:31 +01:00
8a4d866810
#679 : added *.buildinfo file to processedFile list (will be removed, afterwards)
2017-11-24 14:23:26 +01:00
b98abcc049
Allow editing of mirror archive url
...
This is needed in case a mirror has moved or is down and need to move
to new mirror.
2017-11-21 16:31:49 +01:00
10e0966edc
Merge pull request #674 from smira/fix-formatting
...
Fix formatting
2017-11-19 21:53:09 +03:00
340d1fdd7c
Fix formatting
2017-11-19 19:53:24 +03:00
14d4a2706c
Merge pull request #673 from AgNO3/s3-removal
...
S3 backend: include path prefix in removal requests.
2017-11-19 19:24:04 +03:00
308ea83cc0
S3 backend: include path prefix in removal requests.
...
DELETE requests, both for temporary files and no longer referenced
packages, lacked the configured path prefix and therefor were not
removed if a prefix is configured.
2017-11-13 14:48:25 +01:00
9c018ce636
Merge pull request #668 from smira/flx42-sha512-release-file
...
Handle SHA512 in Release files
2017-11-08 22:25:23 +03:00
359cda9d99
Add system test for repo with SHA512-only checksums
2017-11-08 19:45:22 +03:00
e682639b20
Handle SHA512 in Release files
...
Fix : #656
2017-11-08 11:54:19 +03:00
afd2c5fcea
Merge pull request #665 from smira/upd-goleveldb
...
Update goleveldb vendored dependency (see #662 )
2017-11-08 11:49:54 +03:00
5a1d006850
Update goleveldb vendored dependency (see #662 )
2017-11-08 00:49:56 +03:00
67c26368ee
Merge pull request #658 from apachelogger/control-tar-xz-support
...
make deb reader handle new control.tar options introduced in dpkg 1.17.6
2017-11-02 00:43:54 +03:00
1885cbd6a2
make deb reader handle new control.tar options introduced in dpkg 1.17.6
...
newly supported is uncompressed control.tar and xz compressed
control.tar.xz. latter is used by ubuntu for dbgsym ddebs.
Fixes #655
2017-10-31 14:43:00 +01:00
79d68ec3a7
Merge pull request #659 from apachelogger/fix-align-lint
...
fix linting by using new maligned linter instead of aligncheck
2017-10-31 16:38:32 +03:00
f43801cb96
whitelist falke E722 in system/lib.py
...
'E722 do not use bare except' wants us not to use except without type
restriction as it catches everything and the kitchen sink. Since we use
them to catch exceptions in test cases this is intentional as we implement
general purpose error handling on test failure there.
2017-10-31 12:42:11 +01:00
46c2182ade
fix linting by using new maligned linter instead of aligncheck
...
upstream switched the alignment check backend and in doing so fails to run
if the old backend is defined in the config.
also skip alignment linting on a struct we use for byte decoding as we have
no choice in its member order.
2017-10-31 12:24:31 +01:00
5ef45bddda
Merge pull request #650 from smira/278-import-files-from-pool
...
Allow using files from the pool while importing source packages
2017-09-29 23:46:06 +03:00
0d94f29c27
Allow using files from the pool while importing source packages
...
Sometimes source packages reference files already present in the pool.
Allow for those file to be omitted when importing packages either via
`repo add` or `repo include`. If file is missing, aptly would make
an attempt to look up file in the package pool (by checksum) and
use it.
Fixes : #278
2017-09-29 22:39:51 +03:00
04b7543dea
Merge pull request #649 from smira/647-sse-put-copy
...
Enforce SSE/StorageClass in PUT Object Copy
2017-09-28 21:07:30 +03:00
9051f13ce6
Merge branch 'master' into 647-sse-put-copy
2017-09-28 19:30:48 +03:00
1b704db5c0
Merge pull request #648 from smira/upgrade-aws-sdk
...
Upgrade AWS SDK to the latest version
2017-09-28 19:30:30 +03:00
2d66a4ca0a
Enforce SSE/StorageClass in PUT Object Copy
...
"RenameFile" is implemented in S3 using `PUT Object Copy`, which
should enforce SSE/StorageClass same way as regular `PUT Object`.
Fixes : #647
2017-09-28 18:30:50 +03:00
182c21e38c
Upgrade AWS SDK to the latest version
2017-09-28 17:57:05 +03:00
9a767b7631
Merge pull request #646 from smira/update-gin
...
Upgrade gin-gonic to latest master, fix compatibility issues
2017-09-28 01:42:42 +03:00
Andrey Smirnov
Oliver Sauder
André Roth
Stefan
Stefan Felkel
Moritz Bechler
Felix Abecassis
Harald Sitter