98140ca0ab
Update missing blob error checking with latest Azure API
...
Signed-off-by: Richard Scothern <richard.scothern@docker.com>
2016-03-14 15:59:03 -07:00
4c2edee417
Merge pull request #1438 from BrianBland/newStorageDriverWriter
...
Adds new StorageDriver.FileWriter interface
2016-03-11 15:06:07 -08:00
eea043dc7b
Removes ceph rados driver in favor of Swift API gateway support
...
Signed-off-by: Brian Bland <brian.bland@docker.com>
2016-03-10 16:49:08 -08:00
19cfa36ec8
Added support to specifiy custom endpoint
...
Signed-off-by: Keerthan Reddy Mala <keerthan.mala@gmail.com>
2016-03-09 16:12:20 -07:00
490a2f5a55
Updates Swift driver to support new storagedriver.FileWriter interface
...
Signed-off-by: Brian Bland <brian.bland@docker.com>
2016-03-08 16:38:39 -08:00
5b48c81545
Support FileWriter interface for OSS storage driver
...
Change-Id: Ie5533ad85f944800499ca1040fd67bf1378815e0
Signed-off-by: Li Yi <denverdino@gmail.com>
2016-03-08 16:38:39 -08:00
9432b18e30
Storagedriver: GCS: add chunksize parameter
...
Signed-off-by: Arthur Baars <arthur@semmle.com>
2016-03-08 16:38:39 -08:00
115a6e5803
Storagedriver: GCS: implement resumable uploads
...
Signed-off-by: Arthur Baars <arthur@semmle.com>
2016-03-08 16:38:39 -08:00
34891eb7ab
StorageDriver: Testsuite: call Close before getting Size
...
Signed-off-by: Arthur Baars <arthur@semmle.com>
2016-03-08 16:38:38 -08:00
c69c8a3286
Adds new storagedriver.FileWriter interface
...
Updates registry storage code to use this for better resumable writes.
Implements this interface for the following drivers:
+ Inmemory
+ Filesystem
+ S3
+ Azure
Signed-off-by: Brian Bland <brian.bland@docker.com>
2016-03-08 16:37:44 -08:00
5ca3b61609
Fix two misspellings in source code comments
...
Signed-off-by: Aaron Lehmann <aaron.lehmann@docker.com>
2016-03-08 15:13:24 -08:00
2494c28e1f
[driver/s3aws] Update s3aws driver parameter parsing to match s3goamz
...
Mirrors changes from #1414 into the newer driver
Signed-off-by: Brian Bland <brian.bland@docker.com>
2016-03-07 11:52:34 -08:00
becdd83131
Merge pull request #1388 from aibaars/gcs-simplify-move
...
StorageDriver: GCS: remove support for directory Moves
2016-03-03 10:20:51 -08:00
396a73deb7
StorageDriver: GCS: remove support for directory Moves
...
The Move operation is only used to move uploaded blobs
to their final destination. There is no point in implementing
Move on "folders". Apart from simplifying the code, this also
saves an HTTP request.
Signed-off-by: Arthur Baars <arthur@semmle.com>
2016-03-03 13:28:13 +00:00
d16f3046c6
Fix some typos in comments and strings
...
All of them were found and fixed by codespell.
Signed-off-by: Stefan Weil <sw@weilnetz.de>
2016-02-23 22:33:38 +01:00
2e8244822c
Fix description of StorageDriver.WriteStream
...
Offset can be more than CurrentSize as long as this case is checked
by DriverSuite.testContinueStreamAppend.
Signed-off-by: Anton Tiurin <noxiouz@yandex.ru>
2016-02-17 13:57:20 +03:00
c6871737bc
[driver/s3aws] Fix TestStorageClass
...
Fixes bug in TestStorageClass for s3aws driver where the "standard" file
was checked for reduced-redundnancy storage.
Signed-off-by: Brian Bland <brian.bland@docker.com>
2016-02-16 17:50:55 -08:00
881ef1096f
Merge pull request #1385 from BrianBland/s3UseAWSLibrary
...
[driver/s3] Use aws/aws-sdk-go instead of goamz for s3 driver and cloudfront
2016-02-16 11:19:15 -08:00
7ca24a7f5a
fix gofmt
...
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2016-02-16 11:42:09 +08:00
ad6a0735d2
closes #1461 , enhance log message of oss driver
...
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2016-02-16 11:17:09 +08:00
d5a38e4c5f
Adds new s3 driver using aws-sdk-go instead of goamz
...
Keeps old s3 driver, renames to s3goamz, registers new s3 driver as both
"s3" and "s3aws"
Changes cloudfront middleware to use aws-sdk-go
Signed-off-by: Brian Bland <brian.bland@docker.com>
2016-02-12 15:59:26 -08:00
f77c82ebb3
Typo fixes in comments
...
Correct spelling of words in source code comments.
Signed-off-by: Aaron Lehmann <aaron.lehmann@docker.com>
2016-02-10 16:26:29 -08:00
4bb5f80885
Improves flexibility of configuration handling for S3 driver
...
Treats nil parameters the same as unprovided parameters (fixes issues
where certain parameters are printed to "<nil>").
Accepts "true" and "false" string values for boolean parameters.
Signed-off-by: Brian Bland <brian.bland@docker.com>
2016-02-09 17:27:16 -08:00
def3e430bb
Merge pull request #1401 from BrianBland/s3StorageClass
...
Adds "storageclass" configuration parameter for S3 driver.
2016-02-04 16:44:13 -08:00
95b9c7281b
read the actual number of bytes according to the initial size.
...
Signed-off-by: yuzou <zouyu7@huawei.com>
2016-02-04 16:14:35 +08:00
a2ade36ecf
Adds test for S3 storage class configuration option
...
Signed-off-by: Brian Bland <brian.bland@docker.com>
2016-02-01 16:01:55 -08:00
8e7910826e
Adds "storageclass" configuration parameter for S3 driver.
...
Defaults to STANDARD, also supports REDUCED_REDUNDANCY.
Signed-off-by: Brian Bland <brian.bland@docker.com>
2016-02-01 16:01:19 -08:00
6417c05a27
Merge pull request #1381 from BrianBland/s3CustomUAString
...
Adds custom registry User-Agent header to s3 HTTP requests
2016-02-01 15:40:36 -08:00
f41a408e34
Adds custom registry User-Agent header to s3 HTTP requests
...
Uses docker/goamz instead of AdRoll/goamz
Adds a registry UA string param to the storage parameters when
constructing the storage driver for the registry App.
This could be used by other storage drivers as well
Signed-off-by: Brian Bland <brian.bland@docker.com>
2016-02-01 13:43:46 -08:00
59a9607783
StorageDriver: GCS: retry all api calls
...
Signed-off-by: Arthur Baars <arthur@semmle.com>
2016-01-20 13:24:09 +00:00
ffc9527782
StorageDriver: Test suite: improve cleanup
...
Verify that the file(s) have been deleted after calling Delete,
and retry if this is not the case. Furthermore, report the error
if a Delete operation fails.
Signed-off-by: Arthur Baars <arthur@semmle.com>
2016-01-20 13:24:09 +00:00
b2876674f3
Merge pull request #1355 from hopkings2008/master
...
In testsuites.go, enlarge the size of randomBytes to 128M to fix the …
2016-01-18 12:38:26 -08:00
985c0d602f
StorageDriver GCS: try google.DefaultTokenSource first
...
Signed-off-by: Arthur Baars <arthur@semmle.com>
2016-01-15 11:47:47 +00:00
d3d9282a30
In testsuites.go, enlarge the size of randomBytes to 128M to fix the crash of running TestConcurrentStreamReads
...
Signed-off-by: yuzou <zouyu7@huawei.com>
2016-01-15 17:22:43 +08:00
5d35fa34c1
Change the parameters to the GCS drivers to allow CircleCI testing.
...
Remove the requirement of file system access to run GCS unit tests. Deconstruct
the input parameters to take the private key and email which can be specified on
the build system via environment variables.
Signed-off-by: Richard Scothern <richard.scothern@gmail.com>
2016-01-13 18:00:59 -08:00
e5e0e2cc2a
Merge pull request #1276 from denverdino/oss-test
...
Support large layer for OSS driver
2016-01-08 13:26:09 -08:00
6a248e115b
Merge pull request #1321 from aibaars/gcs-fix-retry
...
GCS storage driver: fix retry function
2016-01-06 12:00:12 -08:00
5c6fdc710f
GCS Storagedriver: fix test failure caused by #1187
...
Signed-off-by: Arthur Baars <arthur@semmle.com>
2016-01-06 18:36:28 +00:00
bf1e41a9f2
GCS driver: fix retry function
...
Signed-off-by: Arthur Baars <arthur@semmle.com>
2016-01-06 17:57:22 +00:00
5dc714b347
Replace 404 to http.StatusNotFound
...
Change-Id: Ia100975cb93c0a6d94ea5542b1c9ce386bc87649
Signed-off-by: weiyuan.yl <weiyuan.yl@alibaba-inc.com>
2015-12-29 12:09:04 +08:00
165507a622
Relaxes filesystem driver permissions to 0777 (dirs) and 0666 (files)
...
Leaves any further permissions restrictions to the process umask
Signed-off-by: Brian Bland <brian.bland@docker.com>
2015-12-28 15:22:28 -08:00
dc6944d91d
In HEAD request for missing resource, only 404 NOT FOUND is returned
...
Change-Id: I73caf67b59519e6f4f82f7d78f5d4fd4ad9affcd
Signed-off-by: weiyuan.yl <weiyuan.yl@alibaba-inc.com>
2015-12-28 11:28:42 +08:00
cfd2f03920
Support large layer for OSS driver
...
Signed-off-by: Li Yi <denverdino@gmail.com>
2015-12-11 10:56:50 +08:00
e6363e8a20
Merge pull request #1187 from stevvooe/check-storage-drivers-list-path-not-found
...
[WIP] registry/storage/driver: checking that non-existent path returns PathNotFoundError
2015-12-08 16:32:02 -08:00
d68acc869e
storage/driver/s3: adjust s3 driver to return unmunged path
...
This fixes both the s3 driver and the oss driver to return the unmunged path
when returning errors.
Signed-off-by: Stephen J Day <stephen.day@docker.com>
2015-12-08 15:48:55 -08:00
3032cd2aa9
Merge pull request #1246 from stevvooe/decrease-driver-testsuite-allocations
...
storage/driver: decrease memory allocation done during testsuite
2015-12-08 14:52:59 -08:00
533c912d3e
Fix the issue for listing root directory
...
Change-Id: I1c6181fa4e5666bd2e6ec69cb608c4778ae0fe48
Signed-off-by: Li Yi <denverdino@gmail.com>
2015-12-08 12:04:04 -08:00
3a5c6446d8
Fix for stevvooe:check-storage-drivers-list-path-not-found in OSS driver
...
Change-Id: I5e96fe761d3833c962084fd2d597f47e8a72e7c2
Signed-off-by: Li Yi <denverdino@gmail.com>
2015-12-08 12:04:04 -08:00
aa08ced9d7
driver/swift: treat empty object list as a PathNotFoundError
...
Swift returns an empty object list when trying to read a non-existing object path, treat it as a
PathNotFoundError when trying to list a non existing virtual directory.
Signed-off-by: David li <wenquan.li@hpe.com>
2015-12-08 12:04:04 -08:00
c39158d48c
driver/rados: treat OMAP EIO as a PathNotFoundError
...
RADOS returns a -EIO when trying to read a non-existing OMAP, treat it as a
PathNotFoundError when trying to list a non existing virtual directory.
Signed-off-by: Vincent Giersch <vincent@giersch.fr>
2015-12-08 12:04:04 -08:00
Richard Scothern
Brian Bland
Brian Bland
Keerthan Mala
Li Yi
Arthur Baars
Aaron Lehmann
Richard Scothern
Stefan Weil
Anton Tiurin
liuchang0812
yuzou
weiyuan.yl
Stephen J Day
Stephen Day
davidli
Vincent Giersch