Amazon VOStore?

Matthew Graham mjg at cacr.caltech.edu
Thu Aug 17 08:38:52 PDT 2006


Hi,

We have been aware of the Amazon S3 for a while and have had a look at 
its interface but as their rubric states: Amazon S3 is intentionally 
built with a minimal feature set. It is designed to be a final solution 
whereas VOSpace is a layered functionality solution - it starts with 
VOSpace 1.0 and then progresses from there.
> (1) Why not take the Amazon definition and just use that exactly?
It does not answer all our use cases.
> (2) What can Amazon do that VOSpace cannot (and why is that feature 
> there?)
AS3 supports single-level directories (which it calls buckets): VOSpace 
1.0 is a perfectly flat store but 1.x will support full directory 
structures.

AS3 allows manipulation of Access Control Policy to data objects: 
VOSpace 1.0 is implementation dependent - your data objects might be 
world readable/writable or only only readable/writable. Future versions 
of VOSpace will use the Access Control mechanisms coming out of the IVOA 
security work.
> (3) What can VOSpace do that Amazon cannot (and which use-case needs 
> that?)
Move an object

Copy an object

Support third-party data transfers - the space pushes or pulls the data 
- this is the scalability use case where you do not want to bytes to 
come to your laptop first.

Support arbitrary data transfer protocols

In VOSpace, structured and unstructured data are both first-level 
entities and different views (data formats) can be taken of structured 
data (implementation dependent) since the space knows the data structure 
and how to manipulate this: for example, a VOTable could be imported and 
then exported as CSV.

And then there is all the stuff that we are planning for the next 
versions of VOSpace, such as full directory hierarchy, searching , and 
space federation.

> (4) How does the metadata model differ between Amazon and VOSpace?
Both seem to support arbitrary metadata (key, value) for a data object 
but only VOSpace will list the metadata that is currently uses and 
system supported.
> (5) What are the differences in security model? If the VO model is 
> different, why is it different?
VOSpace uses SSO (WS-Security) for authentication but currently has no 
authorisation mechanism beyond what implementation dependent: Amazon 
uses credentials in the unsecure message to authenticate and has access 
control policies. VOSpace uses the agreed IVOA security model so that we 
have standardised security across all our services.

> (6) What does VOSpace do that Amazon cannot (and who is demanding that 
> extra feature?)
This is question (3) again.
> (7) Is there a problem in implementing Amazon on top of SRB?
Almost certainly.

Cheers,

    Matthew



More information about the vospace mailing list