Cloud PyPI - Mirroring PyPI in the cloud
Update: This project is now canceled, since PyPI is being on hosted on a fastly CDN and the PyPI server itself is hosted on a VM at OSL/OSU.
Idea
We are setting up a PyPI mirror of the static content of PyPI in Amazon CloudFront.
Proposal
The proposal was accepted by the PSF in their December 2010 board meeting.
Funding was limited to an initial USD 500 for Amazon costs to see whether the project would succeed.
Resources
PyPI RPC interface (which we likely won't use, but gives an idea of how the meta data is stored)
Example CDN
We've setup an example CDN which only provides caching services to the PyPI server and uses the pypi.python.org server as origin:
For more details on the used setup, please see CloudPyPI/ExampleCDN
Team
Implementation:
Helping with the PyPI code:
- Richard Jones
- Martin von Löwis
Mailing List
cloud-pypi@lists.egenix.com (private to the project team)
Amazon EC2: Project Development Server
Amazon S3
Access Control
This is a public page. Please don't add any sensitive information to the page. Instead, create subpages that are only available to team members.
Please put the following ACL line at the top of subpages with sensitive information:
#acl CloudPyPIGroup:read,write,revert,admin All: