Differences between revisions 10 and 20 (spanning 10 versions)
Revision 10 as of 2011-01-26 20:15:04
Size: 1588
Comment:
Revision 20 as of 2013-09-07 11:03:07
Size: 2003
Comment:
Deletions are marked like this. Additions are marked like this.
Line 2: Line 2:

''Update:'' This project is now canceled, since PyPI is being on hosted on a fastly CDN and the PyPI server itself is hosted on a VM at OSL/OSU.
Line 21: Line 23:
 * [[PyPiXmlRpc|PyPI RPC interface]] (which we likely won't use, but gives an idea of how the meta data is stored)  * [[PyPIXmlRpc|PyPI RPC interface]] (which we likely won't use, but gives an idea of how the meta data is stored)
Line 23: Line 25:
 * [[https://svn.python.org/packages/trunk/pypi/|PyPI Code]]  * [[https://bitbucket.org/loewis/pypi|PyPI Code]]
Line 25: Line 27:
 * [[https://svn.python.org/packages/trunk/pypi/webui.py| Web GUI code]] == Example CDN ==

We've setup an example CDN which only provides caching services to the PyPI server and uses the pypi.python.org server as origin:

 * https://d1t66zoqn9vlte.cloudfront.net/simple/

 * For more details on the used setup, please see [[CloudPyPI/ExampleCDN]]
Line 32: Line 40:
 * Grig Gheorghiu
 * Neil Schemenauer
 * [[GrigGheorghiu|Grig Gheorghiu]]
 * [[NeilSchemenauer|Neil Schemenauer]]
 * [[VernCeder|Vern Ceder]]
Line 54: Line 63:
 * [[CloudPyPITeam]]  * [[CloudPyPIGroup]]
Line 61: Line 70:
#acl CloudPyPITeam:read,write,revert,admin All: #acl CloudPyPIGroup:read,write,revert,admin All:

Cloud PyPI - Mirroring PyPI in the cloud

Update: This project is now canceled, since PyPI is being on hosted on a fastly CDN and the PyPI server itself is hosted on a VM at OSL/OSU.

Idea

We are setting up a PyPI mirror of the static content of PyPI in Amazon CloudFront.

Proposal

The proposal was accepted by the PSF in their December 2010 board meeting.

Funding was limited to an initial USD 500 for Amazon costs to see whether the project would succeed.

Resources

Example CDN

We've setup an example CDN which only provides caching services to the PyPI server and uses the pypi.python.org server as origin:

Team

Implementation:

Helping with the PyPI code:

  • Richard Jones
  • Martin von Löwis

Mailing List

Amazon EC2: Project Development Server

Amazon S3

Access Control

This is a public page. Please don't add any sensitive information to the page. Instead, create subpages that are only available to team members.

Please put the following ACL line at the top of subpages with sensitive information:

#acl CloudPyPIGroup:read,write,revert,admin All:

CloudPyPI (last edited 2013-09-07 11:03:07 by MarcAndreLemburg)

Unable to edit the page? See the FrontPage for instructions.