Differences between revisions 2 and 20 (spanning 18 versions)
Revision 2 as of 2011-01-26 11:00:33
Size: 919
Comment:
Revision 20 as of 2013-09-07 11:03:07
Size: 2003
Comment:
Deletions are marked like this. Additions are marked like this.
Line 2: Line 2:

''Update:'' This project is now canceled, since PyPI is being on hosted on a fastly CDN and the PyPI server itself is hosted on a VM at OSL/OSU.
Line 11: Line 13:
 The proposal was accepted by the PSF in their December 2010 board meeting. The proposal was accepted by the PSF in their December 2010 board meeting.
Line 13: Line 15:
 Funding was limited to an initial USD 500 for Amazon costs to see whether the project would succeed. Funding was limited to an initial USD 500 for Amazon costs to see whether the project would succeed.

== Resources ==

 * [[http://docs.amazonwebservices.com/AmazonCloudFront/2010-11-01/GettingStartedGuide/|Amazon AWS Getting Started Guide]]

 * [[CheeseShopDev|Developer Intro to the PyPI code]]

 * [[PyPIXmlRpc|PyPI RPC interface]] (which we likely won't use, but gives an idea of how the meta data is stored)

 * [[https://bitbucket.org/loewis/pypi|PyPI Code]]

== Example CDN ==

We've setup an example CDN which only provides caching services to the PyPI server and uses the pypi.python.org server as origin:

 * https://d1t66zoqn9vlte.cloudfront.net/simple/

 * For more details on the used setup, please see [[CloudPyPI/ExampleCDN]]
Line 19: Line 39:
 * [[Marc-André Lemburg|MarcAndreLemburg]]
 * Grig Gheorghiu
 * Neil Schemenauer
 * [[MarcAndreLemburg|Marc-André Lemburg]]
 * [[GrigGheorghiu|Grig Gheorghiu]]
 * [[NeilSchemenauer|Neil Schemenauer]]
 * [[VernCeder|Vern Ceder]]
Line 32: Line 53:
== Project Server == == Amazon EC2: Project Development Server ==
Line 34: Line 55:
For development, we are using an Amazon EC2 VM:  * [[CloudPyPI/DevelopmentServer]]
Line 36: Line 57:
 * cloud-pypi.getpython.org == Amazon S3 ==
Line 38: Line 59:
Note that the development server may be stopped at times, if not currently used.  * [[CloudPyPI/S3]]
Line 40: Line 61:
The server has a snapshot of the PyPI installation as-of 2011-01-15. == Access Control ==

 * [[CloudPyPIGroup]]

This is a public page. Please don't add any sensitive information to the page. Instead, create subpages that are only available to team members.

Please put the following ACL line at the top of subpages with sensitive information:

{{{
#acl CloudPyPIGroup:read,write,revert,admin All:
}}}

Cloud PyPI - Mirroring PyPI in the cloud

Update: This project is now canceled, since PyPI is being on hosted on a fastly CDN and the PyPI server itself is hosted on a VM at OSL/OSU.

Idea

We are setting up a PyPI mirror of the static content of PyPI in Amazon CloudFront.

Proposal

The proposal was accepted by the PSF in their December 2010 board meeting.

Funding was limited to an initial USD 500 for Amazon costs to see whether the project would succeed.

Resources

Example CDN

We've setup an example CDN which only provides caching services to the PyPI server and uses the pypi.python.org server as origin:

Team

Implementation:

Helping with the PyPI code:

  • Richard Jones
  • Martin von Löwis

Mailing List

Amazon EC2: Project Development Server

Amazon S3

Access Control

This is a public page. Please don't add any sensitive information to the page. Instead, create subpages that are only available to team members.

Please put the following ACL line at the top of subpages with sensitive information:

#acl CloudPyPIGroup:read,write,revert,admin All:

CloudPyPI (last edited 2013-09-07 11:03:07 by MarcAndreLemburg)

Unable to edit the page? See the FrontPage for instructions.