Differences between revisions 18 and 39 (spanning 21 versions)
Revision 18 as of 2003-08-13 11:32:59
Size: 4294
Editor: p508E3ACC
Comment:
Revision 39 as of 2008-11-15 14:00:08
Size: 7802
Editor: localhost
Comment: converted to 1.6 markup
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
= Starship Python is Moving! = = Starship Python has Moved! =
Line 3: Line 3:
On September 1, 2003, the machine that has been hosting Starship Python (courtesy of Zope Corporation) will be
shutdow
n. Consequently, Starship is being transferred to a new machine, kindly provided by Stefan Drees.
This page exists so the Starship admins can keep track of what tasks have to be done, what tasks have been
done, and
who's taking care of what. Also, the Starship user community can track the progress of the transfer here.
On September 1, 2003, the machine that has been hosting Starship Python (courtesy of Zope Corporation) has been
shutdo
wn. Consequently, Starship has being transferred to a new machine, kindly provided by Stefan Drees.
This page exists as a record for the Starship admins, so they can keep track of what tasks had to be done, for the successful transfer to happen smoothly. We are currently in the everlasting post-transfer phase, where new features and services are enabled. Probably we should list the core and special features of the current machine here...
Line 15: Line 14:
  [[BR]][done: gward 2003/08/09]   <<BR>>[done: gward 2003/08/09]
Line 18: Line 17:
  [[BR]][partly done: gward 2003/08/10; but some of the top users @python.net addresses bounce]   <<BR>>[partly done: gward 2003/08/10; but some of the top users @python.net addresses bounce]
Line 21: Line 20:
  following loop:[[BR]]   following loop:<<BR>>
Line 34: Line 33:
  [[BR]][assigned: gward]   <<BR>>[assigned: gward]
Line 39: Line 38:
  [[BR]][done: sdrees 2003/08/07]   <<BR>>[done: sdrees 2003/08/07]
Line 42: Line 41:
  [[BR]](will have to be in python2.net domain for now; once DNS service is transferred to   <<BR>>(will have to be in python2.net domain for now; once DNS service is transferred to
Line 45: Line 44:
  [[BR]][done: sdrees 2003/08/10]   <<BR>>[done: sdrees 2003/08/10]
Line 49: Line 48:
  [[BR]](hmmm: testing this stuff will require have at least one real user on the system.   <<BR>>(hmmm: testing this stuff will require have at least one real user on the system.
Line 53: Line 52:
    [[BR]](from unstable? or are they in testing yet?)
    [[BR]](tismer says: use exim-tls -- but is that necessary with the new exim4 packages?
    [[BR]][assigned: gward]
    <<BR>>(from unstable? or are they in testing yet?)
    <<BR>>(tismer says: use exim-tls -- but is that necessary with the new exim4 packages?
    <<BR>>[done: gward 2003/08/24; ended up getting 4.22-1 source package from unstable and
    building custom 4.22-gw1 packages
]
Line 58: Line 58:
    [[BR]][assigned: gward]     <<BR>>[done: gward 2003/08/24]
Line 61: Line 61:
    [[BR]](recompile necessary? or just fix elspy to work with dlopen() patch?)
    [[BR]][assigned: gward]
    <<BR>>(recompile necessary? or just fix elspy to work with dlopen() patch?)
    <<BR>>[done: gward 2003/08/24]
Line 65: Line 65:
    [[BR]](SSL daemon only) (IMAP only? or POP too?)
    [[BR]][assigned: gward]
    <<BR>>(SSL daemon only) (IMAP only? or POP too?)
    <<BR>>[assigned: gward]
Line 69: Line 69:
    [[BR]][assigned: gward]     <<BR>>[assigned: gward]
Line 74: Line 74:
    [[BR]](with mod-proxy, mod-rewrite, and mod-ssl, please!)
    [[BR]][assigned: sdrees]
    <<BR>>(with mod-proxy, mod-rewrite, and mod-ssl, please! Content data is already transfered by greg 2003/08/25)
    <<BR>>[done: admins 2003/08/26]<<BR>>
    [.cgi/.spy files enabled for crew, Server Name updated to starship.python.net Jim 2003/08/27]<<BR>>
    [enabled server side includes for .shtml files Jim 2003/08/28]
Line 78: Line 80:
    [[BR]](Zope 2.7 preferable; (really?) note that Debian testing has Zope 2.6.1 and a working plone on top ;) )
    [[BR]][assigned: sdrees]
    <<BR>>(Zope 2.7 preferable; (really?) note that Debian testing has Zope 2.6.1 and a working plone on top ;) )
    <<BR>>[installed 2.6.1 with plone -- sdrees 2003/08]
Line 81: Line 83:
  * install, configure, and test ProFTPd ('''critical path''')[[BR]][done: sdrees 2003/08/12]   * install, configure, and test ProFTPd ('''critical path''')<<BR>>[done: sdrees 2003/08/12]
Line 83: Line 85:
  * install, configure, and test Mailman ('''critical path''')   * install, configure, and test Mailman ('''critical path''')<<BR>>
  (it's installed, and seems to be working -- but list data has not been transferred.
  I'm going to let someone else worry about it. --gward 2003/08/27)<<BR>>
  [done: jim 2003/08/27]
Line 85: Line 90:
  * compare /etc/{passwd,group,shadow} and friends on both ships, evaluate migration strategy of credential data ('''critical path''')[[BR]][assigned: sdrees]   * Install Python and third party modules: [assigned: tbryan]
    * Motivation - One of Christian's goals in founding the Starship was to give developers a chance to play with the latest and greatest stuff and to show off Python's capabilities
    * History - We have built our own local copy of Python, with as many optional modules enabled as possible, since 1999.
    * Implementation - I was downloading the Python source, using Red Hat's RPM and our own custom Steup.local to build a custom binary RPM of Python for the starship
    * Third party modules - We have normally installed PIL, HTMLGen, and the mx* extensions for every Python release; we'd like to build more third party modules
    * Future - I'd like to reduce the amount of manual work involved in installing a new Python version. I'd like to tie in with the platform's package management system. I'd like to see nightly builds from CVS made available to crew members.
    * Plan - Install Python 2.2 and Python 2.3 with our normal third party modules as locally built software in /usr/local/. That will ensure some continuity in the short term when we move to the new Starship. After the move is complete, we can spend some time later to work out how we want to handle our local Python installations on a Debian machine. Then I'll remove the hand-built /usr/local/ installs and implement the new strategy.

  * compare /etc/{passwd,group,shadow} and friends on both ships, evaluate migration strategy of credential data ('''critical path''')<<BR>>user credential transfer will be greatly simplified by starship policy of using ssh keys for authentication. So the (shadowed) passwords will be a local secret ... greg wrote a little script already<<BR>>[done: gward ;) ]
Line 92: Line 105:
  * find/select a good DNS provider ('''critical path''')
  [[BR]](sdrees uses schlundtechnologies.com and has no complaints about it and has initiated transfer of python2.net to schlundtechnologies.com, no ip change )
  [[BR]](gward uses dyndns.org and has no complaints about it)
  * find/select a good DNS provider (not critical path, but desirable)
  <<BR>>(sdrees uses schlundtechnologies.com and has no complaints about it and has finalized transfer of python2.net to schlundtechnologies.com)
  <<BR>>(gward uses dyndns.org and has no complaints about it)
  <<BR>>(alternately, we could run the primary nameserver on starship, and use a commercial provider
  for the secondary nameserver)
Line 96: Line 111:
  * transfer python.net domain to new DNS provider ('''critical path''')
  [[BR]](currently the DNS servers are at zope.com/baymountain.com,
  * transfer python.net domain to new DNS provider (not critical path, but desirable)
  <<BR>>(currently the DNS servers are at zope.com/baymountain.com,
Line 99: Line 114:
  [[BR]][assigned: tismer (he owns the domain!)]   <<BR>>[assigned: tismer (he owns the domain!)]


== Detailed transfer plan ==

The transfer itself start at 2003-08-27 14:30 UTC.

  * disabled logins on old starship
  * shut down Exim, Courier-IMAP on old starship
  * disabled any other user processes that might update the disk
  (eg. CGI scripts that write state)
  * remounted home read-only on old machine
  * rsynced user directories (this assumed the main bulk transfer had
  already been done)
  * ensured ftpd running and working on new machine
  * changed canonical name of new machine to starship.python.net
  (not being able fixing reverse DNS resolution, since hosting provider is not capable ...)
  * edit Apache config for name change (drydock -> starship) and restart<<BR>>
    [done: jim 2003/08/27]
  * edit Exim config for name change and restart
  * DNS change so "starship.python.net" resolves to the new machine
  * start Exim, Courier-IMAP on new machine
  * enable user logins on new machine

Transfer completed at 2003-08-28 03:11 UTC.

Thanks to everyone who participated!
----
CategoryPythonWebsite

Starship Python has Moved!

On September 1, 2003, the machine that has been hosting Starship Python (courtesy of Zope Corporation) has been shutdown. Consequently, Starship has being transferred to a new machine, kindly provided by Stefan Drees. This page exists as a record for the Starship admins, so they can keep track of what tasks had to be done, for the successful transfer to happen smoothly. We are currently in the everlasting post-transfer phase, where new features and services are enabled. Probably we should list the core and special features of the current machine here...

If you're a Starship admin, feel free to update this page. Otherwise, please email webmaster@python.net if you want to add stuff to our to-do list.

Tasks for old Starship

  • determine disk usage patterns (ie. which directories use up the most space, and which users are responsible for those directories)


    [done: gward 2003/08/09]

  • browbeat top disk space users into cleaning up


    [partly done: gward 2003/08/10; but some of the top users @python.net addresses bounce]

  • find out which users no longer have a valid @python.net email address, and then run the

    following loop:

      for each user with no known forwarding address:
        if (user is "well-known" in the Python community) or
           (user has anything meaningful on starship):
          google to try to find a recent email address
          contact the user and ask:
            do they still need their starship account?
            what's their preferred email forwarding address?
            what's their SSH key (preferably SSHv2)?
        else:
          remove that user's account and all of their files


    [assigned: gward]

Tasks for new Starship

  • upgrade to Debian 'testing' (sarge)


    [done: sdrees 2003/08/07]

  • give the machine a proper hostname


    (will have to be in python2.net domain for now; once DNS service is transferred to a new provider, we can give it a python.net name -- anything but starship.python.net, of course!) Proposed proper hostname: drydock.python2.net ;)
    [done: sdrees 2003/08/10]

  • get email services working


    (hmmm: testing this stuff will require have at least one real user on the system. I guess I'll create a temporary throwaway account rather than transfer real data over yet.)

    • install Exim 4 packages (critical path)
      (from unstable? or are they in testing yet?)
      (tismer says: use exim-tls -- but is that necessary with the new exim4 packages?
      [done: gward 2003/08/24; ended up getting 4.22-1 source package from unstable and building custom 4.22-gw1 packages]

    • configure/test Exim (critical path)
      [done: gward 2003/08/24]

    • get elspy working with Debian Exim packages (critical path)
      (recompile necessary? or just fix elspy to work with dlopen() patch?)
      [done: gward 2003/08/24]

    • install Courier ("semi-critical" for mwh--anyone else?)


      (SSL daemon only) (IMAP only? or POP too?)
      [assigned: gward]

    • configure/test Courier


      [assigned: gward]

  • web services
    • install, configure, and test Apache (critical path)
      (with mod-proxy, mod-rewrite, and mod-ssl, please! Content data is already transfered by greg 2003/08/25)
      [done: admins 2003/08/26]
      [.cgi/.spy files enabled for crew, Server Name updated to starship.python.net Jim 2003/08/27]
      [enabled server side includes for .shtml files Jim 2003/08/28]

    • install, configure, and test Zope (not critical path)
      (Zope 2.7 preferable; (really?) note that Debian testing has Zope 2.6.1 and a working plone on top ;) )
      [installed 2.6.1 with plone -- sdrees 2003/08]

  • install, configure, and test ProFTPd (critical path)
    [done: sdrees 2003/08/12]

  • install, configure, and test Mailman (critical path)
    (it's installed, and seems to be working -- but list data has not been transferred. I'm going to let someone else worry about it. --gward 2003/08/27)
    [done: jim 2003/08/27]

  • Install Python and third party modules: [assigned: tbryan]
    • Motivation - One of Christian's goals in founding the Starship was to give developers a chance to play with the latest and greatest stuff and to show off Python's capabilities
    • History - We have built our own local copy of Python, with as many optional modules enabled as possible, since 1999.
    • Implementation - I was downloading the Python source, using Red Hat's RPM and our own custom Steup.local to build a custom binary RPM of Python for the starship
    • Third party modules - We have normally installed PIL, HTMLGen, and the mx* extensions for every Python release; we'd like to build more third party modules
    • Future - I'd like to reduce the amount of manual work involved in installing a new Python version. I'd like to tie in with the platform's package management system. I'd like to see nightly builds from CVS made available to crew members.
    • Plan - Install Python 2.2 and Python 2.3 with our normal third party modules as locally built software in /usr/local/. That will ensure some continuity in the short term when we move to the new Starship. After the move is complete, we can spend some time later to work out how we want to handle our local Python installations on a Debian machine. Then I'll remove the hand-built /usr/local/ installs and implement the new strategy.
  • compare /etc/{passwd,group,shadow} and friends on both ships, evaluate migration strategy of credential data (critical path)
    user credential transfer will be greatly simplified by starship policy of using ssh keys for authentication. So the (shadowed) passwords will be a local secret ... greg wrote a little script already
    [done: gward ;) ]

Tasks for python.net DNS

  • find/select a good DNS provider (not critical path, but desirable)


    (sdrees uses schlundtechnologies.com and has no complaints about it and has finalized transfer of python2.net to schlundtechnologies.com)
    (gward uses dyndns.org and has no complaints about it)
    (alternately, we could run the primary nameserver on starship, and use a commercial provider for the secondary nameserver)

  • transfer python.net domain to new DNS provider (not critical path, but desirable)


    (currently the DNS servers are at zope.com/baymountain.com, and Starship admins cannot edit the python.net DNS records)
    [assigned: tismer (he owns the domain!)]

Detailed transfer plan

The transfer itself start at 2003-08-27 14:30 UTC.

  • disabled logins on old starship
  • shut down Exim, Courier-IMAP on old starship
  • disabled any other user processes that might update the disk (eg. CGI scripts that write state)
  • remounted home read-only on old machine
  • rsynced user directories (this assumed the main bulk transfer had already been done)
  • ensured ftpd running and working on new machine
  • changed canonical name of new machine to starship.python.net (not being able fixing reverse DNS resolution, since hosting provider is not capable ...)
  • edit Apache config for name change (drydock -> starship) and restart

    • [done: jim 2003/08/27]
  • edit Exim config for name change and restart
  • DNS change so "starship.python.net" resolves to the new machine
  • start Exim, Courier-IMAP on new machine
  • enable user logins on new machine

Transfer completed at 2003-08-28 03:11 UTC.

Thanks to everyone who participated!


CategoryPythonWebsite

StarshipTransfer (last edited 2008-11-15 14:00:08 by localhost)

Unable to edit the page? See the FrontPage for instructions.