|
Size: 1839
Comment: updated progress
|
Size: 2918
Comment: link to some diffs
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 3: | Line 3: |
| * PEP 302: added in Jython 2.2 | * PEP 302 style zipimport module '''''Added in r3463''''' * number of misc. Jython bug fixes '''''most already committed''''' |
| Line 7: | Line 9: |
| * PEP 273 (the zipimport module) - Jython's ZipFileImporter is somewhat different that the CPython zipimport module -- it's not a module, and it does not maintain its own _zip_importer_cache (which setuptools utilizes) apart from sys.path_importer_cache |
* the kicker, a working os.chdir. I hacked together [http://hg.underboss.org/jython-pjenvey/rev/51246729a616 a really quick version of this ], and setuptools was able to get pretty far at installing Pylons. Pylons itself and a number of its dependencies installed fine, but the process died installing the decorator module due to marshal raising a KeyError * working marshal. setuptools uses marshal.load, and there's some bugs with our current marshaller * tarfile module. This requires [http://hg.underboss.org/jython-pjenvey/rev/3507a9b953fa a small patch to PyString] to work for setuptools. I believe it may require some additions to the os module for test_tarfile.py to pass * a valid sys.executable. required by setuptools and distutils for spawning subprocesses. It's impossible to determine argv[0] from java: I'm thinking the jython executable should pass this information along to Jython (java -Dpython.executable=$0) * distutils: requires [http://hg.underboss.org/jython-pjenvey/rev/1026fe32c01c a number of small patches]: |
| Line 10: | Line 19: |
| - The Jython zipimport machinery is different: ZipFileImporter only imports zips if they're SyspathArchives: currently .zips and .jars. How does CPython zipimport identify .eggs in sys.path as .zips? (needed for the ez_setup bootstrap process) '''''I've got a mostly working implementation of a CPython like zipimport (it would replace ZipFileImporter and possibly SyspathArchive''''' * distutils - requires this small patch: http://pylonshq.com/pasties/390 (jython's sys.executable is None) - also requires a number of mappings for os.name == 'java' for file installation locations - also requires a jython spawn-like function: "error: don't know how to spawn programs on platform 'java'". Not sure what to use for that at this point |
- distutils metadata for the os.name == 'java' (like path names, default bdist type, etc) - a jython spawn-like function: "error: don't know how to spawn programs on platform 'java'". os.system works as a replacement - a valid sys.executable |
| Line 22: | Line 26: |
| - I've begun taking a look at implementing mkstemp/NamedTemporaryFile with Java's secure File.createTempFile | - I have [http://jython.org/patches/1783692 patch #1783692] implementing mkstemp (without a valid file descriptor) and NamedTemporaryFile with Java's secure File.createTempFile '''* See below''' * imp.acquire/release_lock This is just a simple lock, but may have to be used by internal imp operations. I'm not sure |
| Line 24: | Line 31: |
| '''''I have a mostly working implementation of this''''' | * setuptools runs a test to ensure .pth files work by running "sys.executable -E -c pass". -E is ignore environment on CPython, but is different on Jython (takes an argument): -E codec : Use a different codec the reading from the console. * a site-packages dir (jython needs to include it on sys.path by default) * A few small maybe upstream patches to setuptools, this includes so far: - use tempfile.NamedTemporaryFile instead of tempfile.mkstemp (Java/Jython doesn't allow usage of file descriptors). This will also remove a usage of os.open '''* See below''' |
| Line 26: | Line 41: |
| * os.open is used for a small hack having to do with usage of tempfile.mkstemp - This is somewhat problematic because even the best Jython mkstemp implementation won't return a file descriptor (No raw file descriptors in java), but setuptools can possibly be patched to use NamedTemporaryFile instead |
- wrap uses of os.chmod in hasattr(os, 'chmod') '''* See below''' |
| Line 29: | Line 43: |
| '''''Patched this for now. I think a reasonable patch can be integrated to setuptools to avoid using mkstemp''''' | - sandbox may assume os.open (and maybe others) exist '''* See below''' |
| Line 31: | Line 45: |
| * imp.acquire/release_lock '''''Made this no-op for now -- is just a simple lock''''' |
- setuptools cut and pasted shutil's rmtree from CPython 2.3, which uses lstat to check for directories. This may need to change to os.path.isdir (Jython might be able to do lstat, though) - '''*I'm looking into faking file descriptors in Jython, allowing the os.open and mkstemp APIs to work -pjenvey''' |
Setuptools requirements:
PEP 302 style zipimport module Added in r3463
number of misc. Jython bug fixes most already committed
We don't have:
the kicker, a working os.chdir. I hacked together [http://hg.underboss.org/jython-pjenvey/rev/51246729a616 a really quick version of this ], and setuptools was able to get pretty far at installing Pylons. Pylons itself and a number of its dependencies installed fine, but the process died installing the decorator module due to marshal raising a KeyError
- working marshal. setuptools uses marshal.load, and there's some bugs with our current marshaller
tarfile module. This requires [http://hg.underboss.org/jython-pjenvey/rev/3507a9b953fa a small patch to PyString] to work for setuptools. I believe it may require some additions to the os module for test_tarfile.py to pass
- a valid sys.executable. required by setuptools and distutils for spawning subprocesses. It's impossible to determine argv[0] from java: I'm thinking the jython executable should pass this information along to Jython (java -Dpython.executable=$0)
distutils: requires [http://hg.underboss.org/jython-pjenvey/rev/1026fe32c01c a number of small patches]:
- - distutils metadata for the os.name == 'java' (like path names, default bdist type, etc) - a jython spawn-like function: "error: don't know how to spawn programs on platform 'java'". os.system works as a replacement - a valid sys.executable
- tempfile.mkstemp
- I have [http://jython.org/patches/1783692 patch #1783692] implementing mkstemp (without a valid file descriptor) and NamedTemporaryFile with Java's secure File.createTempFile * See below
- imp.acquire/release_lock
- This is just a simple lock, but may have to be used by internal imp operations. I'm not sure
- setuptools runs a test to ensure .pth files work by running "sys.executable -E -c pass". -E is ignore environment on CPython, but is different on Jython (takes an argument):
- -E codec : Use a different codec the reading from the console.
- a site-packages dir (jython needs to include it on sys.path by default)
- A few small maybe upstream patches to setuptools, this includes so far:
- use tempfile.NamedTemporaryFile instead of tempfile.mkstemp (Java/Jython doesn't allow usage of file descriptors). This will also remove a usage of os.open * See below
- wrap uses of os.chmod in hasattr(os, 'chmod') * See below
- sandbox may assume os.open (and maybe others) exist * See below - setuptools cut and pasted shutil's rmtree from CPython 2.3, which uses lstat to check for directories. This may need to change to os.path.isdir (Jython might be able to do lstat, though)
- *I'm looking into faking file descriptors in Jython, allowing the os.open and mkstemp APIs to work -pjenvey