Differences between revisions 2 and 76 (spanning 74 versions)
Revision 2 as of 2005-11-15 04:49:19
Size: 2799
Editor: r200-40-245-207-dialup
Comment: Little glitch
Revision 76 as of 2010-03-04 15:15:15
Size: 11056
Editor: PaulBoddie
Comment: Reordered, tidied.
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
The intent of this page is to list the most commonly used Python modules, in hopes that it will provide useful for other programmers (especially beginners). #pragma section-numbers off
= Useful Modules, Packages and Libraries =
The intent of this page is to list some of the most commonly used Python modules, in the hope that it will provide useful recommendations for other programmers (especially beginners). Remember that in addition to the listings below, there are other directories of Python modules - see PublishingPythonModules for details. Another collection of library details can be found on the [[Libraries]] page.
Line 3: Line 5:
Please avoid listing modules that either:
 * You have made
 * Don't have community aproval (ie: are not widely used, are regarded as "unpythonic")
Be warned that this list is subjective by its very nature - it is only intended as a helpful guide. It is not definitive in any way, nor should it discourage developers from developing their own modules.

=== Cryptography ===
 * [[Cryptography|Python and Cryptography]]
=== Database ===
 * [[http://www.sqlalchemy.org/|SQLAlchemy]] or [[http://sqlobject.org/|SQLObject]] - Provides an object oriented way of accessing several different database systems
 * DatabaseInterfaces
 * See also DatabaseProgramming for guidance.
=== Foreign Function Interface ===
 * [[http://starship.python.net/crew/theller/ctypes/|CTypes]] - A package for calling the functions of dlls/shared libraries. Now included with Python 2.5 and up.
=== Game Development ===
 * [[http://www.pygame.org/|PyGame]] - Principal wrapper of the SDL library.
 * See also GameProgramming. A more comprehensive list of packages can be found on the PythonGameLibraries page.
=== GIS (Geographic Information System) ===
 * [[GIS/Web_services|GIS Web services]] - Packages to access to Google Maps, Yahoo! Maps… and more information
=== GUI ===
 * PyGtk - Bindings for the cross-platform Gtk toolkit.
 * PyQt - Bindings for the cross-platform Qt framework.
 * TkInter - The traditional Python user interface toolkit.
 * WxPython - wxWidgets bindings for Python supporting PythonCard, [[Wax]] and other frameworks.
 * PyjamasDesktop - Bindings and a framework for the cross-platform [[http://webkit.org|webkit]].
 * GUI Programming is, in many cases, a matter of taste. See a more extensive list on the GuiProgramming page.
==== Console ====
 * [[Console/Ascii_table|Ascii Table]] packages

=== HTML Forms ===
 * [[http://wwwsearch.sourceforge.net/ClientForm/|ClientForm]] - "!ClientForm is a Python module for handling HTML forms on the client side, useful for parsing HTML forms, filling them in and returning the completed forms to the server. It developed from a port of Gisle Aas' Perl module HTML::Form, from the libwww-perl library, but the interface is not the same." - from the website.
 * [[http://formencode.org/|FormEncode]]
 * [[http://codespeak.net/lxml/|lxml.html]] has support for dealing with forms in HTML documents
 * See also the WebProgramming and WebFrameworks pages.
=== HTML Parser ===
 * [[http://www.crummy.com/software/BeautifulSoup/|Beautiful Soup]] - HTML/XML parser designed for quick turnaround projects like screen-scraping, will accept bad markup.
 * [[http://www.egenix.com/products/python/mxExperimental/mxTidy/|mxTidy]] - HTML cleanup tool. This is a library version of the popular HTML Tidy command-line application which will convert HTML (even badly formatted) into e.g. XHTML.
 * [[http://codespeak.net/lxml/|lxml.html]] is a very fast, easy-to-use and versatile library for handling (and fixing up) HTML
 * See also PythonXml for related tools.
=== ID3 Handling ===
 * [[http://www.sacredchao.net/quodlibet/wiki/Development/Mutagen|Mutagen]] - Mutagen is a Python module to handle audio metadata. It supports FLAC, M4A, Musepack, MP3, Ogg FLAC, Ogg Speex, Ogg Theora, Ogg Vorbis, True Audio, and !WavPack audio files. All versions of ID3v2 are supported, and all standard ID3v2.4 frames are parsed. It can read Xing headers to accurately calculate the bitrate and length of MP3s. ID3 and APEv2 tags can be edited regardless of audio format. It can also manipulate Ogg streams on an individual packet/page level.
 * [[http://www.nedbatchelder.com/code/modules/id3reader.html|ID3Reader]] - "Id3reader.py is a Python module that reads ID3 metadata tags in MP3 files. It can read ID3v1, ID3v2.2, ID3v2.3, or ID3v2.4 tags. It does not write tags at all" (from site). Used in ID3Writer
 * [[http://www.comfortableshoe.co.uk/cgi-bin/blosxom.cgi/Home/Python/id3Writer.comments|ID3Writer]] - Writes ID3 Tags for mp3s (both v1 and v2, as necessary). No Unicode support as of yet. Uses ID3Reader.
 * [[http://sourceforge.net/projects/pyid3|PyID3]] - ""(Appears to be inactive)""Module for manipulating ID3 informational tags in MP3 audio files. Not as good as ID3Writer, but no issues w/ genre, unlike ID3Writer.
 * [[http://www.liquidx.net/pytagger/|pytagger]] - tag reader and writer implemented purely in Python. Supports ID3v1, ID3v1.1, ID3v2.2, ID3v2.3 and ID3v2.4
=== Image Manipulation ===
 * [[http://www.pythonware.com/products/pil/|Python Imaging Library (PIL)]] - Supports many file formats, and provides powerful image processing and graphics capabilities.
=== Indexing and Searching ===
 * InformationRetrieval
=== Java ===
 * [[ScriptingJava|Java scripting]]
=== Networking ===
 * TwistedMatrix - Event-driven networking framework
 * [[http://rpyc.wikispaces.com|RPyC]] - Transparent RPC/distributed-computing framework
 * [[http://pyro.sourceforge.net|PyRO]] - powerful OO RPC
 * [[http://code.google.com/p/httplib2/|HTTPLib2]] - A comprehensive HTTP client library that supports many features left out of other HTTP libraries, like httplib on the standard library.
=== Platform Specific ===
 * [[http://psyco.sourceforge.net/|Psyco]] - Psyco can speed up the execution of any Python code (x86 only).
 * [[http://pyinstaller.hpcf.upr.edu/cgi-bin/trac.cgi|PyInstaller]] - Packages Python programs into stand-alone executables, under Windows, Linux and Irix.
==== Mac ====
 * [[http://pythonmac.org/wiki/py2app|py2app]] - Creates stand-alone apps (like py2exe for Mac)
 * [[http://pyobjc.sourceforge.net|PyObjC]] - Bridge between the Python and Objective-C. Most important usage of this is writing Cocoa GUI applications on Mac OS X in pure Python
==== Windows ====
 * [[https://sourceforge.net/projects/pywin32/|PyWin32]] - Python extensions for Windows.
 * [[http://www.py2exe.org/|Py2exe]] - Converts python scripts into executable windows programs, able to run without requiring a python installation.
=== Plotting ===
 * [[http://code.enthought.com/chaco/|Chaco]] - Creates interactive plots
 * [[http://gnuplot-py.sourceforge.net/|gnuplot.py]] - Based on gnuplot
 * [[http://matplotlib.sourceforge.net/|Matplotlib]] - Production quality output in a wide variety of formats
 * [[http://pyx.sourceforge.net/|PyX]] - Postscript and PDF output, (La)TeX integration
 * [[http://www.reportlab.org/|ReportLab]] includes a charting package
 * [[http://home.gna.org/veusz/|Veusz]] - Postscript output with a PyQt front end
The SciPy [[http://scipy.org/Topical_Software#head-b98ffdb309ccce4e4504a25ea75b5c806e4897b6|topical software]] page has a longer list.

=== RDF Processing ===
 * See RdfLibraries for a list of available RDF processing solutions.
=== Scientific ===
 * [[http://vpython.org/|Visual Python]] - Offers real-time 3D output, is easily usable by novice programmers, excellent for physics.
 * [[http://www.scipy.org/|SciPy]] - Includes modules for graphics and plotting, optimization, integration, special functions, signal and image processing, genetic algorithms, ODE solvers, and others.
 * [[http://rpy.sourceforge.net/|Python Bindings for R]] - R is a well known, open source (GPL 2) statistical package. RPy has two versions. Version 2 is still in development but is already usable.
 * [[numpy]]
 * [[http://www.vni.com/campaigns/pyimslstudioeval|PyIMSL]] is a collection of Python wrappers to the mathematical and statistical algorithms in the IMSL C Numerical Library. Developers can use Python, PyIMSL and the IMSL C Numerical Library for rapid prototyping. [[http://www.vni.com/campaigns/pyimslstudioeval|PyIMSL Studio]] is a complete packaged, supported and documented development environment designed for deploying mathematics and statistics prototype models into production applications. PyIMSL Studio includes the PyIMSL wrappers, the IMSL C Numerical Library, a Python distribution and a selection of open source python modules useful for prototype analytical development. PyIMSL Studio is available for download at no charge for non-commercial use or for commercial evaluation.
=== Standard Library Enhancements ===
 * [[http://www.jorendorff.com/articles/python/path/|Python Path]] - Wraps the functionality of the os.path module and provides something more convenient.
=== Threading ===
 * [[http://chrisarndt.de/projects/threadpool/|ThreadPool]] - Intuitive approach to threads, well-explained.
 * See the ParallelProcessing page for other multiprocessing or parallel processing approaches.
=== Web Development ===
 * [[http://www.djangoproject.com|Django]] - High-level Python Web framework
 * [[http://www.turbogears.org|TurboGears]] - Rapid web development megaframework.
 * [[http://pylonshq.com|Pylons]] - A lightweight Web framework emphasizing flexibility and rapid development.
 * See a more complete list of topics on the WebProgramming page and frameworks on the WebFrameworks page.
=== Workflow ===
 * [[http://www.openflow.it/Openflow|openflow]] - A workflow engine for Zope 2.
 * [[http://code.djangoproject.com/wiki/GoFlow|Goflow]] - A workflow engine for Django, with same design as openflow.
=== XML Processing ===
 * [[http://effbot.org/zone/element-index.htm|ElementTree]] - The Element type is a simple but flexible container object, designed to store hierarchical data structures, such as simplified XML infosets, in memory. --Note: Python 2.5 and up has ElementTree in the Standard Library--
 * [[http://codespeak.net/lxml/|lxml]] is a very fast, easy-to-use and versatile library for XML handling that is mostly compatible with but much more feature-rich than ElementTree
 * [[http://wiki.xml3k.org/Amara2|Amara]] - Amara provides tools you can trust to conform with XML standards without losing the familiar Python feel. (see also the [[http://wiki.xml3k.org/Amara|1.x version]])
 * PythonXml provides a list of available XML processing solutions.

== Editorial Notes ==
Please avoid listing modules where...

 * You are one of the developers (and you just want to promote your work somewhere).
 * The modules in question do not have widespread approval or usage.
If you do want to make people aware of a module, package or library (perhaps your own), consider submitting it to one or more of the directories mentioned in PublishingPythonModules, perhaps also adding it to the topic-specific part of this site (eg. WebProgramming, GuiProgramming).
Line 8: Line 110:
Line 9: Line 112:

Be warned that this list is subjective by its very nature. It's only intended as a helpful guide. It is not definitive in any way, nor should it discourage developers into developing their own modules.

Please provide a short description for each module. Try to put each module in the category that matchs it's "main" audience, since a module might fall into a couple of categories.

[[TableOfContents]]

=== Game development ===
 * [http://www.pygame.org/ PyGame] - Wrapper to the SDL library.

=== General category ===
 * [http://www.jorendorff.com/articles/python/path/ Python Path] - Wraps the functionality in the os.path module.

=== GUI ===
 * [http://www.wxpython.org/ wxPython] - wxWidgets bindings to Python.
 * [http://pythoncard.sourceforge.net/ PythonCard] - Framework built on top of wxPython

=== HTML Parser ===
 * [http://www.crummy.com/software/BeautifulSoup/ Beautiful Soup] - HTML/XML parser designed for quick turnaround projects like screen-scraping, will accept bad markup.

=== Scientific ===
 * [http://vpython.org/ Visual Python] - Offers real-time 3D output, is easily usable by novice programmers, excellent for physics.
 * [http://www.scipy.org/ SciPy] - Includes modules for graphics and plotting, optimization, integration, special functions, signal and image processing, genetic algorithms, ODE solvers, and others.

=== Web development ===
 * [http://www.turbogears.org TurboGears] - Rapid web development megaframework.

=== Platform specific ===
 * [http://psyco.sourceforge.net/ Psyco] - Psyco can speed up the execution of any Python code (x86 only).
 * [http://pyinstaller.hpcf.upr.edu/cgi-bin/trac.cgi PyInstaller] - Packages Python programs into stand-alone executables, under Windows, Linux and Irix.
==== Linux ====
==== Mac ====
 * [http://pythonmac.org/wiki/py2app py2app] - Creates stand-alone apps (like py2exe for Mac)
==== Windows ====
 * [https://sourceforge.net/projects/pywin32/ PyWin32] - Python extensions for Windows.
 * [http://www.py2exe.org/ Py2exe] - Converts python scripts into executable windows programs, able to run without requiring a python installation.

=== XML Processing ===
 * [http://effbot.org/zone/element-index.htm ElementTree] - The Element type is a simple but flexible container object, designed to store hierarchical data structures, such as simplified XML infosets, in memory.
Please provide a short description for each module. Try to put each module in the category that matches its "main" audience, since a module might fall into a number of categories.

Useful Modules, Packages and Libraries

The intent of this page is to list some of the most commonly used Python modules, in the hope that it will provide useful recommendations for other programmers (especially beginners). Remember that in addition to the listings below, there are other directories of Python modules - see PublishingPythonModules for details. Another collection of library details can be found on the Libraries page.

Be warned that this list is subjective by its very nature - it is only intended as a helpful guide. It is not definitive in any way, nor should it discourage developers from developing their own modules.

Cryptography

Database

Foreign Function Interface

  • CTypes - A package for calling the functions of dlls/shared libraries. Now included with Python 2.5 and up.

Game Development

GIS (Geographic Information System)

  • GIS Web services - Packages to access to Google Maps, Yahoo! Maps… and more information

GUI

  • PyGtk - Bindings for the cross-platform Gtk toolkit.

  • PyQt - Bindings for the cross-platform Qt framework.

  • TkInter - The traditional Python user interface toolkit.

  • WxPython - wxWidgets bindings for Python supporting PythonCard, Wax and other frameworks.

  • PyjamasDesktop - Bindings and a framework for the cross-platform webkit.

  • GUI Programming is, in many cases, a matter of taste. See a more extensive list on the GuiProgramming page.

Console

HTML Forms

  • ClientForm - "ClientForm is a Python module for handling HTML forms on the client side, useful for parsing HTML forms, filling them in and returning the completed forms to the server. It developed from a port of Gisle Aas' Perl module HTML::Form, from the libwww-perl library, but the interface is not the same." - from the website.

  • FormEncode

  • lxml.html has support for dealing with forms in HTML documents

  • See also the WebProgramming and WebFrameworks pages.

HTML Parser

  • Beautiful Soup - HTML/XML parser designed for quick turnaround projects like screen-scraping, will accept bad markup.

  • mxTidy - HTML cleanup tool. This is a library version of the popular HTML Tidy command-line application which will convert HTML (even badly formatted) into e.g. XHTML.

  • lxml.html is a very fast, easy-to-use and versatile library for handling (and fixing up) HTML

  • See also PythonXml for related tools.

ID3 Handling

  • Mutagen - Mutagen is a Python module to handle audio metadata. It supports FLAC, M4A, Musepack, MP3, Ogg FLAC, Ogg Speex, Ogg Theora, Ogg Vorbis, True Audio, and WavPack audio files. All versions of ID3v2 are supported, and all standard ID3v2.4 frames are parsed. It can read Xing headers to accurately calculate the bitrate and length of MP3s. ID3 and APEv2 tags can be edited regardless of audio format. It can also manipulate Ogg streams on an individual packet/page level.

  • ID3Reader - "Id3reader.py is a Python module that reads ID3 metadata tags in MP3 files. It can read ID3v1, ID3v2.2, ID3v2.3, or ID3v2.4 tags. It does not write tags at all" (from site). Used in ID3Writer

  • ID3Writer - Writes ID3 Tags for mp3s (both v1 and v2, as necessary). No Unicode support as of yet. Uses ID3Reader.

  • PyID3 - ""(Appears to be inactive)""Module for manipulating ID3 informational tags in MP3 audio files. Not as good as ID3Writer, but no issues w/ genre, unlike ID3Writer.

  • pytagger - tag reader and writer implemented purely in Python. Supports ID3v1, ID3v1.1, ID3v2.2, ID3v2.3 and ID3v2.4

Image Manipulation

Indexing and Searching

Java

Networking

  • TwistedMatrix - Event-driven networking framework

  • RPyC - Transparent RPC/distributed-computing framework

  • PyRO - powerful OO RPC

  • HTTPLib2 - A comprehensive HTTP client library that supports many features left out of other HTTP libraries, like httplib on the standard library.

Platform Specific

  • Psyco - Psyco can speed up the execution of any Python code (x86 only).

  • PyInstaller - Packages Python programs into stand-alone executables, under Windows, Linux and Irix.

Mac

  • py2app - Creates stand-alone apps (like py2exe for Mac)

  • PyObjC - Bridge between the Python and Objective-C. Most important usage of this is writing Cocoa GUI applications on Mac OS X in pure Python

Windows

  • PyWin32 - Python extensions for Windows.

  • Py2exe - Converts python scripts into executable windows programs, able to run without requiring a python installation.

Plotting

  • Chaco - Creates interactive plots

  • gnuplot.py - Based on gnuplot

  • Matplotlib - Production quality output in a wide variety of formats

  • PyX - Postscript and PDF output, (La)TeX integration

  • ReportLab includes a charting package

  • Veusz - Postscript output with a PyQt front end

The SciPy topical software page has a longer list.

RDF Processing

  • See RdfLibraries for a list of available RDF processing solutions.

Scientific

  • Visual Python - Offers real-time 3D output, is easily usable by novice programmers, excellent for physics.

  • SciPy - Includes modules for graphics and plotting, optimization, integration, special functions, signal and image processing, genetic algorithms, ODE solvers, and others.

  • Python Bindings for R - R is a well known, open source (GPL 2) statistical package. RPy has two versions. Version 2 is still in development but is already usable.

  • numpy

  • PyIMSL is a collection of Python wrappers to the mathematical and statistical algorithms in the IMSL C Numerical Library. Developers can use Python, PyIMSL and the IMSL C Numerical Library for rapid prototyping. PyIMSL Studio is a complete packaged, supported and documented development environment designed for deploying mathematics and statistics prototype models into production applications. PyIMSL Studio includes the PyIMSL wrappers, the IMSL C Numerical Library, a Python distribution and a selection of open source python modules useful for prototype analytical development. PyIMSL Studio is available for download at no charge for non-commercial use or for commercial evaluation.

Standard Library Enhancements

  • Python Path - Wraps the functionality of the os.path module and provides something more convenient.

Threading

  • ThreadPool - Intuitive approach to threads, well-explained.

  • See the ParallelProcessing page for other multiprocessing or parallel processing approaches.

Web Development

  • Django - High-level Python Web framework

  • TurboGears - Rapid web development megaframework.

  • Pylons - A lightweight Web framework emphasizing flexibility and rapid development.

  • See a more complete list of topics on the WebProgramming page and frameworks on the WebFrameworks page.

Workflow

  • openflow - A workflow engine for Zope 2.

  • Goflow - A workflow engine for Django, with same design as openflow.

XML Processing

  • ElementTree - The Element type is a simple but flexible container object, designed to store hierarchical data structures, such as simplified XML infosets, in memory. --Note: Python 2.5 and up has ElementTree in the Standard Library--

  • lxml is a very fast, easy-to-use and versatile library for XML handling that is mostly compatible with but much more feature-rich than ElementTree

  • Amara - Amara provides tools you can trust to conform with XML standards without losing the familiar Python feel. (see also the 1.x version)

  • PythonXml provides a list of available XML processing solutions.

Editorial Notes

Please avoid listing modules where...

  • You are one of the developers (and you just want to promote your work somewhere).
  • The modules in question do not have widespread approval or usage.

If you do want to make people aware of a module, package or library (perhaps your own), consider submitting it to one or more of the directories mentioned in PublishingPythonModules, perhaps also adding it to the topic-specific part of this site (eg. WebProgramming, GuiProgramming).

Do list modules that:

  • Get recommended often in the Tutor or comp.lang.python lists

Please provide a short description for each module. Try to put each module in the category that matches its "main" audience, since a module might fall into a number of categories.

UsefulModules (last edited 2021-09-04 03:08:16 by HorstJENS)

Unable to edit the page? See the FrontPage for instructions.