Differences between revisions 101 and 103 (spanning 2 versions)
Revision 101 as of 2012-05-14 18:41:49
Size: 13074
Editor: inyo
Comment: Added link to pyqtgraph library
Revision 103 as of 2012-11-12 19:04:57
Size: 13858
Editor: 184-76-253-171
Comment: wiki restore 2013-01-23
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
#pragma section-numbers off
Line 6: Line 5:
The intent of this page is to list some of the most commonly used Python modules, in the hope that it will provide useful recommendations for other programmers (especially beginners). Remember that in addition to the listings below, there are other directories of Python modules - see PublishingPythonModules for details. Another collection of library details can be found on the [[Libraries]] page.

The intent of this page is to list some of the most commonly used Python modules, in the hope that it will provide useful recommendations for other programmers (especially beginners). Remember that in addition to the listings below, there are other directories of Python modules - see [[PublishingPythonModules|PublishingPythonModules]] for details. Another collection of library details can be found on the [[Libraries|Libraries]] page.
Line 10: Line 12:
Line 11: Line 14:

Line 13: Line 18:
Line 14: Line 20:

Line 15: Line 23:
 * DatabaseInterfaces
 * See also DatabaseProgramming for guidance.
 * [[DatabaseInterfaces|DatabaseInterfaces]]
 * See also [[DatabaseProgramming|DatabaseProgramming]] for guidance.
Line 19: Line 28:

Line 22: Line 33:
Line 23: Line 35:

Line 24: Line 38:
 * See also GameProgramming. A more comprehensive list of packages can be found on the PythonGameLibraries page.  * See also [[GameProgramming|GameProgramming]]. A more comprehensive list of packages can be found on the [[PythonGameLibraries|PythonGameLibraries]] page.
Line 27: Line 42:

Line 29: Line 46:
Line 30: Line 48:
 * PyGtk - Bindings for the cross-platform Gtk toolkit.
 * PyQt - Bindings for the cross-platform Qt framework.
 * TkInter - The traditional Python user interface toolkit.
 * WxPython - wxWidgets bindings for Python supporting PythonCard, [[Wax]] and other frameworks.
 * PyjamasDesktop - Bindings and a framework for the cross-platform [[http://webkit.org|webkit]].
 * GUI Programming is, in many cases, a matter of taste. See a more extensive list on the GuiProgramming page.


* [[PyGtk|PyGtk]] - Bindings for the cross-platform Gtk toolkit.
 * [[PyQt|PyQt]] - Bindings for the cross-platform Qt framework.
 * [[TkInter|TkInter]] - The traditional Python user interface toolkit.
 * [[WxPython|WxPython]] - wxWidgets bindings for Python supporting [[PythonCard|PythonCard]], [[Wax|Wax]] and other frameworks.
 * [[PyjamasDesktop|PyjamasDesktop]] - Bindings and a framework for the cross-platform [[http://webkit.org|webkit]].
 * GUI Programming is, in many cases, a matter of taste. See a more extensive list on the [[GuiProgramming|GuiProgramming]] page.
Line 38: Line 59:

Line 40: Line 63:
Line 41: Line 65:
 * [[http://code.google.com/p/mutagen/|Mutagen]] - Mutagen is a Python module to handle audio metadata. It supports FLAC, M4A, Musepack, MP3, Ogg FLAC, Ogg Speex, Ogg Theora, Ogg Vorbis, True Audio, and !WavPack audio files. All versions of ID3v2 are supported, and all standard ID3v2.4 frames are parsed. It can read Xing headers to accurately calculate the bitrate and length of MP3s. ID3 and APEv2 tags can be edited regardless of audio format. It can also manipulate Ogg streams on an individual packet/page level.
 * [[http://www.nedbatchelder.com/code/modules/id3reader.html|ID3Reader]] - "Id3reader.py is a Python module that reads ID3 metadata tags in MP3 files. It can read ID3v1, ID3v2.2, ID3v2.3, or ID3v2.4 tags. It does not write tags at all" (from site). Used in ID3Writer.  Does not work with Python 3000. Not maintained since 2006.


* [[http://code.google.com/p/mutagen/|Mutagen]] - Mutagen is a Python module to handle audio metadata. It supports FLAC, M4A, Musepack, MP3, Ogg FLAC, Ogg Speex, Ogg Theora, Ogg Vorbis, True Audio, and WavPack audio files. All versions of ID3v2 are supported, and all standard ID3v2.4 frames are parsed. It can read Xing headers to accurately calculate the bitrate and length of MP3s. ID3 and APEv2 tags can be edited regardless of audio format. It can also manipulate Ogg streams on an individual packet/page level.
 * [[http://www.nedbatchelder.com/code/modules/id3reader.html|ID3Reader]] - "Id3reader.py is a Python module that reads ID3 metadata tags in MP3 files. It can read ID3v1, ID3v2.2, ID3v2.3, or ID3v2.4 tags. It does not write tags at all" (from site). Used in ID3Writer. Does not work with Python 3000. Not maintained since 2006.
Line 46: Line 72:
 * [[http://pypi.python.org/pypi/hsaudiotag3k#downloads | hsaudiotag]] - Py3k - hsaudiotag is a pure Python library that lets you read metadata (bitrate, sample rate, duration and tags) from mp3, mp4, wma, ogg, flac and aiff files. It can only read tags, not write to them, but unlike more complete libraries (like Mutagen), it is BSD licensed.  * [[http://pypi.python.org/pypi/hsaudiotag3k#downloads|hsaudiotag]] - Py3k - hsaudiotag is a pure Python library that lets you read metadata (bitrate, sample rate, duration and tags) from mp3, mp4, wma, ogg, flac and aiff files. It can only read tags, not write to them, but unlike more complete libraries (like Mutagen), it is BSD licensed.
Line 49: Line 76:

Line 50: Line 79:
 * [[http://luke.campagnola.me/code/pyqtgraph/|pyqtgraph]] - Pure-python graphics library for scientific applications with image/video display, multidimensional image slicing, and interactive manipulation tools.  * [[http://www.pyqtgraph.org/|pyqtgraph]] - Pure-python graphics library for scientific applications with image/video display, multidimensional image slicing, and interactive manipulation tools.
Line 53: Line 83:
 * InformationRetrieval

* [[InformationRetrieval|InformationRetrieval]]
Line 56: Line 89:

Line 58: Line 93:
Line 59: Line 95:

Line 61: Line 99:
 * TwistedMatrix - Event-driven networking framework  * [[http://twistedmatrix.com|TwistedMatrix]] - Event-driven networking framework
Line 65: Line 103:
 * [[http://celeryproject.org|Celery]] - Distributed task queue for out of band processing/RPC and more.
Line 67: Line 107:

Line 69: Line 111:

Line 70: Line 114:

Line 72: Line 118:

Line 73: Line 121:

Line 76: Line 126:
Line 77: Line 128:

Line 82: Line 135:
 * [[http://home.gna.org/veusz/|Veusz]] - Postscript output with a PyQt front end
 * [[http://luke.campagnola.me/code/pyqtgraph/|pyqtgraph]] - Pure-python plotting and graphics library based on PyQt and numpy.
The SciPy [[http://scipy.org/Topical_Software#head-b98ffdb309ccce4e4504a25ea75b5c806e4897b6|topical software]] page has a longer list.
 * [[http://home.gna.org/veusz/|Veusz]] - Postscript output with a [[PyQt|PyQt]] front end
 * [[http://www.pyqtgraph.org/|pyqtgraph]] - Pure-python plotting and graphics library based on [[PyQt|PyQt]] and numpy.


The [[SciPy|SciPy]] [[http://scipy.org/Topical_Software#head-b98ffdb309ccce4e4504a25ea75b5c806e4897b6|topical software]] page has a longer list.
Line 87: Line 143:
 * [[http://docutils.sourceforge.net/docs/user/tools.html#rst2s5-py]] - Create HTML slides from .rst files
 * [[http://seld.be/notes/introducing-slippy-html-presentations]] - For your Python presentations in browser


* http://docutils.sourceforge.net/docs/user/tools.html#rst2s5-py - Create HTML slides from .rst files
 * http://seld.be/notes/introducing-slippy-html-presentations - For your Python presentations in browser
Line 91: Line 150:
 * See RdfLibraries for a list of available RDF processing solutions.

* See [[RdfLibraries|RdfLibraries]] for a list of available RDF processing solutions.
Line 94: Line 156:

Line 97: Line 161:
 * [[numpy]]  * [[numpy|numpy]]
Line 100: Line 164:
Line 101: Line 166:

Line 104: Line 171:
Line 105: Line 173:

Line 106: Line 176:
 * See the ParallelProcessing page for other multiprocessing or parallel processing approaches.  * See the [[ParallelProcessing|ParallelProcessing]] page for other multiprocessing or parallel processing approaches.
Line 109: Line 180:

Line 111: Line 184:
  * [[http://www.turbogears.org|TurboGears]] - Rapid web development megaframework.
  * [[http://pylonshq.com|Pylons]] - A lightweight web framework emphasizing flexibility and rapid development.
  * [[http://www.turbogears.org|TurboGears]] - Rapid web development megaframework.
  * [[http://pylonshq.com|Pylons]] - A lightweight web framework emphasizing flexibility and rapid development.
Line 115: Line 189:

* See a more complete list of topics on the WebProgramming page and frameworks on the WebFrameworks page.
 * See a more complete list of topics on the [[WebProgramming|WebProgramming]] page and frameworks on the [[WebFrameworks|WebFrameworks]] page.
Line 119: Line 193:
 * [[http://wwwsearch.sourceforge.net/ClientForm/|ClientForm]] - "!ClientForm is a Python module for handling HTML forms on the client side, useful for parsing HTML forms, filling them in and returning the completed forms to the server. It developed from a port of Gisle Aas' Perl module HTML::Form, from the libwww-perl library, but the interface is not the same." - from the website.

* [[http://wwwsearch.sourceforge.net/ClientForm/|ClientForm]] - "ClientForm is a Python module for handling HTML forms on the client side, useful for parsing HTML forms, filling them in and returning the completed forms to the server. It developed from a port of Gisle Aas' Perl module HTML::Form, from the libwww-perl library, but the interface is not the same." - from the website.
Line 122: Line 198:
 * See also the WebProgramming and WebFrameworks pages.  * See also the [[WebProgramming|WebProgramming]] and [[WebFrameworks|WebFrameworks]] pages.

Line 124: Line 202:

Line 127: Line 207:
 * See also PythonXml for related tools.  * See also [[PythonXml|PythonXml]] for related tools.
Line 130: Line 211:

Line 133: Line 216:
Line 134: Line 218:
 * [[http://effbot.org/zone/element-index.htm|ElementTree]] - The Element type is a simple but flexible container object, designed to store hierarchical data structures, such as simplified XML infosets, in memory. --Note: Python 2.5 and up has ElementTree in the Standard Library--
 * [[http://lxml.de/|lxml]] is a very fast, easy-to-use and versatile library for XML handling that is mostly compatible with but much more feature-rich than ElementTree


* [[http://effbot.org/zone/element-index.htm|ElementTree]] - The Element type is a simple but flexible container object, designed to store hierarchical data structures, such as simplified XML infosets, in memory. --Note: Python 2.5 and up has [[ElementTree|ElementTree]] in the Standard Library--
 * [[http://lxml.de/|lxml]] is a very fast, easy-to-use and versatile library for XML handling that is mostly compatible with but much more feature-rich than [[ElementTree|ElementTree]]
Line 137: Line 223:
 * PythonXml provides a list of available XML processing solutions.  * [[PythonXml|PythonXml]] provides a list of available XML processing solutions.
Line 140: Line 227:

Line 142: Line 231:
Line 143: Line 233:

Line 144: Line 236:
Line 147: Line 240:
If you do want to make people aware of a module, package or library (perhaps your own), consider submitting it to one or more of the directories mentioned in PublishingPythonModules, perhaps also adding it to the topic-specific part of this site (eg. WebProgramming, GuiProgramming).

If you do want to make people aware of a module, package or library (perhaps your own), consider submitting it to one or more of the directories mentioned in [[PublishingPythonModules|PublishingPythonModules]], perhaps also adding it to the topic-specific part of this site (eg. [[WebProgramming|WebProgramming]], [[GuiProgramming|GuiProgramming]]).
Line 151: Line 247:
Line 152: Line 249:

Useful Modules, Packages and Libraries

The intent of this page is to list some of the most commonly used Python modules, in the hope that it will provide useful recommendations for other programmers (especially beginners). Remember that in addition to the listings below, there are other directories of Python modules - see PublishingPythonModules for details. Another collection of library details can be found on the Libraries page.

Be warned that this list is subjective by its very nature - it is only intended as a helpful guide. It is not definitive in any way, nor should it discourage developers from developing their own modules.

Cryptography

Database

Foreign Function Interface

  • CTypes - A package for calling the functions of dlls/shared libraries. Now included with Python 2.5 and up.

  • Cython is an extension language for the CPython runtime. It translates Python code to fast C code and supports calling external C and C++ code natively. As opposed to ctypes, it requires a C compiler to translate the generated code.

Game Development

GIS (Geographic Information System)

  • GIS Web services - Packages to access to Google Maps, Yahoo! Maps… and more information

GUI

  • PyGtk - Bindings for the cross-platform Gtk toolkit.

  • PyQt - Bindings for the cross-platform Qt framework.

  • TkInter - The traditional Python user interface toolkit.

  • WxPython - wxWidgets bindings for Python supporting PythonCard, Wax and other frameworks.

  • PyjamasDesktop - Bindings and a framework for the cross-platform webkit.

  • GUI Programming is, in many cases, a matter of taste. See a more extensive list on the GuiProgramming page.

Console

ID3 Handling

  • Mutagen - Mutagen is a Python module to handle audio metadata. It supports FLAC, M4A, Musepack, MP3, Ogg FLAC, Ogg Speex, Ogg Theora, Ogg Vorbis, True Audio, and WavPack audio files. All versions of ID3v2 are supported, and all standard ID3v2.4 frames are parsed. It can read Xing headers to accurately calculate the bitrate and length of MP3s. ID3 and APEv2 tags can be edited regardless of audio format. It can also manipulate Ogg streams on an individual packet/page level.

  • ID3Reader - "Id3reader.py is a Python module that reads ID3 metadata tags in MP3 files. It can read ID3v1, ID3v2.2, ID3v2.3, or ID3v2.4 tags. It does not write tags at all" (from site). Used in ID3Writer. Does not work with Python 3000. Not maintained since 2006.

  • PyID3 - ""(Appears to be inactive)""Module for manipulating ID3 informational tags in MP3 audio files. Not as good as ID3Writer, but no issues w/ genre, unlike ID3Writer. Not maintained since 2007.

  • pytagger - tag reader and writer implemented purely in Python. Supports ID3v1, ID3v1.1, ID3v2.2, ID3v2.3 and ID3v2.4

  • eyeD3 - is a Python module and program for processing ID3 tags. It can extract information such as bit rate, sample frequency, play time, etc. It supports ID3 v1.0/v1.1 and v2.3/v2.4.

  • hsaudiotag - Py3k - hsaudiotag is a pure Python library that lets you read metadata (bitrate, sample rate, duration and tags) from mp3, mp4, wma, ogg, flac and aiff files. It can only read tags, not write to them, but unlike more complete libraries (like Mutagen), it is BSD licensed.

Image Manipulation

  • Python Imaging Library (PIL) - Supports many file formats, and provides powerful image processing and graphics capabilities.

  • pyqtgraph - Pure-python graphics library for scientific applications with image/video display, multidimensional image slicing, and interactive manipulation tools.

Indexing and Searching

Java

Networking

  • asyncoro - Asynchronous, concurrent programming framework with coroutines with thread-like interface

  • Gevent - Coroutine-based network library

  • TwistedMatrix - Event-driven networking framework

  • RPyC - Transparent RPC/distributed-computing framework

  • PyRO - powerful OO RPC

  • HTTPLib2 - A comprehensive HTTP client library that supports many features left out of other HTTP libraries, like httplib on the standard library.

  • Celery - Distributed task queue for out of band processing/RPC and more.

Platform-Specific

  • Psyco - Psyco can speed up the execution of any Python code (x86 only).

  • PyInstaller - Packages Python programs into stand-alone executables, under Windows, Linux and Irix.

Mac

  • py2app - Creates stand-alone apps (like py2exe for Mac)

  • PyObjC - Bridge between the Python and Objective-C. Most important usage of this is writing Cocoa GUI applications on Mac OS X in pure Python

Windows

  • PyWin32 - Python extensions for Windows.

  • Py2exe - Converts python scripts into executable windows programs, able to run without requiring a python installation.

Plotting

  • Chaco - Creates interactive plots

  • gnuplot.py - Based on gnuplot

  • Matplotlib - Production quality output in a wide variety of formats

  • PyX - Postscript and PDF output, (La)TeX integration

  • ReportLab includes a charting package

  • Veusz - Postscript output with a PyQt front end

  • pyqtgraph - Pure-python plotting and graphics library based on PyQt and numpy.

The SciPy topical software page has a longer list.

Presentation

RDF Processing

  • See RdfLibraries for a list of available RDF processing solutions.

Scientific

  • Visual Python - Offers real-time 3D output, is easily usable by novice programmers, excellent for physics.

  • SciPy - Includes modules for graphics and plotting, optimization, integration, special functions, signal and image processing, genetic algorithms, ODE solvers, and others.

  • Python Bindings for R - R is a well known, open source (GPL 2) statistical package. RPy has two versions. Version 2 is still in development but is already usable.

  • numpy

  • PyIMSL is a collection of Python wrappers to the mathematical and statistical algorithms in the IMSL C Numerical Library. Developers can use Python, PyIMSL and the IMSL C Numerical Library for rapid prototyping. PyIMSL Studio is a complete packaged, supported and documented development environment designed for deploying mathematics and statistics prototype models into production applications. PyIMSL Studio includes the PyIMSL wrappers, the IMSL C Numerical Library, a Python distribution and a selection of open source python modules useful for prototype analytical development. PyIMSL Studio is available for download at no charge for non-commercial use or for commercial evaluation.

Standard Library Enhancements

  • Python Path - Wraps the functionality of the os.path module and provides something more convenient.

  • PyLibrary - Collection of Libraries useful for Python developers.

Threading

  • ThreadPool - Intuitive approach to threads, well-explained.

  • See the ParallelProcessing page for other multiprocessing or parallel processing approaches.

Web Development

  • Django - High-level web framework.

  • Pyramid - Turbogears, Pylons, Repoz.bfg merged as Pyramid.

    • TurboGears - Rapid web development megaframework.

    • Pylons - A lightweight web framework emphasizing flexibility and rapid development.

  • web2py - High-level framework for agile development.

  • Flask - microframework for Python based on Werkzeug, Jinja 2. (It's BSD licensed)

  • See a more complete list of topics on the WebProgramming page and frameworks on the WebFrameworks page.

HTML Forms

  • ClientForm - "ClientForm is a Python module for handling HTML forms on the client side, useful for parsing HTML forms, filling them in and returning the completed forms to the server. It developed from a port of Gisle Aas' Perl module HTML::Form, from the libwww-perl library, but the interface is not the same." - from the website.

  • FormEncode

  • lxml.html has support for dealing with forms in HTML documents

  • See also the WebProgramming and WebFrameworks pages.

HTML Parser

  • Beautiful Soup - HTML/XML parser designed for quick turnaround projects like screen-scraping, will accept bad markup.

  • mxTidy - HTML cleanup tool. This is a library version of the popular HTML Tidy command-line application which will convert HTML (even badly formatted) into e.g. XHTML.

  • lxml.html is a very fast, easy-to-use and versatile library for handling (and fixing up) HTML

  • See also PythonXml for related tools.

Workflow

  • openflow - A workflow engine for Zope 2.

  • Goflow - A workflow engine for Django, with same design as openflow.

XML Processing

  • ElementTree - The Element type is a simple but flexible container object, designed to store hierarchical data structures, such as simplified XML infosets, in memory. --Note: Python 2.5 and up has ElementTree in the Standard Library--

  • lxml is a very fast, easy-to-use and versatile library for XML handling that is mostly compatible with but much more feature-rich than ElementTree

  • Amara - Amara provides tools you can trust to conform with XML standards without losing the familiar Python feel. (see also the 1.x version)

  • PythonXml provides a list of available XML processing solutions.

Flow Based Programming

Editorial Notes

Please avoid listing modules where...

  • You are one of the developers (and you just want to promote your work somewhere).
  • The modules in question do not have widespread approval or usage.

If you do want to make people aware of a module, package or library (perhaps your own), consider submitting it to one or more of the directories mentioned in PublishingPythonModules, perhaps also adding it to the topic-specific part of this site (eg. WebProgramming, GuiProgramming).

Do list modules that:

  • Get recommended often in the Tutor or comp.lang.python lists

Please provide a short description for each module. Try to put each module in the category that matches its "main" audience, since a module might fall into a number of categories.

UsefulModules (last edited 2021-09-04 03:08:16 by HorstJENS)

Unable to edit the page? See the FrontPage for instructions.