TWiki
>
GRM Web
>
Pynini
(revision 61) (raw view)
Edit
Attach
---+ OpenGrm Pynini: Finite-state grammar development in Python --- %ICON{led-red}% *Version 2.1.3 is now available for [[PyniniDownload][download]].* <br />%ICON{new}% Pynini is now available on [[https://conda-forge.org/][conda-forge]]. Linux (x86) and Mac OS X users who already have [[https://docs.conda.io/en/latest/][Conda]] can install Pynini and all dependencies using the following command: =conda install -c conda-forge pynini=. <br />%ICON{strategy}% When using Pynini from a [[https://jupyter.org/][Jupyter]] or [[https://colab.research.google.com/][Colab]] notebook, logging and error messages sent to STDERR are lost. To recover them, install [[https://pypi.org/project/wurlitzer/][ =wurlitzer= ]] and then add the following to the top of your notebook: =%load_ext wurlitzer= --- _OpenGrm_ _Pynini_, like [[Thrax]], compiles grammars expressed as strings, regular expressions, and context-dependent rewrite rules into weighted finite-state transducers. It uses the [[http://www.openfst.org][OpenFst library]] and its [[http://www.python.openfst.org][Python extension]] to create, access and manipulate compiled grammars. Pynini is embedded in a [[https://www.python.org][Python]] module, allowing users to write Thrax-like grammars using Python's flexible syntax (including imperative programming constructs not available in Thrax) and powerful toolchain, including an [[http://ipython.org][interactive development]] ("REPL") environment. It is (loosely) named after [[https://en.wikipedia.org/wiki/PÄ\x81á¹ini][Pāṇini]] (पाणिनि), the renowned Sanskrit grammarian. * [[PyniniDownload][Download]] * [[PyniniDocs][Documentation]] * C++ API documentation (for advanced users): * [[PyniniOptimizeDoc][Optimization]] * [[PyniniPathsDoc][Path iteration]] * [[PyniniOperatorsDoc][Specialty operators]] * [[PyniniStringDoc][String (de)compilation]] For more information about Pynini, see: * K. Gorman. 2016. [[https://www.aclweb.org/anthology/W16-2409][Pynini: A Python library for weighted finite-state grammar compilation]]. In _Proceedings of the ACL Workshop on Statistical NLP and Weighted Automata_, pages 75-80. Berlin: Association for Computational Linguistics. * K. Gorman & R. Sproat. [[https://www.oreilly.com/ideas/how-to-get-superior-text-processing-in-python-with-pynini][How to get superior text processing in Python with Pynini]]. O'Reilly Ideas blog, accessed 11/16/16. Other third-party information: * [[https://stackoverflow.com/questions/57898360/how-can-i-install-and-use-pynini-on-windows-10][Installing Pynini on Windows 10]]
Edit
|
Attach
|
Watch
|
P
rint version
|
H
istory
:
r80
|
r63
<
r62
<
r61
<
r60
|
B
acklinks
|
V
iew topic
|
Raw edit
|
More topic actions...
Topic revision: r61 - 2020-11-19
-
KyleGorman
GRM
Log In
or
Register
GRM Web
Create New Topic
Index
Search
Changes
Notifications
Statistics
Preferences
Webs
Contrib
FST
Forum
GRM
Kernel
Main
Sandbox
TWiki
Main
Copyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki?
Send feedback