---+ [[GRM.NGramLibrary][OpenGrm NGram]] Forum You need to be a registered user to participate in the discussions. <br /> %IF{"context authenticated" then='%MAKETEXT{"You are logged in as [_1]." args="[[%WIKIUSERNAME%][%SPACEOUT{%WIKINAME%}%]]"}%%BR%%LOGOUT%' else='%LOGIN% %MAKETEXT{"or"}% [[%TWIKIWEB%.TWikiRegistration][%MAKETEXT{"Register"}%]]'}% %TOC{depth="2"}% You can start a new discussion here: <blockquote> %ICON{help}% You can use the formatting commands describes in TWiki.TextFormattingRules in your comment. <br /> %ICON{tip}% If you want to post some code, surround it with =<verbatim>= and =</verbatim>= tags. <br /> %ICON{warning}% Auto-linking of TWiki.WikiWords is now disabled in comments, so you can type !VectorFst and it won't result in a broken link.<br /> %ICON{warning}% You now need to use =<br>= to force new lines in your comment (unless inside =verbatim= tags). However, a blank line will automatically create a new paragraph. </blockquote> %COMMENT{type="newtopic"}% ---++ FATAL: NGramModel: bad ngram model topology ---+++ Main.BenoitFavre - 10 Sep 2012 - 09:18 <noautolink> I generated an ngram model from a .arpa file with the following command: ngramread --ARPA lm.arpa > lm.model ngramread does not complain, but ngraminfo and trying to load the model from C++ code generate the following error: FATAL: NGramModel: bad ngram model topology How can I troubleshoot the problem? </noautolink> ---+++ Main.BenoitFavre - 10 Sep 2012 - 09:27 <noautolink> Adding verbosity results in more mystery... ngraminfo --v=2 lm.model INFO: FstImpl::ReadHeader: source: lm.model, fst_type: vector, arc_type: standard, version: 2, flags: 3 INFO: Incomplete # of ascending n-grams: 1377525 FATAL: NGramModel: bad ngram model topology </noautolink> ---+++ Main.BrianRoark - 11 Sep 2012 - 10:33 <noautolink> Hi, that error is coming from a sanity check that verifies that every state in the language model (other than the start and unigram states) is reached by exactly one 'ascending' arc, that goes from a lower order to a higher order state. ARPA format models can diverge from this, by, for example, having 'holes' (e.g., bigrams pruned but trigrams with that bigram as a suffix retained). But ngramread should plug all of those. maybe duplication? I'll email you about this. </noautolink> %COMMENT{type="mythreadmode"}% -- Main.CyrilAllauzen - 09 Aug 2012
This topic: Forum
>
WebHome
>
GrmNGramForum
Topic revision: r3 - 2012-09-11 - BrianRoark
Copyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki?
Send feedback