Debian Codegraph @

manual/probabilistic.xml

raw
1 <?xml version="1.0" encoding="utf-8"?>
2 <!DOCTYPE chapter SYSTEM "docbook-dtd-45/docbookx.dtd">
3
4 <chapter id="probabilistic">
5 <title>Making use of Probabilistic / Statistic Input</title>
6
7 <para>
8 If your input contains confidence values or similar, you can make use of those in the grammar.
9 <emphasis>
10 See <link linkend="numerical-matches">numeric tags</link> for the specific feature.
11 </emphasis>
12 </para>
13
14 <para>
15 For example, given the input sentence "<emphasis>Bear left at zoo.</emphasis>" a statistical tagger
16 may assign confidence and frequency values to the readings:
17 <screen>
18 "&lt;Bear&gt;"
19 &nbsp; "bear" N NOM SG &lt;Noun:784&gt; &lt;Conf:80&gt; @SUBJ
20 &nbsp; "bear" V INF &lt;Verb:140&gt; &lt;Conf:20&gt; @IMV @#ICL-AUX&lt;
21 "&lt;left&gt;"
22 &nbsp; "leave" PED @IMV @#ICL-N&lt;
23 &nbsp; "leave" V PAST VFIN @FMV
24 "&lt;at&gt;"
25 &nbsp; "at" PRP @ADVL
26 "&lt;zoo&gt;"
27 &nbsp; "zoo" N NOM SG @P&lt;
28 "&lt;$.&gt;"
29 </screen>
30 which you could query with e.g.
31 <screen>
32 # Remove any reading with Confidence below 5%
33 REMOVE (&lt;Conf&lt;5&gt;) ;
34 # Select N NOM SG if Confidence is above 60%
35 SELECT (N NOM SG &lt;Conf&gt;60&gt;) ;
36 # Remove the Verb reading if the frequency is under 150
37 # and Noun's frequency is above 700
38 REMOVE (&lt;Verb&lt;150&gt;) (0 (&lt;Noun&gt;700&gt;)) ;
39 </screen>
40 </para>
41
42 <para>
43 These are just examples of what <link linkend="numerical-matches">numeric tags</link> could be used for.
44 There is no reason Confidence values are in % and there is no requirement that they must add up to 100%.
45 The only requirement of a numerical tag is an alphanumeric identifier and a double-precision floating point value that fits
46 in the range -281474976710656.0 to +281474976710655.0.
47 </para>
48
49 </chapter>