A library of code to build a parse tree and break text into sentences. This is version 1.
-
-
What This Module Does - An overview of the syntax module's role and abilities. -
How To Include This Module - What to do to make use of the syntax module in a new command-line tool.
-
-
Loading this module.
-
Syntax Module - Setting up the use of this module.
-
-
-
Syntax Trees - To parse trees which decompose the meaning of excerpts of text, and which allow annotations to be made at each node. -
Node Types - Each node in a syntax tree has a type, which informs whether it can have child nodes, and what in general terms it means. -
Parse Nodes - Syntax trees are made of single nodes, each representing one way to understand a given piece of text. -
Node Annotations - Attaching general-purpose data to nodes in the syntax tree. -
Tree Verification - Did we go wrong anywhere? This section is purely defensive, and tests whether Inform contains bugs of a kind which lead to malformed syntax trees: that should never happen even if the source text being compiled is a dumpster fire. -
Simple Preform Cache - A simple way to speed up repeated Preform parses of the same text.
-
-
Chapter 3: Breaking into Sentences
-
Sentences - To break up the stream of words produced by the lexer into English sentences, and join each to the parse tree.
-
Powered by Inweb.