token

Mirrors graphql-js language/ast.ts Token class.

In graphql-js the Token is a doubly-linked node whose prev/next pointers are mutated by the parser. Gleam values are immutable, so the Gleam port keeps Token as a flat record and lets the parser thread tokens through by position. The substantive fields (kind, start, end, line, column, value) are identical to graphql-js.

Types

Token

A single lexed token. start and end are 0-indexed code-point offsets into Source.body. line and column are 1-indexed. value is set for Name, Int, Float, String, BlockString, and Comment tokens (matching graphql-js); for other kinds it is None.

pub type Token {
  Token(
    kind: token_kind.TokenKind,
    start: Int,
    end: Int,
    line: Int,
    column: Int,
    value: option.Option(String),
  )
}

Constructors

Token(
  kind: token_kind.TokenKind,
  start: Int,
  end: Int,
  line: Int,
  column: Int,
  value: option.Option(String),
)

Values

punctuator

pub fn punctuator(
  kind: token_kind.TokenKind,
  start: Int,
  end: Int,
  line: Int,
  column: Int,
) -> Token

Construct a token with a None value (used for punctuators and Sof/Eof).