Unsupervised metrics

Airtrain offers a number of standard metrics that can be evaluated without labeled references. The following metrics are available:

  • Length – simply the number of characters in the inference
  • Compression – Ratio of input length to output length with lengths measured in characters (paper)
  • Extractive Fragment Density – How much of the output is formed by pulling fragments from the input. (paper)

If you would like other metrics implemented, reach out to us on Slack.