Unsupervised metrics

Airtrain offers a number of standard metrics that can be evaluated without labeled references. The following metrics are available:

• Length – simply the number of characters in the inference
• Compression – Ratio of input length to output length with lengths measured in characters (paper)
• Extractive Fragment Density – How much of the output is formed by pulling fragments from the input. (paper)

If you would like other metrics implemented, reach out to us on Slack.