neuralmonkey.evaluators.multeval module

class neuralmonkey.evaluators.multeval.MultEvalWrapper(wrapper: str, name: str = 'MultEval', encoding: str = 'utf-8', metric: str = 'bleu', language: str = 'en') → None

Bases: object

Wrapper for mult-eval’s reference BLEU and METEOR scorer.

__init__(wrapper: str, name: str = 'MultEval', encoding: str = 'utf-8', metric: str = 'bleu', language: str = 'en') → None

Initialize the wrapper.

Parameters:

• wrapper – path to multeval.sh script
• name – name of the evaluator
• encoding – encoding of input files
• language – language of hypotheses and references
• metric – evaluation metric “bleu”, “ter”, “meteor”

serialize_to_bytes(sentences: List[List[str]]) → bytes