Modified server to allow source features

[anderleich]

This PR modifies the server to allow source features in the request.

Request example:

[{"id": 101, "src": "This is a test.", "src_feats": {"feat0": "A A A B", "feat1": "D D D F"}}]

It adds the InferFeatsTransform to the server to correctly manage features. Options from this transform can be set in the server configuration file:

{
    "models_root": "EXPERIMENT_dummy/models",
    "models": [
        {
            "id": 101,
            "model": "model_step_1000.pt",
            "timeout": 600,
            "on_timeout": "to_cpu",
            "load": true,
            "opt": {
                "gpu": 0
            },
            "tokenizer": {
                "type": "pyonmttok",
                "mode": "conservative",
                "params": {
                    "bpe_model_path": "codes.bpe",
                    "joiner": "￭",
                    "joiner_annotate": true,
                    "case_markup": true,
                    "support_prior_joiners": true
                }
            },
            "features": {
                "reversible_tokenization": "joiner",
                "prior_tokenization": false
            }
        }
    ]
}

[anderleich]

Hi @francoishernandez ,
Any news on this?

[francoishernandez]

Sorry, this went a bit under my radar. I'll try and review this week.

[anderleich]

Ok, great! Don't worry, that's what I thought ;)

[francoishernandez]

Just had a quick look. Looks good. Please fix conflicts and then we'll merge.

[anderleich]

Done