LLM evaluation pipeline development
While LLMs are claimed to be useful for an ever growing range of tasks, systematic evaluation is required to produce evidence of their actual performance. A core component of an automated LLM evaluation is the data used to prompt the model, i.e. the user’s “side” of the transcript. These inputs can be designed in a … Read more