Re: Socially Situated AI; Introducing HELM

This is a useful reference for our Human-in-Loop discussion ... I will add
the following as initial Topics..

   - Instruction tuning, the practice of fine-tuning 'Models' with human
   feedback,
   - A scenario consists of a task, a domain (consisting of what genre the
   text is, who wrote it, and when it was written),
   - 7 metrics - accuracy, calibration, robustness, fairness, bias,
   toxicity, and efficiency

Carl Mattocks

It was a pleasure to clarify


On Sun, Nov 27, 2022 at 9:30 AM Paola Di Maio <paola.dimaio@gmail.com>
wrote:

> I am glad to see Stanford conceding that humans must remain at the center
> of AI.  There is A LOT
> to dig into relevant to this CG- what are the implications for us here?
>
> https://hai.stanford.edu/news/language-models-are-changing-ai-we-need-understand-them
>
>
>