Bio
Dr. Hadas Raviv is a senior data scientist at AI21 Labs, a unique startup aimed at building AI systems with an unprecedented capacity to understand and generate natural language. She is passionate about language understanding and dedicated the last 13 years to work on related topics.
Hadas holds a MsC in physics from Tel-Aviv university and PhD in information retrieval from the Technion, her research topic was entity-based retrieval.
Bio
Dr. Hadas Raviv is a senior data scientist at AI21 Labs, a unique startup aimed at building AI systems with an unprecedented capacity to understand and generate natural language. She is passionate about language understanding and dedicated the last 13 years to work on related topics.
Hadas holds a MsC in physics from Tel-Aviv university and PhD in information retrieval from the Technion, her research topic was entity-based retrieval.
Abstract
Subjective human annotations are often too noisy for evaluation tasks in which a complex, possibly multi dimensional decision has to be made. In this lightning talk we propose a method for reducing that noise and utilizing the annotations for evaluating the output of machine learning models.
Specifically, we demonstrate its application for evaluating the fluency of machine-generated texts. We present empirical results demonstrating the effectiveness of our method and show that it can be used for evaluating and comparing the quality of different generation models.
Abstract
Subjective human annotations are often too noisy for evaluation tasks in which a complex, possibly multi dimensional decision has to be made. In this lightning talk we propose a method for reducing that noise and utilizing the annotations for evaluating the output of machine learning models.
Specifically, we demonstrate its application for evaluating the fluency of machine-generated texts. We present empirical results demonstrating the effectiveness of our method and show that it can be used for evaluating and comparing the quality of different generation models.
Planned Agenda
| 8:45 | Reception |
|---|---|
| 9:30 | Opening words by Shir Meir Lador, Data Science leader at Intuit |
| 9:45 | Yael Karov - AI For Assisting in Task Completion |
| 10:15 | Ofra Amir - Agent Strategy Summarization: Describing Agent Behavior to People |
| 10:45 | Break |
| 11:00 | Lightning talks |
| 12:30 | Lunch & Poster session |
|---|---|
| 13:30 | Roundtable session & Poster session |
| 14:30 | Roundtable closure |
| 14:45 | Gal Yona - How Fair Can We Be |
| 15:15 | Daphna Weissglas - Turning Data Science Into Precision Medicine Empowering Millions |
| 15:45 | Closing remarks |
Planned Agenda
| 8:45 | Reception |
|---|---|
| 9:30 | Opening words by Shir Meir Lador, Data Science leader at Intuit |
| 9:45 | Yael Karov - AI For Assisting in Task Completion |
| 10:15 | Ofra Amir - Agent Strategy Summarization: Describing Agent Behavior to People |
| 10:45 | Break |
| 11:00 | Lightning talks |
| 12:30 | Lunch & Poster session |
| 13:30 | Roundtable session & Poster session |
| 14:30 | Roundtable closure |
| 14:45 | Gal Yona - How Fair Can We Be |
| 15:15 | Daphna Weissglas - Turning Data Science Into Precision Medicine Empowering Millions |
| 15:45 | Closing remarks |
