Events at The University of Manchester
  • University home
  • Events
  • Home
  • Exhibitions
  • Conferences
  • Lectures and seminars
  • Performances
  • Events for prospective students
  • Sustainability events
  • Family events
  • All Events

AI-Fun with ELLIS Seminar | Chrysoula Zerva: Uncertainty in NLP & beyond: quantification, interpretation, evaluation

AI FUN & ELLIS
Dates:30 October 2024
Times:11:00 - 12:00
What is it:Seminar
Organiser:Faculty of Science and Engineering
Who is it for:University staff, External researchers, Alumni, Current University students
Speaker:Chrysoula Zerva
See travel and contact information
Add to your calendar

More information

  • AI Fundamentals Website
  • Registration link to attend online

Other events

  • In category "Seminar"
  • In group "(DF) Data Science and AI"
  • By Faculty of Science and Engineering

The Manchester Centre for AI Fundamentals and Manchester's ELLIS Unit are co-hosting a series of seminars featuring expert researchers working in the fundamentals of AI.

Title: Uncertainty in NLP & beyond: quantification, interpretation, evaluation

Abstract: As language models grow in popularity, size, and application across a wide range of tasks, they are becoming ubiquitous in modern society. This, in turn, brings forward questions on reliability, trust and interpretability. We know models don’t always “know what they don’t know” and may end up generating seemingly convincing answers that are entirely fabricated. Hence, obtaining reliable confidence estimates, i.e. being able to quantify the uncertainty over their predictions, is a key step in the path towards the reliability of language models and more responsible AI solutions.

This talk will discuss the challenges of uncertainty estimation for natural language processing, emphasising aspects such as multiple sources of uncertainty and limited access to the model parameters (black box models) as well as aspects of interpretation and evaluation. I will focus on generation and evaluation tasks, using machine translation as the main paradigm, and discuss how the conformal prediction framework can be leveraged to provide meaningful confidence intervals with statistical guarantees, while also allowing us to calibrate our confidence to obtain more interpretable and fair uncertainty representations.

Chrysoula (Chryssa) Zerva is an Assistant Professor for Artificial Intelligence at IST and a researcher at Instituto de Telecomunicações (IT) in Lisbon. She is a member of the European Laboratory for Learning & Intelligent Systems (ELLIS) and LUMLIS, the Lisbon Unit for Learning & Intelligent Systems. She obtained her PhD in 2019 from the University of Manchester on "Automated Identification of Textual Uncertainty". In 2019 she also received the EPSRC Doctoral Prize Fellowship, and in 2021, she joined IT as a postdoc for the DeepSPIN project. She is a co-PI in the Centre for Responsible AI project, a PRR initiative for trustworthy, sustainable, fair, and transparent AI. She is also part of the UTTER project, with her focus being on uncertainty-aware, adaptable and context-aware models. Her research focuses on elucidating uncertainty in machine learning and especially NLP. She also explores topics on explainability, fairness and quality estimation under multilingual and multimodal setups.

Speaker

Chrysoula Zerva

  • https://underline.io/speakers/153843-chrysoula-zerva

Travel and Contact Information

Find event

Lecture Theatre 1.5
Kilburn Building

Contact event

Centre for AI Fundamentals

ai-fun@manchester.ac.uk

Contact us

  • +44 (0) 161 306 6000

Find us

The University of Manchester
Oxford Rd
Manchester
M13 9PL
UK

Connect with the University

  • Facebook page for The University of Manchester
  • X (formerly Twitter) page for The University of Manchester
  • YouTube page for The University of Manchester
  • Instagram page for The University of Manchester
  • TikTok page for The University of Manchester
  • LinkedIn page for The University of Manchester

  • Privacy /
  • Copyright notice /
  • Accessibility /
  • Freedom of information /
  • Charitable status /
  • Royal Charter Number: RC000797
  • Close menu
  • Home
    • Featured events
    • Today's events
    • The Whitworth events
    • Manchester Museum events
    • Jodrell Bank Discovery Centre events
    • Martin Harris Centre events
    • The John Rylands Library events
    • Exhibitions
    • Conferences
    • Lectures and seminars
    • Performances
    • Events for prospective students
    • Sustainability events
    • Family events
    • All events