BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//CERN//INDICO//EN
BEGIN:VEVENT
SUMMARY:Informal learning seminar on mathematics and AI
DTSTART:20260508T140000Z
DTEND:20260508T150000Z
DTSTAMP:20260518T072100Z
UID:indico-event-1319@math-events.uni-bonn.de
DESCRIPTION:Speakers: Maximilian Schimpf (MPIM)\n\n\n\n\n\n\n\n\nTitle: "T
 ransformers as a dynamical system"\nWe start by noting that the repeated f
 iltering of information through the attention layers of a transformer can 
 be interpreted as a discrete dynamical system. The continuous limit of thi
 s system satisfies a differential equation\, which can be interpreted unde
 r appropriate assumptions as a gradient flow. After explaining this\, we w
 ill see how this gradient flow has a tendency to form (often metastable) c
 lusters. This perhaps offers a partial explanation of why a chatbot can ex
 tract "meaning" from input text.\nhttps://sites.google.com/view/informal-m
 ath-ai-bonn/home\n\n\n\n\n\n\n\n\nhttps://math-events.uni-bonn.de/event/13
 19/
LOCATION:0.008 (Mathezentrum)
URL:https://math-events.uni-bonn.de/event/1319/
END:VEVENT
END:VCALENDAR