ИИ-статИИ / paper readings - positional embeddings for transforemers (RoPE)
Schedule
Sun Jun 30 2024 at 03:00 pm
UTC+03:00Location
Факултет по математика и информатика, СУ | Sofia, SF
Advertisement
!! Place: FMI, hall 501In this meeting we'll discuss the paper "RoFormer: Enhanced Transformer with Rotary Position Embedding" ( https://arxiv.org/abs/2104.09864 )
If you haven't attended before - we choose a scientific paper in the field of AI (every month or two) and come together to help each other understand it. There's no barrier to entry, but it would be nice if you've read the paper and/or related materials, so that we can get into specific questions ASAP. There's a moderator, that does an overview of the paper, and then we have free-form discussion to understand the specifics.
Relevant other papers we might get to if there's time to spare:
ALiBi ( https://arxiv.org/abs/2108.12409 )
Contextual Position Encoding ( https://arxiv.org/abs/2405.18719 )
Join our paper reading group to make a suggestion for the next topic and keep in touch: https://www.facebook.com/groups/1369557000588976
You can also subscribe to the DSS newsletter at https://www.datasciencesociety.net/
Advertisement
Where is it happening?
Факултет по математика и информатика, СУ, bul James Bourchier 5,Sofia, BulgariaEvent Location & Nearby Stays:
