Ori Ram
PhD Candidate
Tel Aviv University

Hi!

I'm a PhD student for Computer Science at Tel Aviv University and a Research Scientist at AI21 Labs.

I'm fortunate to be advised by Amir Globerson and to collaborate with Jonathan Berant and Omer Levy.

My research areas are natural language processing, machine learning and information retrieval. I'm mostly excited about language models, dense retrieval systems and learning in few-shot or zero-shot settings, especially from self-supervision.

Publications

What Are You Token About? Dense Retrieval as Distributions Over the Vocabulary
Ori Ram, Liat Bezalel, Adi Zicher, Yonatan Belinkov, Jonathan Berant, Amir Globerson
Paper


Learning to Retrieve Passages without Supervision
Ori Ram, Gal Shachaf, Omer Levy, Jonathan Berant, Amir Globerson
NAACL 2022 (Oral)
Paper Code Models Blog (Weaviate) Podcast (Weaviate) Podcast (Neural IR Talks) Cite


Parallel Context Windows Improve In-Context Learning of Large Language Models
Nir Ratner, Yoav Levine, Yonatan Belinkov, Ori Ram, Omri Abend, Ehud Karpas, Amnon Shashua, Kevin Leyton-Brown, Yoav Shoham
Paper


Standing on the Shoulders of Giant Frozen Language Models
Yoav Levine, Itay Dalmedigos, Ori Ram, Yoel Zeldes, Daniel Jannai, Dor Muhlgay, Yoni Osin, Opher Lieber, Barak Lenz, Shai Shalev-Shwartz, Amnon Shashua, Kevin Leyton-Brown, Yoav Shoham
Paper


Transformer Language Models without Positional Encodings Still Learn Positional Information
Adi Haviv, Ori Ram, Ofir Press, Peter Izsak, Omer Levy
EMNLP 2022 (Findings)
Paper


Few-Shot Question Answering by Pretraining Span Selection
Ori Ram*, Yuval Kirstain*, Jonathan Berant, Amir Globerson, Omer Levy
ACL 2021 (Oral)
Paper Code Models Cite


How Optimal is Greedy Decoding for Extractive Question Answering?
Or Castel, Ori Ram, Avia Efrat, Omer Levy
AKBC 2022 (Oral)
Paper Code Models Cite


Coreference Resolution without Span Representations
Yuval Kirstain*, Ori Ram*, Omer Levy
ACL 2021 (Oral)
Paper Code & Model Cite


SenseBERT: Driving Some Sense into BERT
Yoav Levine, Barak Lenz, Or Dagan, Ori Ram, Dan Padnos, Or Sharir, Shai Shalev-Shwartz, Amnon Shashua, Yoav Shoham
ACL 2020
Paper Cite


Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsing
Tal Schuster*, Ori Ram*, Regina Barzilay, Amir Globerson
NAACL 2019 (Oral)
Paper Code & Models Cite