Ori Ram
PhD Candidate
Tel Aviv University 

Hi!

I'm a PhD student for Computer Science at Tel Aviv University and a Research Scientist at AI21 Labs. 

I'm fortunate to be advised by Amir Globerson and to collaborate with Jonathan Berant and Omer Levy.

My research areas are natural language processing, machine learning and information retrieval. I'm mostly excited about language models, dense retrieval systems and learning in few-shot or zero-shot settings, especially from self-supervision.

Publications

In-Context Retrieval-Augmented Language Models
Ori Ram*, Yoav Levine*, Itay Dalmedigos, Dor Muhlgay, Amnon Shashua, Kevin Leyton-Brown, Yoav Shoham
Paper   Code


What Are You Token About? Dense Retrieval as Distributions Over the Vocabulary
Ori Ram,  Liat Bezalel, Adi Zicher, Yonatan Belinkov, Jonathan Berant, Amir Globerson
Paper       


Learning to Retrieve Passages without Supervision
Ori Ram, Gal Shachaf, Omer Levy, Jonathan Berant, Amir Globerson
NAACL 2022 (Oral)
Paper   Code   Models   Blog (Weaviate)   Podcast (Weaviate)    Podcast (Neural IR Talks)   Cite     


Parallel Context Windows Improve In-Context Learning of Large Language Models
Nir Ratner, Yoav Levine, Yonatan Belinkov, Ori Ram, Omri Abend, Ehud Karpas, Amnon Shashua, Kevin Leyton-Brown, Yoav Shoham
Paper   


Standing on  the Shoulders of Giant Frozen Language Models
Yoav Levine, Itay Dalmedigos, Ori Ram, Yoel Zeldes, Daniel Jannai, Dor Muhlgay, Yoni Osin, Opher Lieber, Barak Lenz, Shai Shalev-Shwartz, Amnon Shashua, Kevin Leyton-Brown, Yoav Shoham
Paper


Transformer Language Models without Positional Encodings Still Learn Positional Information
Adi Haviv, Ori Ram, Ofir Press, Peter Izsak, Omer Levy
EMNLP 2022 (Findings)
Paper


Few-Shot Question Answering by Pretraining Span Selection
Ori Ram*, Yuval Kirstain*, Jonathan Berant, Amir Globerson, Omer Levy
ACL 2021 (Oral)
Paper   Code   Models   Cite


How Optimal is Greedy Decoding for Extractive Question Answering?
Or Castel, Ori Ram, Avia Efrat, Omer Levy
AKBC 2022 (Oral)
Paper   Code   Models   Cite


Coreference Resolution without Span Representations
Yuval Kirstain*, Ori Ram*, Omer Levy
ACL 2021 (Oral)
Paper   Code & Model   Cite


SenseBERT: Driving Some Sense into BERT
Yoav Levine, Barak Lenz, Or Dagan, Ori Ram, Dan Padnos, Or Sharir, Shai Shalev-Shwartz, Amnon Shashua, Yoav Shoham
ACL 2020
Paper   Cite


Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsing
Tal Schuster*, Ori Ram*, Regina Barzilay, Amir Globerson
NAACL 2019 (Oral)
Paper   Code & Models   Cite