Goto

Collaborating Authors

 Country




Trans Tab: LearningTransferableTabular TransformersAcrossTables

Neural Information Processing Systems

Tabular data (or tables) are the most widely used data format in machine learning (ML). However,ML models often assume the table structure keeps fixed in training and testing. Before ML modeling, heavy data cleaning is required to merge disparate tables with different columns.






1457c0d6bfcb4967418bfb8ac142f64a-Supplemental.pdf

Neural Information Processing Systems

Reversed Words and Anagrams: Recall that these tasks are of the form "alaok =100 koala". Due to the short length of these tasks, we used 2-grams for filtering (ignoring101 punctuation).


LanguageModelsareFew-ShotLearners

Neural Information Processing Systems

Specifically, we train GPT-3, an autoregressive language model with 175 billion parameters, 10x more than any previous nonsparse language model, and test its performance in the few-shot setting. For all tasks, GPT-3 is applied without any gradient updates or fine-tuning, with tasks andfew-shot demonstrations specified purelyviatextinteraction withthemodel.