Hi. I'm Nathan!

computer science

@ stanford

about

Hi there! I'm a student at Stanford University studying computer science (BS + MS) and music (minor). I'm a pianist, organist, and violinist — see some of my performances here.


My expertise lies in artificial intelligence and generative AI: particularly, chatbots and medical AI. In the past, I led a team of five Harvard, Yale, and MIT researchers to evaluate reasoning in LLMs. My work on reducing hallucinations in medical LLMs has been cited by Google Research and Google Deepmind. Previously, I was a member of Stanford’s dialogue team for Amazon’s Alexa Prize, which won first place for scientific research (a $250k prize). I've also co-developed an intelligent chatbot to help people with autism improve their social skills, which is currently under trial at the Stanford Med School. In high school, I was named a Regeneron STS Scholar for my research on building AI models to detect signs of autism in child speech.


I currently serve as the co-president of Stanford ACM, the predominant CS club on campus. I also section lead for CS 106A (Python) and 106B (C++), Stanford's largest CS courses.


In my spare time, I love playing board games (personal favorite: Agricola) and competitive Geoguessr — at my peak, I was rated in the top 500 in the world. I'm an avid fan of the color green.

experience


2023Research InternStanford AI LaboratoryDevised autoregressive method to evaluate large language model chatbots for social downstream tasks.
2023Co-PresidentStanford ACMCo-directing Stanford’s premier CS club. Manage team of 10+ officers and industry communications.
2023Section LeaderStanford CS 106Lead weekly section, office hours, and interactive grading for CS 106A (Python) and CS106B (C++), Stanford’s introductory and largest CS courses.
2022Research InternYale NLPLeading team of 5 undergrads creating benchmark for analyzing reasoning in LLMs.
2022Research InternStanford NLP Dialogue TeamBuilt system to dynamically generate fluid topic transitions in chatbot deployed to all Alexa users.
2022Research InternStanford Open Virtual Assistant LabCo-developed Noora, a LLM chatbot to improve social skills of people with autism. Under clinical trial @ Stanford Med.
2022FellowMeta Above & Beyond CSSelected to join 9-week CS workshop program with Meta software engineers.
2022Research InternHarvard Med / Stanford AI LaboratoryCreated method using vision language models to reduce hallucinations in medical text generation (ML4H ‘22).
2021Research InternStanford MedBuilt SOTA AI model to classify semi-structured child speech for autism.

select publications

Linguistic Reasoning in Large Language Models
Nathan Andrew Chi, Teodor Malchev, Riley Kong, et al.
In Proceedings of the 6th Workshop on Research in Computational Linguistic Typology and Multilingual NLP @ EACL. March 2024.

Dialogue Distillery: Crafting Interpolable, Interpretable, & Introspectable Dialogue from LMs
Ryan A. Chi, Jeremy Kim, ... Nathan Andrew Chi, et al.
In Alexa Prize Proceedings. September 2023.

Contrastive X-Ray Report Determination Employing Prior Reference Removal
Vignav Ramesh*, Nathan Andrew Chi*, Pranav Rajpurkar,
In Proceedings of Machine Learning for Health @ NeurIPS. September 2022.

Classifying Autism From Crowdsourced Semistructured Speech Recordings
Nathan A. Chi, Peter Washington, Aaron Kline, et al.
In Journal of Medical Internet Research Pediatrics and Parenting. January 2022.

Beyond the Imitation Game: Quantifying and Extrapolating the Capabilities of Language Models
Srivastava et al. (coauthored with Google Research)
In Transactions of Machine Learning Research. May 2022.

Neural Methods for Clinical Trial Report NLI
Co-senior advising author, mentored 9 Stanford undergrads.
In Proceedings of Workshop for Semantic Evaluation at ACL. February 2023.

Noora: A Social Coach for Individuals with Autism Spectrum Disorder
Nathan A. Chi, et al.
Under preparation.

music

At Stanford, I study organ with Dr. Robert Huw Morgan. In the past, I studied with Erna Gulabyan, Debra Fong, Angela Kraft Cross, and Daisy Bate. Selected performances below — and check out some of my other videos here!

contact

If you'd like to get in touch, please email me at nchi1@stanford.edu!

© 2023 Nathan Andrew Chi