Hi! I am a Ph.D. student in the School of Computing at KAIST. I am working with Juho Kim as part of KIXLAB.
My research interests in Human-Computer Interaction lie in video understanding and interaction. In particular, I leverage HCI and AI techniques to comprehend video content and aim to advance interactive technologies that empower users to create and consume video content more effectively. Recently, I have focused on Video QA and using generative AIs to help users create videos.

Keywords: Human-AI Interaction; Video Interaction; Multimodal Understanding; Generative AIs

News

📝 (Dec. 2023) Delighted to share that our paper on Video QA has been accepted to AAAI!
👩‍💼 (Sep. 2023) Gave talks on video interaction at University of Toronto and UBC!
📝 (Jul. 2023) A paper I collaborated on has been accepted to ICCV 2023!
👩‍💼 (Jun. 2023) Serving as a Video Previews Co-Chair for UIST 2023!
👩‍💻 (Jun. 2023) Started my research internship @ Autodesk in Toronto!
🛫 (Apr. 2023) Attending CHI 2023 to present our paper!
📝 (Jan. 2023) Two papers are accepted to CHI 2023!
🏆 (Dec. 2022) I received a NAVER PhD Fellowship Award!
🏆 (Oct. 2022) I received a Special Recognition for Outstanding Reviews at CSCW 2023.

Publications

Conference and Journal Papers

YTCommentQA: Video Question Answerability in Instructional Videos (to appear)

Saelyne Yang, Sunghyun Park, Yunseok Jang, Moontae Lee

AAAI 2024

Towards Content-based Pixel Retrieval in Revisited Oxford and Paris

Guoyuan An, Woo Jae Kim, Saelyne Yang, Rong Li, Yuchi Huo, Sungeui Yoon

ICCV 2023

[pdf]

Beyond Instructions: A Taxonomy of Information Types in How-to Videos

Saelyne Yang, Sangkyung Kwak﹡, Juhoon Lee﹡, Juho Kim

CHI 2023

[pdf] [project website] [talk]

AVscript: Accessible Video Editing with Audio-Visual Scripts

Mina Huh, Saelyne Yang, Yi-Hao Peng, Xiang ‘Anthony’ Chen, Young-Ho Kim, Amy Pavel

CHI 2023

[pdf]

CatchLive: Real-time Summarization of Live Streams with Stream Content and Interaction Data

Saelyne Yang, Jisu Yim, Juho Kim, Hijung Valentina Shin

CHI 2022

[pdf] [project website]

SoftVideo: Improving the Learning Experience of Software Tutorial Videos with Collective Interaction Data

Saelyne Yang, Jisu Yim, Aitolkyn Baigutanova, Seoyoung Kim, Minsuk Chang, Juho Kim

IUI 2022

[pdf] [project website] [dataset]

Snapstream: Snapshot-based Interaction in Live Streaming for Visual Art

Saelyne Yang, Changyoon Lee, Hijung Valentina Shin, Juho Kim

CHI 2020

[pdf] [project website] [video preview]

What Makes It Hard for Users to Follow Software Tutorial Videos?

Saelyne Yang, Juho Kim

HCI Korea 2020

[pdf]

Posters, Demos, and Workshop Papers

Improving Video Interfaces by Presenting Informational Units of Videos

Saelyne Yang, Sankyung Kwak, Tae Soo Kim, Juho Kim

CHI 2022 Workshop on Computational Approaches for Understanding, Generating, and Adapting User Interfaces

[pdf]

Experiences

Autodesk Research
Reserach Intern, HCI & Visualization Group (Jun. 2023 - Sep. 2023)
Host: Jo Vermeulen, Justin Matejka, George Fitzmaurice
LG AI Research
Reserach Intern, Advanced ML Lab (Oct. 2022 - Feb. 2023)
Host: Moontae Lee
Adobe Research
Reserach Intern, Creative Technologies Lab (Jun. 2020 - Sep. 2020)
Host: Hijung Valentina Shin
ACRYL
Software Engineer Intern (Jan. 2018 - Feb. 2018)

Awards & Honors

Google Student Travel Grant (2023)
NAVER PhD Fellowship (2022)
Special Recognition for Outstanding Reviews (CSCW 2023)
Special Recognition for Outstanding Reviews (CHI 2022)
Inseong Fellow, KAIST (2021)
An Outstanding TA Award, KAIST (2021 Spring, 2022 Spring)
An Outstanding MS Thesis Award, KAIST (2021)
Kwanjeong Scholarship (2019-20)
Google WTM Scholarsip (2018)
Dean's List, School of Computing, KAIST (2018 Spring)

Education

Ph.D. in School of Computing, KAIST (Mar. 2021 - Present)
GPA: 4.16/4.3, Advisor: Prof. Juho Kim
M.S. in School of Computing, KAIST (Mar. 2019 - Feb. 2021)
An Outstanding MS Thesis Award, Advisor: Prof. Juho Kim
B.S. in School of Computing, KAIST (Mar. 2015 - Feb. 2019)
Magna Cum Laude