Hi! I'm a 4th-year Ph.D. student in the School of Computing at
KAIST. I am working with Juho Kim as part of KIXLAB.
My research interests in Human-Computer Interaction lie in video understanding and interaction. I leverage HCI and AI techniques to comprehend video content and build interactive technologies that empower users to create and consume video content more effectively. In particular, I aim to improve how people learn procedural tasks through instructional/how-to videos to achieve everyday tasks.
Keywords: Human-Computer Interaction; Computer Vision; Video Interaction; Multimodal Understanding; Procedural Task;
My research interests in Human-Computer Interaction lie in video understanding and interaction. I leverage HCI and AI techniques to comprehend video content and build interactive technologies that empower users to create and consume video content more effectively. In particular, I aim to improve how people learn procedural tasks through instructional/how-to videos to achieve everyday tasks.
Keywords: Human-Computer Interaction; Computer Vision; Video Interaction; Multimodal Understanding; Procedural Task;
News
- 📝 (Jul. 2024) One paper accepted to UIST 2024!
- 🛫 (May. 2024) Attended CVPR 2024 and presented workshop papers!🇺🇸
- 👩💼 (May. 2024) Started a summer internship at Adobe Seattle!
- 🛫 (May. 2024) Attended CHI 2024 in Hawaii!🇺🇸
- 📝 (Apr. 2024) Papers accepted to CVPR 24 LPVL workshop!
- 👩💼 (Mar. 2024) Serving as a program committee member for CVPR 24 workshop on procedural videos (LPVL).
- 🛫 (Mar. 2024) Attended IUI 2024 in Greenville!🇺🇸
- 🛫 (Feb. 2024) Attened AAAI 2024 in Vancouver!🇨🇦
- 📝 (Jan. 2024) My Autodesk internship paper has been accepted to CHI 2024!
- 📝 (Dec. 2023) Our paper on AI-assited video editing has been accepted to IUI 2024!
- 📝 (Dec. 2023) My LG AI internship paper on Video QA has been accepted to AAAI 2024!
- 👩💼 (Sep. 2023) Gave talks on video interaction at University of Toronto and UBC!🇨🇦
Publications
Conference and Journal Papers
Silent Impact: Tracking Tennis Shots from the Passive Arm
UIST 2024
AQuA: Automated Question-Answering in Software Tutorial Videos with Visual Anchors
CHI 2024
ExpressEdit: Video Editing with Natural Language and Sketching
IUI 2024
Also presented at the HAI-GEN Workshop at IUI 2024
YTCommentQA: Video Question Answerability in Instructional Videos
AAAI 2024
Also presented at the LPVL Workshop at CVPR 2024
Towards Content-based Pixel Retrieval in Revisited Oxford and Paris
ICCV 2023
Beyond Instructions: A Taxonomy of Information Types in How-to Videos
CHI 2023
AVscript: Accessible Video Editing with Audio-Visual Scripts
CHI 2023
CatchLive: Real-time Summarization of Live Streams with Stream Content and Interaction Data
CHI 2022
SoftVideo: Improving the Learning Experience of Software Tutorial Videos with Collective Interaction Data
IUI 2022
Snapstream: Snapshot-based Interaction in Live Streaming for Visual Art
CHI 2020
What Makes It Hard for Users to Follow Software Tutorial Videos?
HCI Korea 2020
Posters, Demos, and Workshop Papers
Fine-Grained Action Understanding with Tools in Instructional Videos
CVPR 2024 Workshop on Learning from Procedural Videos and Language
Improving Video Interfaces by Presenting Informational Units of Videos
CHI 2022 Workshop on Computational Approaches for Understanding, Generating, and Adapting User Interfaces
Experiences
-
Adobe Research
Reserach Intern, STORIE Lab (May. 2024 - Present)
Mentors: Dingzeyu Li, Anh Truong -
Autodesk Research
Reserach Intern, HCI & Visualization Group (Jun. 2023 - Sep. 2023)
Mentors: Jo Vermeulen, Justin Matejka, George Fitzmaurice -
LG AI Research
Reserach Intern, Advanced ML Lab (Oct. 2022 - Feb. 2023)
Mentor: Moontae Lee -
Adobe Research
Reserach Intern, Creative Technologies Lab (Jun. 2020 - Sep. 2020)
Mentor: Hijung Valentina Shin -
ACRYL
Software Engineer Intern (Jan. 2018 - Feb. 2018)
Awards & Honors
- AAAI Student Scholar (2024)
- Google Student Travel Grant (2023)
- NAVER PhD Fellowship (2022)
- Special Recognition for Outstanding Reviews (CSCW 2023)
- Special Recognition for Outstanding Reviews (CHI 2022)
- Inseong Fellow, KAIST (2021)
- An Outstanding TA Award, KAIST (2021 Spring, 2022 Spring)
- An Outstanding MS Thesis Award, KAIST (2021)
- Kwanjeong Scholarship (2019-20)
- Google WTM Scholarsip (2018)
- Dean's List, School of Computing, KAIST (2018 Spring)
Academic Services
Organizing Committee
- UIST 2023 Video Previews Chair
Program Committee
- CVPR 2024 LPVL Workshop
- CHI 2023 Late-Breaking Work
- CHI 2022 Late-Breaking Work
Session Chair
- CHI 2024 Main Paper Track
Reviewer
(*=Special Recognition for Outstanding Reviews)- CHI 2024, 2023, 2022(*), 2021, 2020
- UIST 2024, 2022
- CSCW 2023(*), 2020
- DIS 2023
- CVPR 2024 Workshop
- IEEE Transactions on Learning Technologies
Student Volunteer
- AAAI 2024
- IUI 2022
- CHI 2019
Invited Talks
Enhancing How People Learn Procedural Tasks Through How-to Videos
-
Twelve Labs (Jul. 2024)
Improving Video Experiences by Leveraging User Interaction and Content Analysis
-
University of British Columbia (Oct. 2023)Host: Prof. Dongwook Yoon
-
DGP Lab, University of Toronto (Sep. 2023)
-
Intro to HCI @ UNIST (May. 2023)Host: Prof. Jaeyeon Lee
Education
-
Ph.D. in School of Computing, KAIST (Mar. 2021 - Present)GPA: 4.16/4.3, Advisor: Prof. Juho Kim
-
M.S. in School of Computing, KAIST (Mar. 2019 - Feb. 2021)An Outstanding MS Thesis Award, Advisor: Prof. Juho Kim
-
B.S. in School of Computing, KAIST (Mar. 2015 - Feb. 2019)Magna Cum Laude