Career Profile
I’m research scientist at Twelve Labs.
Education
- M.S. student in Computer Science and Engineering
- Advisor: Prof. Gunhee Kim.
- College of Liberal Studies
- B.S. in Computer Science
- B.A. in Information Science and Culture
Experiences
- Video search
- Frenz dev
- Work on automated video magazine editing.
- Including video classification, magazine layout recommendation and text generation.
- Worked on video captioning and character re-identification.
- Worked on interactive image retrieval and change captioning.
- Worked on text-to-speech algorithm, speaker adaptation and encoding.
- Worked on web video classification, visual question answering.
- Worked on movie video captioning, language based retrieval algorithm
Publications
Viewpoint-Agnostic Change Captioning with Cycle Consistency
ICCV 2021
Transitional Adaptation of Pretrained Models for Visual Storytelling
CVPR 2021
ECCV 2020 spotlight
Workshops
Cycled Compositional Learning between Images and Text
CVPR 2020, Third Workshop on Computer Vision for Fashion, Art and Design
Temporal Attention Mechanism with Conditional Inference for Large-Scale Multi-Label Video Classification
ECCV 2018, Second Workshop on Youtube-8M Large-Scale Video Understanding
awards
- SNU CSE best thesis award, 2021.02
- 1st prize, 2nd DramaQA Challenge 2020 held in ECCV 2020
- 1st prize, Fashion-IQ Challenge 2020 held in CVPR 2020
- 1st prize, Large Scale Movie Description and Understanding Challenge 2019 held in ICCV 2019
- Hyundai Motor Chung Mong-Koo Foundation Scholarship, 2019 ~ 2020
- 5th prize (ITM), The 2nd YouTube-8M Video Understanding Challenge (Team KANU) held in ECCV 2018
- 1st prize, Movie Fill-in-the-Blank track - Large Scale Movie Description and Understanding Challenge held in ICCV 2017
- 1st prize, Movie Annotation and Retrieval track - Large Scale Movie Description and Understanding Challenge held in ICCV 2017