Hankyul Kang

Hankyul Kang

Ph.D. Candidate, Department of Artificial Intelligence
Ajou University, Suwon, Korea
hankyulkang1997@gmail.com
Google Scholar · hankyul2.github.io

About

I am Hankyul Kang, a Ph.D. candidate in the Department of Artificial Intelligence at Ajou University in Suwon, Korea, where I am advised by Prof. Jongbin Ryu in the Computational Intelligence Lab. I joined the lab in January 2021 as an undergraduate researcher and have stayed there since, moving into the doctoral program in March 2022.

I am interested in advancing the frontiers of state-of-the-art algorithms to achieve breakthrough performance. My expertise lies in improving efficiency through architectures, compression, and learning algorithms for vision models and large language models. My work spans four directions:

C: conference paper · J: journal paper · S: submission or preprint · P: project

Education

Research Experience

News

Publications

Forgetting curves for short-term, optimal, and long-term recall intervals
[C.2] Hankyul Kang, Gregor Seifer, Donghyun Lee, and Jongbin Ryu. Do Your Best and Get Enough Rest for Continual Learning.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025

Keywords: “continual learning, forgetting curve, recall interval, long-term memory”

Multi-token attention pooling with inter- and intra-group distillation across two token branches
[C.1] Hankyul Kang and Jongbin Ryu. Enriching Local Patterns with Multi-Token Attention for Broad-Sight Neural Networks.
IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2025

Keywords: “global average pooling, multi-token attention, attention pooling, high throughput network, low parameter overhead”

U-Net with a deconvolution decoder compared with ADNet's attentional decoder and harmonic pooling
[J.1] Hankyul Kang, Namkug Kim, and Jongbin Ryu. Attentional Decoder Networks for Chest X-Ray Image Recognition on High-Resolution Features.
Computer Methods and Programs in Biomedicine, 2024

Keywords: “chest X-ray recognition, encoder-decoder, attentional upsampling, resource efficient fine-tuning”

Preprints and Working Papers

Conceptual illustration of the QLoRA learning trajectory drifting away from the stable optimal region
[S.5] Anonymous Authors. An Empirical Study on Learning Trajectories of LoRA Adapters for Quantized Large Language Models.
Working paper

Keywords: “quantized LLM, QLoRA, exponential moving average, low-bit low-rank fine-tuning”

Sequential pruning-then-quantization compared with differentiable bit-width co-optimization
[S.4] Anonymous Authors. Co-Optimizing Pruning and Quantization via Singular Value Decomposition for Efficient LLM Compression.
Working paper

Keywords: “LLM compression, pruning, quantization, differentiable bit-width, ultra-low-bit memory footprint, batch-size agnostic throughput gain”

Decision boundaries with and without auxiliary out-of-distribution samples across continual learning tasks
[S.3] Anonymous Authors. Utilizing Auxiliary Datasets for Robust Decision Boundaries in Continual Learning Scenarios.
Working paper

Keywords: “continual learning, decision boundary, out-of-distribution data, long-term memory”

Accuracy versus runtime across four devices for slimmable networks
[S.2] Anonymous Authors. Pluggable Decoder for Slimmable Neural Networks.
Working paper

Keywords: “slimmable networks, layer slimming, pluggable decoder, on-device inference, heterogeneous devices, mobile accelerators, inference latency, training time”

Baseline multi-head self-attention compared with decomposed and interactive attention variants
[S.1] Hankyul Kang, Ming-Hsuan Yang, and Jongbin Ryu. Interactive Multi-Head Self-Attention with Linear Complexity.
arXiv preprint, 2024

Keywords: “multi-head self-attention, cross-head interaction, linear complexity, scalable architecture, real-world constraint optimization, runtime, memory”

Research Projects