MQ-FORMER
: Multi-modal cross modal projector
$$ \Huge \textbf {Sumin Ha} \\ \small {AI \, researcher \ \& \ Licensed \, Pharmacist} $$
<aside> 📖 Academic CV
</aside>
<aside> 📧 [email protected]
</aside>
<aside> 📍 Seoul, Korea
</aside>
<aside> <img src="https://prod-files-secure.s3.us-west-2.amazonaws.com/854c6942-cee4-4a07-b82a-3f9064bde9fb/cca60680-50ba-4aa1-9b01-3edf949109e5/github.png" alt="https://prod-files-secure.s3.us-west-2.amazonaws.com/854c6942-cee4-4a07-b82a-3f9064bde9fb/cca60680-50ba-4aa1-9b01-3edf949109e5/github.png" width="40px" /> Github
</aside>
Hi, I'm a master’s student in the Interdisciplinary Program in Artificial Intelligence at Seoul National University, where I’m part of the Bio & Health Informatics Lab under Prof. Sun Kim. My academic journey combines AI-driven research with a professional background in pharmacy, allowing me to explore the intersections of drug discovery, generative modeling, and language models.
My research focuses on developing AI models that can bridge knowledge gaps in drug discovery, particularly through leveraging innovative graph neural networks and transformer-based architectures. I’m also deeply interested in utilizing language models and generative models to push the boundaries of molecular understanding and representation. Recent projects include a state-of-the-art model for toxicity prediction that employs multiple fragment level graphs and molecule captioning by aligning 2D and 3D molecular structures with textual descriptions. Additionally, I have experience in creating tech-based solutions, such as ChemTox, a toxicity prediction platform developed in collaboration with AIGENDRUG.
As a licensed pharmacist, my goal is to extend the role of pharmaceutical science by delivering AI-driven insights and tools that support healthcare and drug development at a broader scale. Moving forward, I’m excited to apply these techniques beyond molecular data to explore new applications and drive innovation across a range of domains.
2023.03 - 2025.03
Master of Science in Engineering (Artificial Intelligence) - Seoul National University
Advisor: Prof. Sun Kim
2019.03 - 2023.02
Bachelor of Science in Pharmacy (Pharmacy) ****- Seoul National University
Dissertation: “*The Effect of Ultrasound Application on Artificial Membrane and MDCKII Cell Permeability of Carbamazepine and Donepezil” (*Advisor: Prof. Suk-Jae Chung)
Honors: Cum Laude
C: Conference J: Journal *: equal contribution
[C1] MV-CLAM: Multi-View Molecular Interpretation with Cross-Modal Projection via Language Model [paper] [code]
Sumin Ha*, Junhyeong Kim*, Yinhua Piao, Sun Kim.
Conference on Empirical Methods in Natural Language Processing (EMNLP) Findings. 2025.
NeurIPS Workshop on AI for New Drug Modalities. 2024.
[J1] FATE-TOX: Fragment Attention Transformer for E(3)-Equivariant Multi-Organ Toxicity Prediction [paper] [code]
Sumin Ha*, Dongmin Bang*, Sun Kim
Journal of Cheminformatics. 2025
[C2] Multimodal graph representation learning for toxicity prediction by integrating chemical knowledge-based fragmentation [paper]
Sumin Ha, Dongmin Bang, Sun Kim
Korea Computer Congress (KCC) Oral. 2024
2024.06.14
2024 Creative and Independent AI Research Contest - GSAI, SNU
Outstanding research (Conference fee support)
