Skip to content
View yeongjoonJu's full-sized avatar
🎯
Focusing
🎯
Focusing

Highlights

  • Pro

Block or report yeongjoonJu

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
yeongjoonJu/README.md

😄 Profile

🎓 Affiliation: Pattern Recognition and Machine Learning Lab in Korea University (2020~)

I'm researching efficient and effective in-context augmentation for multimodal large language models (MLLMs).

Research direction: face generation (vision) $\rightarrow$ dialogue generation (NLP) $\rightarrow$ neural network debugging (XAI) $\rightarrow$ 🌞 language modeling for multimodalities (NLP)

📃 Publications

Co-authors: Seong-Whan Lee / Gun-Hee Lee / Woo-Jeoung Nam / Jung-Ho Hong / Ji-Hoon Park / Hee-Dong Kim / Tae-Jin Woo / Woo-Seok Jo / Jeong-Woo Shim

💻 Research Projects (national and industry-academic projects)

  • Development of Core Technologies for Artificial General Intelligence based on Task-free Generalized Self-Awareness and Self-Learning (태스크에 무관한 자가 인지 및 학습 기반 범용 인공지능 핵심 기술 개발)

    • Institution: Institute of Information & communications Technology Planning & Evaluation (IITP, 정보통신기획평가원), Republic of Korea
    • Duration: Jul. 2024 ~ present
    • Role: Designing long-term research and development goals and content for AGI, and preparing a research and development plan for the project (과제 제안서 작성) / Research of self-improving multimodal agents
  • Research on AI-based large-scale language modeling techniques for military-related topic (hidden)

    • Institution: Agency for Defense Development (ADD, 국방과학연구소), Republic of Korea
    • Duration: Aug. 2023 ~ Nov. 2023
    • Role: Team leader (practitioner)
  • Development of an AI assistant for elementary education teacher based on a large language model (대규모 언어 모델 기반 초등 교육 교사 어시스턴트 개발)

    • Institution: i-Scream Edu (아이스크림에듀), Republic of Korea
    • Duration: May 2023 ~ Jan. 2024
    • Role: Team leader (practitioner) / Development of LLM-based assistant for primary education teachers and elementary students
  • Development of Artificial Intelligence Technology for Personalized Plug-and-Play Explanation and Verification of Explanation (플러그앤플레이 방식으로 설명가능성을 제공하는 인공지능 기술 개발 및 인공지능 시스템에 대한 설명 제공 검증)

    • Institution: Institute of Information & communications Technology Planning & Evaluation (IITP, 정보통신기획평가원), Republic of Korea
    • Duration: Jun. 2022 ~ Dec. 2023
    • Role: Team leader (practitioner) / Research of plug-and-play debugging for the decision-making process of neural networks
  • Development of facial skin change analysis and visualization techniques (얼굴 피부 변화 분석 및 시각화 기술 개발)

    • Institution: Samsung Electronics (삼성전자), Republic of Korea
    • Duration: Jun. 2020 ~ Jun. 2021
    • Role: Research of facial dense alignment technique based on optical flow

👍 Awards, etc.

  • Reviewer at IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2024

  • Grand Prize in The 6th SW·AI Hackerton, Sejong University, Korea (Jul. 2019)

    Project: Android application that manages seat status for discussion lounge / Development of seat status detection model and API based on Flask (Jul. 2019 ~ Jul. 2019)

  • Grand Prize in The 7th Creative Design Competition, Sejong University, Korea (Jun. 2019)

    Project: Web application that automatically blurs out license plates and faces / Development of web application based on React.js, detection models, and API. (Mar. 2019 ~ Jun. 2019)

Pinned Loading

  1. CFR-GAN CFR-GAN Public

    Complete Face Recovery GAN: Unsupervised Joint Face Rotation and De-Occlusion from a Single-View Image (WACV 2022)

    Python 89 7

  2. Occlusion-Robust-3D-Face-CFR-GAN Occlusion-Robust-3D-Face-CFR-GAN Public

    Occlusion robust 3D face reconstruction model in CFR-GAN (WACV 2022)

    Python 53 9

  3. NeuroInspect NeuroInspect Public

    Neuron-based Debugging Framework for Mitigating Spurious Correlations in Neural Networks

    Jupyter Notebook 6

  4. Mesh-Viewer-using-pytorch3d Mesh-Viewer-using-pytorch3d Public

    Mesh Viewer implemented pyqt5

    Python 21 5

  5. PRML-NLP/ElementGPT PRML-NLP/ElementGPT Public

    GPT for elementary school

    Python 3

  6. AugNLE AugNLE Public

    Data augmentation for few-shot natural language explanations

    Python 4