Curriculum Vitae

Summary

Try speaking me here!

I am currently an AI Engineer at AI Singapore, where I work on a variety of projects ranging from chatbots to document understanding. I am also pursuing a BSc (Honours) in Mathematics with a Minor in Data Science at the Singapore University of Social Sciences. I am passionate about AI and its applications, and I am always looking for opportunities to learn and grow. I enjoy keeping up to trend with the latest AI research and developments, as such I tend to dive into various rabbit holes.

Interests

In general, my interests lies in making things fast and efficient. I am greatly inspired by the works of flash-attn and unsloth, where they focus on speeding up the generic transformers architecture. Having worked with Megatron-LM, a large scale training framework for LLMs, my current learning journey is about distributed pytorch, with different parallelism techniques. I am learning how to fuse pytorch functions as a start, before exploring triton and hopefully CUDA kernels someday. Additionally, I am interested in distillation methods such as pruning, which can significantly reduce model size and improve efficiency without compromising performance.

Skills

Generic Skills:

• Agile Methodologies
• Data Analysis
• Data Engineering
• Problem Solving
• Basic web development (HTML, CSS)
• Web scraping

Languages:

• Python
• SQL
• Rust (learning)

Libraries:

• Pandas
• OpenCV
• Matplotlib
• NumPy
• BeautifulSoup
• Selenium

AI Specific libraries:

Note: Some libraries listed here may have applications beyond AI, but they are included in this category due to their prominent use in AI-related projects.

• Pytorch
• Tensorflow
• scikit-learn
• Huggingface(transformers,datasets)
• Peft(LLM fine-tuning)
• DeepSpeed
• Langchain
• llama_index
• Megatron Deepspeed
• Composer

AI/ML knowledge:

• Computer Vision
• Natural Language Processing (NLP)
• Large Language Models
• Multi-GPU Training and Inference
• MLOps
• Low Rank Adapter fine-tuning
• Distributed training on multi nodes

Other:

• Simple sysadmin: Networking, cron, bash scripting
• Cluster management: Slurm, PBS
• Cloud: AWS Parellel Clusters setup
• Docker

Operating Systems: Linux, Windows, Mac

Education

JUN 2020 - PRESENT
Singapore University of Social Sciences - BSc (Hons) Mathematics with a Minor in Data Science

• Advanced Linear Algebra
• Calculus (1-4)
• Object Oriented Programming
• Big data cloud computing
• Data Programming
• Data analytics with Python
• Financial Mathematics

Note: My honours is an invitational extension of my current degree, therefore I already have completed the basic degree.

Experience

DEC 2023 - PRESENT
AI Singapore - AI Engineer

• Setup Distributed Training Environments: Configured and managed environments for distributed machine learning training for cluster training.
• Benchmarking for Distributed Training: Conducted rigorous testing and benchmarking to evaluate and optimise configurations / frameworks for distributed training systems, ensuring maximum efficiency and performance.
• Setting Up Inference Servers (Ollama, vLLM): Deployed and configured inference servers using Ollama, vLLM, with docker compose on GCP instances.
• Performed evaluation tasks with lm-eval library with vLLM backend.
• Converted a python script for internal data processing to rust, reducing time taken by close to 80%.
• Implemented changes for open-source training framework such as llm-foundry and Megatron-LM for internal use cases.
  These included schedulers or different model architectures.
• Deployed a multi-node slurm cluster from bare metal DGX H100 servers, with pyxis and enroot support.

FEB 2023 - NOV 2023
AI Singapore - AI Apprentice (CAIE Associate AI Engineer)

• Refining prompt engineering using OpenAI function calls to enhance response structuring in a proprietary chatbot, resulting in optimised processes and improved user interactions.
• Designed a document understanding model that streamlines training by eliminating traditional box labeling.
• Built a synthetic data generator for the above-mentioned document understanding model, allowing training using a single image.
• Conducted a literature review and technical presentation on U-Net image segmentation to all AI Singapore staff.
• Designed a Langchain-integrated document retrieval chatbot in just three days, leveraging OpenAI API to surpass conventional rule-based constraints, showcasing the prowess of contemporary large language models.
• Collaborated with the AI products team using Agile methodologies, focusing on the swift development of MVPs and POCs.
• Established a CI process with GitHub Actions that conducted automated testing and linting.
• Effectively coached the upcoming batches in several topics such as Deep Neural Networks, Computer Vision, and Natural Language Processing.
• Recipient of the “Outstanding Apprenticeship Award” for exceptional achievement in the programmme.

DEC 2017 - FEB 2023
Republic of Singapore Air Force - Air Force Engineer

• Specialist engineer in vibration analysis and balancing for helicopter systems which involves precise weight adjustments to dampeners and rotary parts, preventing component faults by reducing damage from vibrative stresses, while improving pilots’ comfort and safety.
• Applied analytical reasoning through troubleshooting charts and root cause analysis techniques to diagnose and resolve unique ad-hoc rectifications.
• Managed and scheduled tasks for multiple teams on aircraft system rectifications, ensuring efficient sequencing and concurrent tasks without conflicts.
• Played a key role in preparing aircraft for bilateral missions, with a specialisation in rapid aircraft turnarounds and comprehensive servicing, highlighting proficiency in teamwork and the ability to achieve results in diverse, high-pressure environments.

Certifications

MAY 2023
CAIE Associate AI Engineer
Specialisation in neural networks, computer vision, natural language processing with transformers, and time series analysis.

NOV 2023
AI Apprenticeship Programme
A 9-month full-time programme that trains AI engineers in the latest AI technologies and applications.

NOV 2023 - NOV 2026
Amazon Web Services – Certified Cloud Practitioner
Knowledge of AWS Cloud, services, and terminology.

Awards

NOV 2023
Outstanding Apprenticeship award
Awarded to the top apprentices in the AI Apprenticeship Programme.