Rambod Azimi
  • Bio
  • Papers
  • Experience
  • Projects
  • Recent & Upcoming Talks
    • Example Talk
  • Projects
  • Blog
    • 🎉 Easily create your own simple yet highly customizable blog
    • 🧠 Sharpen your thinking with a second brain
    • 📈 Communicate your results effectively with the best data visualizations
    • 👩🏼‍🏫 Teach academic courses
    • ✅ Manage your projects
  • Experience
  • Teaching
    • Learn JavaScript
    • Learn Python
  • Publications
    • SEMU-Net: A Segmentation-based Corrector for Fabrication Process Variations of Nanophotonics with Microscopic Images
    • Coming soon
    • KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
  • Projects
    • AI Game Agent
    • Dashcam Object Tracking
    • Handwritten Digit Recognition
    • Online Ticketing System
    • OS Simulation
    • Parallel Image Binarization
    • Reliable Network Design
    • Weekly Meal Planner

KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation

Aug 19, 1010·
Rambod Azimi
Rambod Azimi
· 0 min read
PDF Cite Code Source Document
Type
Paper-Workshop
Publication
In Proceedings of the ENLSP NeurIPS 2024 Workshop
Last updated on Aug 19, 1010
Neurips, ENLSP2024, LLMs
Rambod Azimi
Authors
Rambod Azimi
AI/ML Researcher at Mila x McGill
← Coming soon Aug 19, 1010

© 2024 Me. This work is licensed under CC BY NC ND 4.0

Published with Hugo Blox Builder — the free, open source website builder that empowers creators.