Skip to content

thainq107/llms_qlora

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Large Language Model Fine-Tuning with QLoRA

QLoRA: Efficient Fine-Tuning of QUantized LLMs

Dependencies

  • Python 3.10
  • PyTorch 2.0 +
    pip install -r requirements.txt 

Dataset

carblacac/twitter-sentiment-analysis

Training

 python run_qlora.py \ --dataset_name carblacac/twitter-sentiment-analysis \ --model_name_or_path tiiuae/falcon-7b \ --do_train True \ --do_eval True \ --do_predict True 

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors