Skip to content

Aquila

Directory actions

More options

Directory actions

More options

Latest commit

 

History

History
 
 

Aquila

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
configs
configs
 
 
utils
utils
 
 
README.md
README.md
 
 
aquila.py
aquila.py
 
 
aquila_dataset.py
aquila_dataset.py
 
 
pipeline.py
pipeline.py
 
 
tokenizer.py
tokenizer.py
 
 

README.md

Aquila

推理

  • cuda
python projects/Aquila/pipeline.py --model_path=/root/models/Aquila-7B --mode=huggingface
  • npu
python projects/Aquila/pipeline.py --model_path=/data0/hf_models/Aquila-7B --mode=huggingface --device=npu
  • xpu
python projects/Aquila/pipeline.py --model_path=/root/models/Aquila-7B --mode=huggingface --device=xpu

训练

  • data preparation
python projects/Aquila/utils/data_prepare.py
  • cuda
export NUM_GPUS=4 python3 -m oneflow.distributed.launch \ --nproc_per_node ${NUM_GPUS} \ --nnodes 1 \ --node_rank 0 \ --master_addr 127.0.0.1 \ --master_port 12345 \ tools/train_net.py --config-file=projects/Aquila/configs/aquila_sft.py \ graph.enabled=True \ train.input_placement_device="cuda" \ train.dist.device_type="cuda" \ train.dist.pipeline_parallel_size=${NUM_GPUS}
  • xpu
export NUM_GPUS=1 python3 -m oneflow.distributed.launch \ --nproc_per_node ${NUM_GPUS} \ --nnodes 1 \ --node_rank 0 \ --master_addr 127.0.0.1 \ --master_port 12345 \ tools/train_net.py --config-file=projects/Aquila/configs/aquila_sft.py \ graph.enabled=False \ train.input_placement_device="xpu" \ train.dist.device_type="xpu" \ train.dist.pipeline_parallel_size=${NUM_GPUS}