1.1 KiB
1.1 KiB
OpenVLA Lightweight Version
OpenVLA的轻量化版本,基于llava-next框架 特点: 1.主体模型仅0.5B,使用qwen2-0.5B 2.不使用RLDS格式数据集,使用mllm格式进行微调 3.不占用LLM模型固有tokens,使用新增的271个tokens表示动作
Installation
Follow the steps below to install the OpenVLA-Qwen lightweight version.
1. Clone the repository
Clone the repository to your local machine:
git clone https://github.com/IP127000/openVLA-Qwen.git
cd openVLA-Qwen
2. Create a new conda environment and activate it:
conda create -n vla-qwen python=3.10 -y
conda activate vla-qwen
3. Install the required dependencies
pip install --upgrade pip
pip install -e ".[train]"
Acknowledgements
I would like to express my gratitude to the following repositories:
- OpenVLA - For providing the core structure and functionality that inspired OpenVLA-Qwen.
- LLaVA_OpenVLA - For his contribution to data preprocessing techniques.