chenglongy/glassvla-4b-sam2-lora-percent10-63k

SpatialVLA Merged Model

This model is a merged version of:

• Base Model: /remote-home/share/chenglong/Workplace/SpatialVLA/ckpts_pretrained/spatialvla-4b-224-pt
• LoRA Adapter: /remote-home/share/chenglong/Workplace/SpatialVLA/outputs/spatialvla_4b_finetune/2025-10-14/08-05-35_glass_grayscale_dataset_spatialvla-4b-224-pt_lr5e-6_bs32_node1_gpu2_r32_a32_ep10_linear+emb+h/checkpoint-63490

Merge Details

• LoRA Rank (r): 32
• LoRA Alpha: 32
• Target Modules: gate_proj, q_proj, position_embedding_head.3, spatial_embed_tokens, fc2, o_proj, out_proj, k_proj, fc1, down_proj, v_proj, linear, lm_head, position_embedding_head.0, up_proj
• Merge Date: <function get_file_binaries_from_pathnames at 0x7fd341033ac0>

Usage

This merged model can be used directly without PEFT:

import torch
from transformers import AutoModel, AutoProcessor

model_path = "/remote-home/share/chenglong/Workplace/SpatialVLA/ckpts_merged/spatialvla-4b-224-glass-grayscale-merged"
processor = AutoProcessor.from_pretrained(model_path, trust_remote_code=True)
model = AutoModel.from_pretrained(
    model_path, 
    trust_remote_code=True, 
    torch_dtype=torch.bfloat16
).eval().cuda()

# Use the model for inference
# ... your inference code here ...

Notes

• This is a fully merged model, so the LoRA adapter is no longer needed.
• The model can be used just like the original base model.
• All weights have been merged into a single set of parameters.