Cortexelus commited on
Commit
f6ada03
·
1 Parent(s): 267e477

Remove pipeline_state from tensorRT/ — it ships with the inference code repo, not here

Browse files

The TRT engines repo only holds engine binaries. The small config + tokenizer files
(pipeline_state/cond_routing.json, dist_shift_config.json, model_info.json,
num_conditioner.{pt,npz}, num_conditioner_config.json, tokenizer/*) live alongside
sa3_trt.py in the inference code repo since they are required by the runtime code
and tiny (~35 MB including the tokenizer).

tensorRT/pipeline_state/cond_routing.json DELETED
@@ -1 +0,0 @@
1
- {"cross_attn_cond_ids": ["prompt", "seconds_total"], "global_cond_ids": ["seconds_total"], "local_add_cond_ids": ["inpaint_mask", "inpaint_masked_input"]}
 
 
tensorRT/pipeline_state/dist_shift_config.json DELETED
@@ -1 +0,0 @@
1
- {"type": "DistributionShift", "base_shift": 0.5, "max_shift": 1.15, "max_length": 4096, "min_length": 256, "use_sine": false}
 
 
tensorRT/pipeline_state/model_info.json DELETED
@@ -1 +0,0 @@
1
- {"io_channels": 256, "sample_rate": 44100, "model_dtype": "torch.float32"}
 
 
tensorRT/pipeline_state/num_conditioner.npz DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:a26ca5ef3af62677d82a3199195aebd6b6a74c15ab4b303851557b6e493f60a4
3
- size 790094
 
 
 
 
tensorRT/pipeline_state/num_conditioner.pt DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:0f2aecdb2436073f3aedb37b4c129e42b5ad7dce5aeca16fabdbe100bbaf607e
3
- size 791304
 
 
 
 
tensorRT/pipeline_state/num_conditioner_config.json DELETED
@@ -1 +0,0 @@
1
- {"min_val": 0, "max_val": 384, "type": "NumberConditioner", "output_dim": 768}
 
 
tensorRT/pipeline_state/tokenizer/tokenizer.json DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:f7f12d987b3614408d037113c1fe9348bc1a1c4994807ad07c71b280e33abdbd
3
- size 34362304
 
 
 
 
tensorRT/pipeline_state/tokenizer/tokenizer_config.json DELETED
@@ -1,16 +0,0 @@
1
- {
2
- "backend": "tokenizers",
3
- "bos_token": "<bos>",
4
- "clean_up_tokenization_spaces": false,
5
- "eos_token": "<eos>",
6
- "is_local": false,
7
- "mask_token": "<mask>",
8
- "model_max_length": 1000000000000000019884624838656,
9
- "pad_token": "<pad>",
10
- "padding_side": "right",
11
- "sp_model_kwargs": {},
12
- "spaces_between_special_tokens": false,
13
- "tokenizer_class": "GemmaTokenizer",
14
- "unk_token": "<unk>",
15
- "use_default_system_prompt": false
16
- }