akashsharma02 commited on
Commit
6a164d4
·
verified ·
1 Parent(s): 4f6bb7c

Upload folder using huggingface_hub

Browse files
README.md CHANGED
@@ -1,3 +1,37 @@
1
- ---
2
- license: cc-by-nc-4.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ tags:
4
+ - sparsh-skin
5
+ - tiny
6
+ ---
7
+
8
+ # Sparsh-skin model
9
+
10
+ [Sparsh-skin](https://akashsharma02.github.io/sparsh-skin-ssl/) is a transformer-based backbone for full hand tactile sensing with the [Xela](https://www.xelarobotics.com/tactile-sensors) sensor. This model is trained using self-distillation SSL and is specifically adapted for full hand Xela sensing, accounting for hand configuration, etc.
11
+
12
+ Disclaimer: This model card was written by the Sparsh-skin authors. The Transformer architetcure and DINO objectives have been adapted for full hand tactile SSL purposes.
13
+
14
+ ## Intended uses & limitations
15
+ You can utilize the Sparsh-skin model to extract touch representations for the Xela sensor. You have two options:
16
+
17
+ 1. Use the frozen Sparsh-skin encoder: This allows you to leverage the pre-trained weights of the Sparsh-skin model without modifying them.
18
+ 2. Fine-tune the Sparsh-skin encoder: You can fine-tune the Sparsh-skin encoder along with the training of your downstream task, allowing the model to adapt to your specific use case.
19
+
20
+ Both options enable you to take advantage of the powerful touch representations learned by the Sparsh-skin model.
21
+
22
+ ## How to Use
23
+ For detailed instructions on how to load the encoder and integrate it into your downstream task, please refer to our [GitHub repository](https://github.com/facebookresearch/sparsh-multisensory-touch).
24
+
25
+ ## Citation
26
+
27
+ ```bibtex
28
+ @inproceedings{
29
+ sharma2025selfsupervised,
30
+ title={Self-supervised perception for tactile skin covered dexterous hands},
31
+ author={Akash Sharma and Carolina Higuera and Chaithanya Krishna Bodduluri and Zixi Liu and Taosha Fan and Tess Hellebrekers and Mike Lambeta and Byron Boots and Michael Kaess and Tingfan Wu and Francois Robert Hogan and Mustafa Mukadam},
32
+ booktitle={9th Annual Conference on Robot Learning},
33
+ year={2025},
34
+ url={https://openreview.net/forum?id=eLeCrM5PEO}
35
+ }
36
+ ```
37
+
xela_sparshskin_tiny.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8ac6119bdfc5b13276f34219a52016f28ac58464c233950c9c49eed0e469770
3
+ size 432345356
xela_sparshskin_tiny.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1006a242688b9921b260e5dd024abc333383bc7db6217c8822b0b269e127a78f
3
+ size 14611341