Upload folder using huggingface_hub

Urdu-HLR-Model/README.md

@@ -0,0 +1,79 @@
+---
+language:
+  - ur
+license: cc-by-nc-4.0
+tags:
+  - handwritten-text-recognition
+  - urdu
+  - pucit
+  - densenet
+  - transformer
+  - transfer-learning
+  - pytorch
+  - safetensors
+datasets:
+  - PUCIT
+  - DASTNUS
+metrics:
+  - cer
+  - wer
+pipeline_tag: image-to-text
+---
+
+# Urdu Handwritten Text Recognition: DenseNet121-Transformer (Fine-tuned on PUCIT)
+
+## Model Description
+A lightweight DenseNet121-Transformer architecture for Urdu handwritten line recognition,
+pre-trained on the Kurdish DASTNUS dataset and fine-tuned on the PUCIT Urdu handwritten dataset.
+Uses a triple unified vocabulary covering Kurdish, Arabic, and Urdu scripts (192 tokens).
+
+## Architecture
+- **CNN Backbone:** DenseNet-121 (pretrained on ImageNet)
+- **Encoder:** 3 Transformer encoder layers
+- **Decoder:** 3 Transformer decoder layers
+- **Attention Heads:** 8
+- **Hidden Size:** 256
+- **Parameters:** ~12.8M
+- **Vocabulary:** 192 tokens (Triple unified: Kurdish + Arabic + Urdu)
+
+## Transfer Learning Pipeline
+1. Pre-trained on Kurdish DASTNUS dataset (with unified vocabulary)
+2. Fine-tuned on PUCIT Urdu handwritten line dataset
+
+## Performance on PUCIT Test Set
+| Metric | Value |
+|--------|-------|
+| CER | 0.0932 |
+| WER | 0.2799 |
+| CRR | 90.68% |
+
+## Training Data
+- **Pre-training:** DASTNUS Kurdish handwritten dataset
+- **Fine-tuning:** PUCIT Urdu handwritten dataset (5,554 training, 935 validation, 912 testing)
+
+## Usage
+```python
+from safetensors.torch import load_file
+import json
+
+# Load model weights
+state_dict = load_file("model.safetensors")
+
+# Load config
+with open("config.json", "r") as f:
+    config = json.load(f)
+
+# Load vocabulary
+with open("vocab.json", "r", encoding="utf-8") as f:
+    vocab = json.load(f)
+
+# Load full unified vocabulary info
+with open("unified_vocabulary.json", "r", encoding="utf-8") as f:
+    unified_vocab = json.load(f)
+```
+
+## Citation
+[]
+
+## License
+This model is released for non-commercial scientific research purposes only.

Urdu-HLR-Model/config.json

@@ -0,0 +1,30 @@
+{
+  "architecture": "DenseNet121-Transformer",
+  "model_type": "custom",
+  "task": "handwritten-text-recognition",
+  "language": "Urdu",
+  "script": "Arabic",
+  "transfer_learning": "Kurdish (DASTNUS) → Urdu (PUCIT)",
+  "vocabulary": "Triple unified (Kurdish + Arabic + Urdu)",
+  "hidden_size": 256,
+  "num_encoder_layers": 3,
+  "num_decoder_layers": 3,
+  "num_attention_heads": 8,
+  "feed_forward_dim": 1024,
+  "dropout": 0.4,
+  "vocab_size": 192,
+  "max_sequence_length": 150,
+  "image_height": 96,
+  "image_width": 1235,
+  "cnn_backbone": "densenet121",
+  "parameters": 14209145,
+  "training": {
+    "best_val_cer": 0.061720455254131584,
+    "best_val_loss": null,
+    "best_epoch": 74,
+    "optimizer": "AdamW",
+    "learning_rate": 0.0005,
+    "batch_size": 16,
+    "pretrained_from": "Kurdish DASTNUS (unified vocab)"
+  }
+}

Urdu-HLR-Model/idx_to_char.json

@@ -0,0 +1,194 @@
+{
+  "0": "<PAD>",
+  "1": "<SOS>",
+  "2": "<EOS>",
+  "3": " ",
+  "4": "!",
+  "5": "\"",
+  "6": "#",
+  "7": "%",
+  "8": "&",
+  "9": "'",
+  "10": "(",
+  "11": ")",
+  "12": "*",
+  "13": "+",
+  "14": ",",
+  "15": "-",
+  "16": ".",
+  "17": "/",
+  "18": "0",
+  "19": "1",
+  "20": "2",
+  "21": "3",
+  "22": "4",
+  "23": "5",
+  "24": "6",
+  "25": "7",
+  "26": "8",
+  "27": "9",
+  "28": ":",
+  "29": ";",
+  "30": "=",
+  "31": ">",
+  "32": "?",
+  "33": "@",
+  "34": "A",
+  "35": "B",
+  "36": "C",
+  "37": "D",
+  "38": "E",
+  "39": "F",
+  "40": "H",
+  "41": "I",
+  "42": "K",
+  "43": "M",
+  "44": "P",
+  "45": "R",
+  "46": "S",
+  "47": "Y",
+  "48": "[",
+  "49": "\\",
+  "50": "]",
+  "51": "_",
+  "52": "a",
+  "53": "b",
+  "54": "c",
+  "55": "d",
+  "56": "e",
+  "57": "f",
+  "58": "g",
+  "59": "h",
+  "60": "i",
+  "61": "l",
+  "62": "m",
+  "63": "n",
+  "64": "o",
+  "65": "p",
+  "66": "r",
+  "67": "s",
+  "68": "t",
+  "69": "u",
+  "70": "v",
+  "71": "w",
+  "72": "x",
+  "73": "y",
+  "74": "{",
+  "75": "|",
+  "76": "}",
+  "77": " ",
+  "78": "×",
+  "79": "÷",
+  "80": "،",
+  "81": "؎",
+  "82": "ؐ",
+  "83": "ؑ",
+  "84": "ؒ",
+  "85": "ؓ",
+  "86": "؛",
+  "87": "؟",
+  "88": "ء",
+  "89": "آ",
+  "90": "أ",
+  "91": "ؤ",
+  "92": "إ",
+  "93": "ئ",
+  "94": "ا",
+  "95": "ب",
+  "96": "ة",
+  "97": "ت",
+  "98": "ث",
+  "99": "ج",
+  "100": "ح",
+  "101": "خ",
+  "102": "د",
+  "103": "ذ",
+  "104": "ر",
+  "105": "ز",
+  "106": "س",
+  "107": "ش",
+  "108": "ص",
+  "109": "ض",
+  "110": "ط",
+  "111": "ظ",
+  "112": "ع",
+  "113": "غ",
+  "114": "ـ",
+  "115": "ف",
+  "116": "ق",
+  "117": "ك",
+  "118": "ل",
+  "119": "م",
+  "120": "ن",
+  "121": "ه",
+  "122": "و",
+  "123": "وو",
+  "124": "ى",
+  "125": "ي",
+  "126": "ً",
+  "127": "ٌ",
+  "128": "ٍ",
+  "129": "َ",
+  "130": "ُ",
+  "131": "ِ",
+  "132": "ّ",
+  "133": "ْ",
+  "134": "ٓ",
+  "135": "ٔ",
+  "136": "٠",
+  "137": "١",
+  "138": "٢",
+  "139": "٣",
+  "140": "٤",
+  "141": "٥",
+  "142": "٦",
+  "143": "٧",
+  "144": "٨",
+  "145": "٩",
+  "146": "٪",
+  "147": "٬",
+  "148": "ٰ",
+  "149": "ٹ",
+  "150": "پ",
+  "151": "چ",
+  "152": "ڈ",
+  "153": "ڑ",
+  "154": "ڕ",
+  "155": "ژ",
+  "156": "ڤ",
+  "157": "ک",
+  "158": "گ",
+  "159": "ڵ",
+  "160": "ں",
+  "161": "ھ",
+  "162": "ہ",
+  "163": "ۂ",
+  "164": "ۃ",
+  "165": "ۆ",
+  "166": "ی",
+  "167": "ێ",
+  "168": "ے",
+  "169": "ۓ",
+  "170": "۔",
+  "171": "ە",
+  "172": "۰",
+  "173": "۱",
+  "174": "۲",
+  "175": "۳",
+  "176": "۴",
+  "177": "۵",
+  "178": "۷",
+  "179": "۹",
+  "180": "‌",
+  "181": "‎",
+  "182": "‏",
+  "183": "–",
+  "184": "‘",
+  "185": "’",
+  "186": "“",
+  "187": "”",
+  "188": "…",
+  "189": "ﷲ",
+  "190": "ﺅ",
+  "191": ""
+}

Urdu-HLR-Model/model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8fb2a51ae87b5d215ee7841854208f76f0230633625255137d961e00ae713122
+size 56952648

Urdu-HLR-Model/unified_vocabulary.json

@@ -0,0 +1,1008 @@
+{
+  "dataset": "Unified_Kurdish_Arabic_Urdu",
+  "description": "Triple unified vocabulary for Kurdish (DASTNUS), Arabic (KHATT), and Urdu (PUCIT)",
+  "vocab_list": [
+    "<PAD>",
+    "<SOS>",
+    "<EOS>",
+    " ",
+    "!",
+    "\"",
+    "#",
+    "%",
+    "&",
+    "'",
+    "(",
+    ")",
+    "*",
+    "+",
+    ",",
+    "-",
+    ".",
+    "/",
+    "0",
+    "1",
+    "2",
+    "3",
+    "4",
+    "5",
+    "6",
+    "7",
+    "8",
+    "9",
+    ":",
+    ";",
+    "=",
+    ">",
+    "?",
+    "@",
+    "A",
+    "B",
+    "C",
+    "D",
+    "E",
+    "F",
+    "H",
+    "I",
+    "K",
+    "M",
+    "P",
+    "R",
+    "S",
+    "Y",
+    "[",
+    "\\",
+    "]",
+    "_",
+    "a",
+    "b",
+    "c",
+    "d",
+    "e",
+    "f",
+    "g",
+    "h",
+    "i",
+    "l",
+    "m",
+    "n",
+    "o",
+    "p",
+    "r",
+    "s",
+    "t",
+    "u",
+    "v",
+    "w",
+    "x",
+    "y",
+    "{",
+    "|",
+    "}",
+    " ",
+    "×",
+    "÷",
+    "،",
+    "؎",
+    "ؐ",
+    "ؑ",
+    "ؒ",
+    "ؓ",
+    "؛",
+    "؟",
+    "ء",
+    "آ",
+    "أ",
+    "ؤ",
+    "إ",
+    "ئ",
+    "ا",
+    "ب",
+    "ة",
+    "ت",
+    "ث",
+    "ج",
+    "ح",
+    "خ",
+    "د",
+    "ذ",
+    "ر",
+    "ز",
+    "س",
+    "ش",
+    "ص",
+    "ض",
+    "ط",
+    "ظ",
+    "ع",
+    "غ",
+    "ـ",
+    "ف",
+    "ق",
+    "ك",
+    "ل",
+    "م",
+    "ن",
+    "ه",
+    "و",
+    "وو",
+    "ى",
+    "ي",
+    "ً",
+    "ٌ",
+    "ٍ",
+    "َ",
+    "ُ",
+    "ِ",
+    "ّ",
+    "ْ",
+    "ٓ",
+    "ٔ",
+    "٠",
+    "١",
+    "٢",
+    "٣",
+    "٤",
+    "٥",
+    "٦",
+    "٧",
+    "٨",
+    "٩",
+    "٪",
+    "٬",
+    "ٰ",
+    "ٹ",
+    "پ",
+    "چ",
+    "ڈ",
+    "ڑ",
+    "ڕ",
+    "ژ",
+    "ڤ",
+    "ک",
+    "گ",
+    "ڵ",
+    "ں",
+    "ھ",
+    "ہ",
+    "ۂ",
+    "ۃ",
+    "ۆ",
+    "ی",
+    "ێ",
+    "ے",
+    "ۓ",
+    "۔",
+    "ە",
+    "۰",
+    "۱",
+    "۲",
+    "۳",
+    "۴",
+    "۵",
+    "۷",
+    "۹",
+    "‌",
+    "‎",
+    "‏",
+    "–",
+    "‘",
+    "’",
+    "“",
+    "”",
+    "…",
+    "ﷲ",
+    "ﺅ",
+    ""
+  ],
+  "vocab_size": 192,
+  "char_to_idx": {
+    "<PAD>": 0,
+    "<SOS>": 1,
+    "<EOS>": 2,
+    " ": 3,
+    "!": 4,
+    "\"": 5,
+    "#": 6,
+    "%": 7,
+    "&": 8,
+    "'": 9,
+    "(": 10,
+    ")": 11,
+    "*": 12,
+    "+": 13,
+    ",": 14,
+    "-": 15,
+    ".": 16,
+    "/": 17,
+    "0": 18,
+    "1": 19,
+    "2": 20,
+    "3": 21,
+    "4": 22,
+    "5": 23,
+    "6": 24,
+    "7": 25,
+    "8": 26,
+    "9": 27,
+    ":": 28,
+    ";": 29,
+    "=": 30,
+    ">": 31,
+    "?": 32,
+    "@": 33,
+    "A": 34,
+    "B": 35,
+    "C": 36,
+    "D": 37,
+    "E": 38,
+    "F": 39,
+    "H": 40,
+    "I": 41,
+    "K": 42,
+    "M": 43,
+    "P": 44,
+    "R": 45,
+    "S": 46,
+    "Y": 47,
+    "[": 48,
+    "\\": 49,
+    "]": 50,
+    "_": 51,
+    "a": 52,
+    "b": 53,
+    "c": 54,
+    "d": 55,
+    "e": 56,
+    "f": 57,
+    "g": 58,
+    "h": 59,
+    "i": 60,
+    "l": 61,
+    "m": 62,
+    "n": 63,
+    "o": 64,
+    "p": 65,
+    "r": 66,
+    "s": 67,
+    "t": 68,
+    "u": 69,
+    "v": 70,
+    "w": 71,
+    "x": 72,
+    "y": 73,
+    "{": 74,
+    "|": 75,
+    "}": 76,
+    " ": 77,
+    "×": 78,
+    "÷": 79,
+    "،": 80,
+    "؎": 81,
+    "ؐ": 82,
+    "ؑ": 83,
+    "ؒ": 84,
+    "ؓ": 85,
+    "؛": 86,
+    "؟": 87,
+    "ء": 88,
+    "آ": 89,
+    "أ": 90,
+    "ؤ": 91,
+    "إ": 92,
+    "ئ": 93,
+    "ا": 94,
+    "ب": 95,
+    "ة": 96,
+    "ت": 97,
+    "ث": 98,
+    "ج": 99,
+    "ح": 100,
+    "خ": 101,
+    "د": 102,
+    "ذ": 103,
+    "ر": 104,
+    "ز": 105,
+    "س": 106,
+    "ش": 107,
+    "ص": 108,
+    "ض": 109,
+    "ط": 110,
+    "ظ": 111,
+    "ع": 112,
+    "غ": 113,
+    "ـ": 114,
+    "ف": 115,
+    "ق": 116,
+    "ك": 117,
+    "ل": 118,
+    "م": 119,
+    "ن": 120,
+    "ه": 121,
+    "و": 122,
+    "وو": 123,
+    "ى": 124,
+    "ي": 125,
+    "ً": 126,
+    "ٌ": 127,
+    "ٍ": 128,
+    "َ": 129,
+    "ُ": 130,
+    "ِ": 131,
+    "ّ": 132,
+    "ْ": 133,
+    "ٓ": 134,
+    "ٔ": 135,
+    "٠": 136,
+    "١": 137,
+    "٢": 138,
+    "٣": 139,
+    "٤": 140,
+    "٥": 141,
+    "٦": 142,
+    "٧": 143,
+    "٨": 144,
+    "٩": 145,
+    "٪": 146,
+    "٬": 147,
+    "ٰ": 148,
+    "ٹ": 149,
+    "پ": 150,
+    "چ": 151,
+    "ڈ": 152,
+    "ڑ": 153,
+    "ڕ": 154,
+    "ژ": 155,
+    "ڤ": 156,
+    "ک": 157,
+    "گ": 158,
+    "ڵ": 159,
+    "ں": 160,
+    "ھ": 161,
+    "ہ": 162,
+    "ۂ": 163,
+    "ۃ": 164,
+    "ۆ": 165,
+    "ی": 166,
+    "ێ": 167,
+    "ے": 168,
+    "ۓ": 169,
+    "۔": 170,
+    "ە": 171,
+    "۰": 172,
+    "۱": 173,
+    "۲": 174,
+    "۳": 175,
+    "۴": 176,
+    "۵": 177,
+    "۷": 178,
+    "۹": 179,
+    "‌": 180,
+    "‎": 181,
+    "‏": 182,
+    "–": 183,
+    "‘": 184,
+    "’": 185,
+    "“": 186,
+    "”": 187,
+    "…": 188,
+    "ﷲ": 189,
+    "ﺅ": 190,
+    "": 191
+  },
+  "idx_to_char": {
+    "0": "<PAD>",
+    "1": "<SOS>",
+    "2": "<EOS>",
+    "3": " ",
+    "4": "!",
+    "5": "\"",
+    "6": "#",
+    "7": "%",
+    "8": "&",
+    "9": "'",
+    "10": "(",
+    "11": ")",
+    "12": "*",
+    "13": "+",
+    "14": ",",
+    "15": "-",
+    "16": ".",
+    "17": "/",
+    "18": "0",
+    "19": "1",
+    "20": "2",
+    "21": "3",
+    "22": "4",
+    "23": "5",
+    "24": "6",
+    "25": "7",
+    "26": "8",
+    "27": "9",
+    "28": ":",
+    "29": ";",
+    "30": "=",
+    "31": ">",
+    "32": "?",
+    "33": "@",
+    "34": "A",
+    "35": "B",
+    "36": "C",
+    "37": "D",
+    "38": "E",
+    "39": "F",
+    "40": "H",
+    "41": "I",
+    "42": "K",
+    "43": "M",
+    "44": "P",
+    "45": "R",
+    "46": "S",
+    "47": "Y",
+    "48": "[",
+    "49": "\\",
+    "50": "]",
+    "51": "_",
+    "52": "a",
+    "53": "b",
+    "54": "c",
+    "55": "d",
+    "56": "e",
+    "57": "f",
+    "58": "g",
+    "59": "h",
+    "60": "i",
+    "61": "l",
+    "62": "m",
+    "63": "n",
+    "64": "o",
+    "65": "p",
+    "66": "r",
+    "67": "s",
+    "68": "t",
+    "69": "u",
+    "70": "v",
+    "71": "w",
+    "72": "x",
+    "73": "y",
+    "74": "{",
+    "75": "|",
+    "76": "}",
+    "77": " ",
+    "78": "×",
+    "79": "÷",
+    "80": "،",
+    "81": "؎",
+    "82": "ؐ",
+    "83": "ؑ",
+    "84": "ؒ",
+    "85": "ؓ",
+    "86": "؛",
+    "87": "؟",
+    "88": "ء",
+    "89": "آ",
+    "90": "أ",
+    "91": "ؤ",
+    "92": "إ",
+    "93": "ئ",
+    "94": "ا",
+    "95": "ب",
+    "96": "ة",
+    "97": "ت",
+    "98": "ث",
+    "99": "ج",
+    "100": "ح",
+    "101": "خ",
+    "102": "د",
+    "103": "ذ",
+    "104": "ر",
+    "105": "ز",
+    "106": "س",
+    "107": "ش",
+    "108": "ص",
+    "109": "ض",
+    "110": "ط",
+    "111": "ظ",
+    "112": "ع",
+    "113": "غ",
+    "114": "ـ",
+    "115": "ف",
+    "116": "ق",
+    "117": "ك",
+    "118": "ل",
+    "119": "م",
+    "120": "ن",
+    "121": "ه",
+    "122": "و",
+    "123": "وو",
+    "124": "ى",
+    "125": "ي",
+    "126": "ً",
+    "127": "ٌ",
+    "128": "ٍ",
+    "129": "َ",
+    "130": "ُ",
+    "131": "ِ",
+    "132": "ّ",
+    "133": "ْ",
+    "134": "ٓ",
+    "135": "ٔ",
+    "136": "٠",
+    "137": "١",
+    "138": "٢",
+    "139": "٣",
+    "140": "٤",
+    "141": "٥",
+    "142": "٦",
+    "143": "٧",
+    "144": "٨",
+    "145": "٩",
+    "146": "٪",
+    "147": "٬",
+    "148": "ٰ",
+    "149": "ٹ",
+    "150": "پ",
+    "151": "چ",
+    "152": "ڈ",
+    "153": "ڑ",
+    "154": "ڕ",
+    "155": "ژ",
+    "156": "ڤ",
+    "157": "ک",
+    "158": "گ",
+    "159": "ڵ",
+    "160": "ں",
+    "161": "ھ",
+    "162": "ہ",
+    "163": "ۂ",
+    "164": "ۃ",
+    "165": "ۆ",
+    "166": "ی",
+    "167": "ێ",
+    "168": "ے",
+    "169": "ۓ",
+    "170": "۔",
+    "171": "ە",
+    "172": "۰",
+    "173": "۱",
+    "174": "۲",
+    "175": "۳",
+    "176": "۴",
+    "177": "۵",
+    "178": "۷",
+    "179": "۹",
+    "180": "‌",
+    "181": "‎",
+    "182": "‏",
+    "183": "–",
+    "184": "‘",
+    "185": "’",
+    "186": "“",
+    "187": "”",
+    "188": "…",
+    "189": "ﷲ",
+    "190": "ﺅ",
+    "191": ""
+  },
+  "kurdish_char_count": 112,
+  "arabic_char_count": 84,
+  "urdu_char_count": 143,
+  "all_three_overlap_count": 49,
+  "all_three_overlap_chars": [
+    " ",
+    "!",
+    "\"",
+    "(",
+    ")",
+    "*",
+    "-",
+    ".",
+    "/",
+    "0",
+    "1",
+    "2",
+    "4",
+    ":",
+    ";",
+    "[",
+    "]",
+    "x",
+    "،",
+    "؛",
+    "؟",
+    "ء",
+    "أ",
+    "ؤ",
+    "ئ",
+    "ا",
+    "ب",
+    "ت",
+    "ث",
+    "ج",
+    "ح",
+    "خ",
+    "د",
+    "ذ",
+    "ر",
+    "ز",
+    "س",
+    "ش",
+    "ص",
+    "ط",
+    "ع",
+    "غ",
+    "ف",
+    "ق",
+    "ل",
+    "م",
+    "ن",
+    "و",
+    "ي"
+  ],
+  "kurdish_only_count": 28,
+  "arabic_only_count": 7,
+  "urdu_only_count": 53,
+  "kurdish_only_chars": [
+    "&",
+    "@",
+    "C",
+    "D",
+    "H",
+    "_",
+    "h",
+    "{",
+    "|",
+    "}",
+    "÷",
+    "وو",
+    "٠",
+    "١",
+    "٢",
+    "٣",
+    "٤",
+    "٥",
+    "٧",
+    "٩",
+    "٪",
+    "ڕ",
+    "ڤ",
+    "ڵ",
+    "ۆ",
+    "ێ",
+    "ە",
+    "‎"
+  ],
+  "arabic_only_chars": [
+    ">",
+    "?",
+    "\\",
+    " ",
+    "إ",
+    "ٌ",
+    "ٍ"
+  ],
+  "urdu_only_chars": [
+    "A",
+    "B",
+    "E",
+    "I",
+    "K",
+    "M",
+    "R",
+    "S",
+    "Y",
+    "b",
+    "f",
+    "g",
+    "i",
+    "l",
+    "n",
+    "r",
+    "u",
+    "v",
+    "w",
+    "y",
+    "؎",
+    "ؐ",
+    "ؑ",
+    "ؒ",
+    "ؓ",
+    "ٓ",
+    "ٔ",
+    "٬",
+    "ٰ",
+    "ٹ",
+    "ڈ",
+    "ڑ",
+    "ں",
+    "ہ",
+    "ۂ",
+    "ۃ",
+    "ے",
+    "ۓ",
+    "۰",
+    "۱",
+    "۲",
+    "۳",
+    "۴",
+    "۵",
+    "۷",
+    "۹",
+    "’",
+    "“",
+    "”",
+    "…",
+    "ﷲ",
+    "ﺅ",
+    ""
+  ],
+  "kurdish_arabic_overlap_count": 60,
+  "kurdish_urdu_overlap_count": 73,
+  "arabic_urdu_overlap_count": 66,
+  "kurdish_arabic_overlap_chars": [
+    " ",
+    "!",
+    "\"",
+    "#",
+    "%",
+    "(",
+    ")",
+    "*",
+    "+",
+    "-",
+    ".",
+    "/",
+    "0",
+    "1",
+    "2",
+    "4",
+    ":",
+    ";",
+    "=",
+    "[",
+    "]",
+    "x",
+    "×",
+    "،",
+    "؛",
+    "؟",
+    "ء",
+    "أ",
+    "ؤ",
+    "ئ",
+    "ا",
+    "ب",
+    "ة",
+    "ت",
+    "ث",
+    "ج",
+    "ح",
+    "خ",
+    "د",
+    "ذ",
+    "ر",
+    "ز",
+    "س",
+    "ش",
+    "ص",
+    "ط",
+    "ع",
+    "غ",
+    "ـ",
+    "ف",
+    "ق",
+    "ك",
+    "ل",
+    "م",
+    "ن",
+    "ه",
+    "و",
+    "ى",
+    "ي",
+    "–"
+  ],
+  "kurdish_urdu_overlap_chars": [
+    " ",
+    "!",
+    "\"",
+    "'",
+    "(",
+    ")",
+    "*",
+    "-",
+    ".",
+    "/",
+    "0",
+    "1",
+    "2",
+    "4",
+    ":",
+    ";",
+    "F",
+    "P",
+    "[",
+    "]",
+    "a",
+    "c",
+    "d",
+    "e",
+    "m",
+    "o",
+    "p",
+    "s",
+    "t",
+    "x",
+    "،",
+    "؛",
+    "؟",
+    "ء",
+    "أ",
+    "ؤ",
+    "ئ",
+    "ا",
+    "ب",
+    "ت",
+    "ث",
+    "ج",
+    "ح",
+    "خ",
+    "د",
+    "ذ",
+    "ر",
+    "ز",
+    "س",
+    "ش",
+    "ص",
+    "ط",
+    "ع",
+    "غ",
+    "ف",
+    "ق",
+    "ل",
+    "م",
+    "ن",
+    "و",
+    "ي",
+    "٦",
+    "٨",
+    "پ",
+    "چ",
+    "ژ",
+    "ک",
+    "گ",
+    "ھ",
+    "ی",
+    "۔",
+    "‌",
+    "‏"
+  ],
+  "arabic_urdu_overlap_chars": [
+    " ",
+    "!",
+    "\"",
+    "(",
+    ")",
+    "*",
+    ",",
+    "-",
+    ".",
+    "/",
+    "0",
+    "1",
+    "2",
+    "3",
+    "4",
+    "5",
+    "6",
+    "7",
+    "8",
+    "9",
+    ":",
+    ";",
+    "[",
+    "]",
+    "x",
+    "،",
+    "؛",
+    "؟",
+    "ء",
+    "آ",
+    "أ",
+    "ؤ",
+    "ئ",
+    "ا",
+    "ب",
+    "ت",
+    "ث",
+    "ج",
+    "ح",
+    "خ",
+    "د",
+    "ذ",
+    "ر",
+    "ز",
+    "س",
+    "ش",
+    "ص",
+    "ض",
+    "ط",
+    "ظ",
+    "ع",
+    "غ",
+    "ف",
+    "ق",
+    "ل",
+    "م",
+    "ن",
+    "و",
+    "ي",
+    "ً",
+    "َ",
+    "ُ",
+    "ِ",
+    "ّ",
+    "ْ",
+    "‘"
+  ],
+  "kurdish_arabic_only_count": 11,
+  "kurdish_urdu_only_count": 24,
+  "arabic_urdu_only_count": 17,
+  "kurdish_arabic_only_chars": [
+    "#",
+    "%",
+    "+",
+    "=",
+    "×",
+    "ة",
+    "ـ",
+    "ك",
+    "ه",
+    "ى",
+    "–"
+  ],
+  "kurdish_urdu_only_chars": [
+    "'",
+    "F",
+    "P",
+    "a",
+    "c",
+    "d",
+    "e",
+    "m",
+    "o",
+    "p",
+    "s",
+    "t",
+    "٦",
+    "٨",
+    "پ",
+    "چ",
+    "ژ",
+    "ک",
+    "گ",
+    "ھ",
+    "ی",
+    "۔",
+    "‌",
+    "‏"
+  ],
+  "arabic_urdu_only_chars": [
+    ",",
+    "3",
+    "5",
+    "6",
+    "7",
+    "8",
+    "9",
+    "آ",
+    "ض",
+    "ظ",
+    "ً",
+    "َ",
+    "ُ",
+    "ِ",
+    "ّ",
+    "ْ",
+    "‘"
+  ]
+}

Urdu-HLR-Model/vocab.json

@@ -0,0 +1,194 @@
+{
+  "<PAD>": 0,
+  "<SOS>": 1,
+  "<EOS>": 2,
+  " ": 3,
+  "!": 4,
+  "\"": 5,
+  "#": 6,
+  "%": 7,
+  "&": 8,
+  "'": 9,
+  "(": 10,
+  ")": 11,
+  "*": 12,
+  "+": 13,
+  ",": 14,
+  "-": 15,
+  ".": 16,
+  "/": 17,
+  "0": 18,
+  "1": 19,
+  "2": 20,
+  "3": 21,
+  "4": 22,
+  "5": 23,
+  "6": 24,
+  "7": 25,
+  "8": 26,
+  "9": 27,
+  ":": 28,
+  ";": 29,
+  "=": 30,
+  ">": 31,
+  "?": 32,
+  "@": 33,
+  "A": 34,
+  "B": 35,
+  "C": 36,
+  "D": 37,
+  "E": 38,
+  "F": 39,
+  "H": 40,
+  "I": 41,
+  "K": 42,
+  "M": 43,
+  "P": 44,
+  "R": 45,
+  "S": 46,
+  "Y": 47,
+  "[": 48,
+  "\\": 49,
+  "]": 50,
+  "_": 51,
+  "a": 52,
+  "b": 53,
+  "c": 54,
+  "d": 55,
+  "e": 56,
+  "f": 57,
+  "g": 58,
+  "h": 59,
+  "i": 60,
+  "l": 61,
+  "m": 62,
+  "n": 63,
+  "o": 64,
+  "p": 65,
+  "r": 66,
+  "s": 67,
+  "t": 68,
+  "u": 69,
+  "v": 70,
+  "w": 71,
+  "x": 72,
+  "y": 73,
+  "{": 74,
+  "|": 75,
+  "}": 76,
+  " ": 77,
+  "×": 78,
+  "÷": 79,
+  "،": 80,
+  "؎": 81,
+  "ؐ": 82,
+  "ؑ": 83,
+  "ؒ": 84,
+  "ؓ": 85,
+  "؛": 86,
+  "؟": 87,
+  "ء": 88,
+  "آ": 89,
+  "أ": 90,
+  "ؤ": 91,
+  "إ": 92,
+  "ئ": 93,
+  "ا": 94,
+  "ب": 95,
+  "ة": 96,
+  "ت": 97,
+  "ث": 98,
+  "ج": 99,
+  "ح": 100,
+  "خ": 101,
+  "د": 102,
+  "ذ": 103,
+  "ر": 104,
+  "ز": 105,
+  "س": 106,
+  "ش": 107,
+  "ص": 108,
+  "ض": 109,
+  "ط": 110,
+  "ظ": 111,
+  "ع": 112,
+  "غ": 113,
+  "ـ": 114,
+  "ف": 115,
+  "ق": 116,
+  "ك": 117,
+  "ل": 118,
+  "م": 119,
+  "ن": 120,
+  "ه": 121,
+  "و": 122,
+  "وو": 123,
+  "ى": 124,
+  "ي": 125,
+  "ً": 126,
+  "ٌ": 127,
+  "ٍ": 128,
+  "َ": 129,
+  "ُ": 130,
+  "ِ": 131,
+  "ّ": 132,
+  "ْ": 133,
+  "ٓ": 134,
+  "ٔ": 135,
+  "٠": 136,
+  "١": 137,
+  "٢": 138,
+  "٣": 139,
+  "٤": 140,
+  "٥": 141,
+  "٦": 142,
+  "٧": 143,
+  "٨": 144,
+  "٩": 145,
+  "٪": 146,
+  "٬": 147,
+  "ٰ": 148,
+  "ٹ": 149,
+  "پ": 150,
+  "چ": 151,
+  "ڈ": 152,
+  "ڑ": 153,
+  "ڕ": 154,
+  "ژ": 155,
+  "ڤ": 156,
+  "ک": 157,
+  "گ": 158,
+  "ڵ": 159,
+  "ں": 160,
+  "ھ": 161,
+  "ہ": 162,
+  "ۂ": 163,
+  "ۃ": 164,
+  "ۆ": 165,
+  "ی": 166,
+  "ێ": 167,
+  "ے": 168,
+  "ۓ": 169,
+  "۔": 170,
+  "ە": 171,
+  "۰": 172,
+  "۱": 173,
+  "۲": 174,
+  "۳": 175,
+  "۴": 176,
+  "۵": 177,
+  "۷": 178,
+  "۹": 179,
+  "‌": 180,
+  "‎": 181,
+  "‏": 182,
+  "–": 183,
+  "‘": 184,
+  "’": 185,
+  "“": 186,
+  "”": 187,
+  "…": 188,
+  "ﷲ": 189,
+  "ﺅ": 190,
+  "": 191
+}