Upload 26 files

9.txt

@@ -0,0 +1,30 @@
+Doctor: What is your patient ID?
+Patient: 8
+Doctor: What is your age?
+Patient: 27
+Doctor: What is your gender?
+Patient: Male
+Doctor: Please describe your social life at the IISERB campus. Are you actively participating in extracurricular activities, interacting with others, or taking initiative to socialize with others? 
+Patient: I love participating in such activities. Nowdays, due to PhD workload, don't get much time to indulge in extracurriculars, so i compensate it by spending more time with friends. 
+Doctor:  Describe your typical daily Mood? 
+Patient: I am mostly compsed, worried about the progress of my PHD sometimes. Mostly, i have high morale and i indulge in work enthusiastically.
+Doctor:  Does your Mood remain steady or goes up and down throughout the day without any reason or on trivial matters? 
+Patient: My mood almost remain steady, trivial matters does not affect much. Sometimes, unethical conduct of my colleagues bother me, but for a very small duration. 
+Doctor: How do you handle day-to-day irritations or frustrations? 
+Patient: I sleep well, talk to my friends. Always think of a better future. I tell myself if a work with compassion today, the coming years will be much better.
+Doctor: How do you handle pressure related to academics? 
+Patient: I try to separate my personal life from professional one. I believe academics is full of pressure, however you perform, pressure will always be there. So, don't let academic pressure destroy your personal space and mental peace, just deal it as any other profession.
+Doctor: Describe your ability to attend to the task at hand or concentrate on daily tasks (academic, non-academic)? 
+Patient: I can concentrate on tasks quite well. Although i am not able to follow the pre-decided timeline of the tasks, i do concentrate well at the task at hand.
+Doctor: Have you noticed any difficulties with memory, such as unable to register new information, forgetting recent events, or not able to recall older personal/factual events? 
+Patient: I don't have any such difficulty with memory. 
+Doctor: What do you do to feel better? For example, some people take caffeine, talk with people, or watch movies to feel better. 
+Patient: I am a hardcore tea-lover, 5-6 cups daily. So to feel better, tea is the first choice, second option i consider is to talk with people, rarely I watch movies to feel better.
+Doctor: Describe how supported you feel by others (e.g., friends, family) around you and how they help you? 
+Patient: I am lucky to have best of friends and family. Friends listen to my concerns and always provide some solution, family gives me the opportunity to focus on my career without worrying about anything else.
+Doctor: What do you usually do when you have a bad day or when you are not able to concentrate on work? 
+Patient: I take rest, sleep properly (thankfully tension does not disturb my sleep cycle), clean my room, working area, wash clothes, call family and friends.
+Doctor:  Are you experiencing symptoms of stress, anxiety, or depression? If yes, describe the symptoms?
+Patient: No
+Doctor:  Are you doing anything (by self or help seeking) for the ongoing stress, anxiety, or depression, if any? If yes, what? 
+Patient: No

Readme.txt

@@ -0,0 +1,13 @@
+To run the sample, follow these instructions:
+
+1. USing Pegasus Model
+	i. Open `code_pegasus.py`
+	ii. Run it (we have provided the path of sample data 9.txt)
+	iii. To run on other conversation files, you have to provide the path to the desired data files for testing. (You can find our sample dataset in the Sample Dataset directory)
+
+2. USing BART-large Model
+	i. Open `code_bart.py`
+	ii. Run it (we have provided the path of sample data 9.txt)
+	iii. To run on other conversation files, you have to provide the path to the desired data files for testing. (You can find our sample dataset in the Sample Dataset directory)
+	
+Note: The Sample Dataset includes an anonymized our collected sample dataset named conv_1, conv_2, and conv_3, along with a Chinese language dataset translated to English named conv_1001, conv_1002, and conv_1003 (D4).

Sample Dataset/conv_1.txt

@@ -0,0 +1,45 @@
+Doctor: What is your patient ID?
+Patient: 101
+
+Doctor: What is your age?
+Patient: 19
+
+Doctor: What is your gender?
+Patient: Male
+
+Doctor: Please describe your social life at the *anonymized* campus. Are you actively participating in extracurricular activities, interacting with others, or taking initiative to socialize with others? 
+Patient: I'm don't participate in any extracurricular activities, however I have taken part in organizing some festivals. I interact with a lot of people on a daily basis, and sometimes I take initiative to socialize with others, but generally don't initiate talk with people I've not met yet.
+
+Doctor:  Describe your typical daily Mood? 
+Patient: My typical daily mood starts positive, sometimes neutral, and tends to be neutral by the end of the day
+
+Doctor:  Does your Mood remain steady or goes up and down throughout the day without any reason or on trivial matters? 
+Patient: My mood has rarely fluctuated without reason, however it does tend to go up for trivial reasons, my mood generally doesn't do down easily. 
+
+Doctor: How do you handle day-to-day irritations or frustrations? 
+Patient: I try to fix whatever is causing me to be irritated quickly and make sure that it doesn't bother me again. If I'm not able to fix the cause of my frustration, I try to ignore it to the best of my ability and try to not bother others.
+
+Doctor: How do you handle pressure related to academics? 
+Patient: I try to create different options to study and different ways to make sure I'm studying. I have changed my timetable many times and changed my study location to try and study better.
+
+Doctor: Describe your ability to attend to the task at hand or concentrate on daily tasks (academic, non-academic)? 
+Patient: I tend to get distracted fairly easily if I'm not too concentrated on my task at hand, however, I tend to be extremely efficient with my work if I actually concentrate on what I'm doing, studying I sometimes I have to force myself but I'm able to do this in the end.
+
+Doctor: Have you noticed any difficulties with memory, such as unable to register new information, forgetting recent events, or not able to recall older personal/factual events? 
+Patient: Nothing such that it affects my daily life, however I do tend to forget information about events and such if I'm not interested in them.
+
+Doctor: What do you do to feel better? For example, some people take caffeine, talk with people, or watch movies to feel better. 
+Patient: I tend to just hang out and talk with friends to feel better if I'm feeling particularly sad, but I also play video games or watch youtube videos to feel better in general.
+
+Doctor: Describe how supported you feel by others (e.g., friends, family) around you and how they help you? 
+Patient: I feel very supported by my friends and family, they are always there to take care of me and always help me when I ask for it
+
+Doctor: What do you usually do when you have a bad day or when you are not able to concentrate on work? 
+Patient: I spend the day trying to do something new, some activity that I have not done before or very little. If that doesn't work, I just hang out with friends and hope tomorrow will be better.
+
+Doctor:  Are you experiencing symptoms of stress, anxiety, or depression? If yes, describe the symptoms?
+Patient: I sometimes feel socially anxious, talking to new people is always scary and feels like an impossible task, sometimes I feel that people talk about me behind my back, and sometimes I just feel uncomfortable. 
+
+Doctor:  Are you doing anything (by self or help seeking) for the ongoing stress, anxiety, or depression, if any? If yes, what? 
+Patient: I try my best to make sure that anxiety doesn't overwhelm me, I talk to myself, encourage myself and make sure that any unnecessary thoughts are gone from my mind.
+

Sample Dataset/conv_1001.txt

@@ -0,0 +1,48 @@
+Doctor: What is your patient ID?
+Patient: 1001
+
+Doctor: What is your age?
+Patient: 32
+
+Doctor: What is your gender?
+Patient: Female
+
+Patient: "Okay"
+
+Doctor: "Hello"
+
+Doctor: "What are your main problems recently?"
+Patient: "I haven't been feeling well recently, and I feel a little tight in my chest"
+
+Doctor: "Have you ever gone to the hospital to see a doctor?"
+
+Patient: "Not yet, I don't have much time recently"
+Patient: "Maybe it will take two weeks to go"
+Doctor: "Hmm, let's take some time to see if you have any emotional problems recently"
+
+Patient: "There's nothing wrong with my mood, I just feel mentally tired recently"
+Doctor: "Do you feel tired without doing anything?"
+
+Patient: "I feel like this, I don't want to move"
+Doctor: "Then do you feel like you don't want to work?"
+
+Patient: "I don't have enough energy to work"
+Patient: "Yes"
+Patient: "But I have to work"
+Patient: "It's quite stressful"
+Doctor: "Have you ever felt that you have lost interest in your past hobbies?"
+
+Patient: "I should still be interested"
+Patient: "I just don't have enough time to develop my hobbies"
+Doctor: "Sleep, eat, etc."
+
+Doctor: "Is everything normal?"
+Patient: "fairly normal"
+Doctor: "Will you feel dizzy or nauseous?"
+Patient: "I get dizzy occasionally"
+Doctor: "Do you feel lack of confidence? You are always worried about not doing well"
+
+Patient: "No, I don't have time to worry about this or that"
+Doctor: "It sounds like you are doing well lately"
+
+Doctor: "The consultation ends here"

Sample Dataset/conv_1002.txt

@@ -0,0 +1,55 @@
+Doctor: What is your patient ID?
+Patient: 1002
+
+Doctor: What is your age?
+Patient: 22
+
+Doctor: What is your gender?
+Patient: Female
+
+Patient: "Hello doctor"
+
+Doctor: "Hello"
+
+Doctor: "Let's get started"
+Doctor: "What problems have you encountered recently?"
+Patient: "I am preparing for the exam recently, but I get sleepy while studying"
+
+Doctor: "Understand, do you feel tired every day and have no energy?"
+
+Patient: "Not very tired"
+Patient: "If you don't study, you will be very energetic"
+Patient: "I feel sleepy after reading a book for a while, especially in the morning when I get up early"
+Doctor: "You know, do you feel that you are not interested in learning?"
+
+Patient: "Because I have to endorse, it's really a bit boring. It's not as fun as watching TV or something."
+Doctor: "Hmm, besides watching TV, are you still interested in other things that you were interested in before?"
+
+Patient: "interested"
+Doctor: "Okay, I just mentioned that you will easily feel sleepy when studying after getting up early. How have you been sleeping recently?"
+
+Patient: "Sleep is about the same as before"
+Doctor: "How long does it take from lying down in bed to falling asleep at night?"
+
+Patient: "About 15 minutes"
+Doctor: "It sounds like you fell asleep well. Will you wake up easily?"
+
+Patient: "Maybe I'll get up for a WC"
+Doctor: "I understand, do you usually wake up earlier than the alarm clock in the morning?"
+
+Patient: "I used to set an alarm clock for 8 o'clock. After a while, I would automatically wake up a few minutes earlier every time. Gradually, the alarm clock has been changed to 7:30."
+Patient: "I don't know if I have formed a biological clock"
+Doctor: "I understand, so I sleep fairly regularly every day"
+
+Doctor: "In addition to being easily sleepy while studying, are there any other problems?"
+
+Patient: "No other problems for the time being"
+Doctor: "Okay, I understand. How are you feeling recently?"
+
+Patient: "Okay"
+Doctor: "I understand. It sounds like you have been feeling sleepy while studying recently due to preparations for exams, which makes you feel a little troubled. Don't worry too much. You can combine work and rest through exercise or other entertainment activities in your daily study life, and pay attention to relaxation."
+
+Doctor: "Okay, then our consultation ends here"
+
+Patient: "Okay"
+Patient: "Thank you"

Sample Dataset/conv_1003.txt

@@ -0,0 +1,39 @@
+Doctor: What is your patient ID?
+Patient: 1003
+
+Doctor: What is your age?
+Patient: 38
+
+Doctor: What is your gender?
+Patient: Female
+Patient: "Hello, Dr. Wu"
+Doctor: "Hello!"
+Doctor: "What are your main problems recently?"
+Patient: "I haven't been in a good mood the past two days"
+Patient: "The child's grades have not improved"
+Doctor: "Okay, let's talk."
+Doctor: "How long have you been feeling this way?"
+Patient: "Just these two days, my child's grades came down yesterday. He didn't do well in the test."
+Doctor: "Children's affairs are indeed important, but parents' emotions also have a certain impact on their children. How have you been feeling in the past two weeks?"
+Patient: "It was pretty good the past few days. I bought a stock before and it was doing pretty well."
+Doctor: "May I ask, is stock trading an interest of yours?"
+Patient: "It's okay to say it's just interest. After all, I'm in the finance industry."
+Doctor: "Children's performance matters are staged. Don't rush for success. Emotions cannot change the current situation. I think you can take some events to accompany your child recently to see where the performance problems lie."
+Patient: "Yeah, good doctor. I think so too"
+Doctor: "For you, you may be too busy at work. Why don't you try something you are interested in to adjust your mood?"
+Patient: "I have always liked dancing, and I even signed up for a dance class some time ago"
+Patient: "After all, I am nearly 40 years old, so I have to keep in shape"
+Doctor: "This is a great hobby. Have you persisted with it recently?"
+Patient: "Yes, I will take two classes every weekend"
+Patient: "When I have nothing to do, I will also practice with this mirror"
+Doctor: "Okay, I hope dancing can bring you a good mood."
+Doctor: "Okay, how is your sleep quality recently?"
+Patient: "It's very good. Maybe because of dancing, the quality of sleep is quite high"
+Doctor: "Okay, do you have a good appetite for all three meals?"
+Patient: "I have a good appetite and my husband is a good cook"
+Doctor: "Okay, it seems that you are very happy in life!"
+Doctor: "So, don't worry too much about your children, how about you adjust your own state?"
+Patient: "Life is quite happy."
+Patient: "Yeah, okay. Thank you doctor"
+Doctor: "Okay, okay, if there are no other questions, our consultation will end here."
+Patient: "Yeah, thank you for your hard work, Dr. Wu."

Sample Dataset/conv_2.txt

@@ -0,0 +1,45 @@
+Doctor: What is your patient ID?
+Patient: 102
+
+Doctor: What is your age?
+Patient: 19
+
+Doctor: What is your gender?
+Patient: Female
+
+Doctor: Please describe your social life at the *anonymized* campus. Are you actively participating in extracurricular activities, interacting with others, or taking initiative to socialize with others? 
+Patient: I am part of football team and a core member in Physics club and Singularity working team. I also make contacts with my seniors and other staffs for both personal and official discussions. I volunteer for community fests and other initiatives.
+
+Doctor:  Describe your typical daily Mood? 
+Patient: I always try to find happiness in every single moment of my life. But at times I turnout t be moody.
+
+Doctor:  Does your Mood remain steady or goes up and down throughout the day without any reason or on trivial matters? 
+Patient: My mood is dynamic. It goes up and down for  both valid and unknown reasons . I get upset on simple jokes and responses from my close circle.
+
+Doctor: How do you handle day-to-day irritations or frustrations? 
+Patient: I try to connect more with the Almighty through daily prayers. But mostly I prefer sleeping with no disturbance for hours. Nowadays I try to engage myself with a busy schedule and locations.
+
+Doctor: How do you handle pressure related to academics? 
+Patient: lately I started purposeful ignorance of academic pressure. I will engage my times studying or with close friend. I also try to phone my parents when I feel so exhausted.
+
+Doctor: Describe your ability to attend to the task at hand or concentrate on daily tasks (academic, non-academic)? 
+Patient: I am mostly able to focus on my task and complete on time. But when I am in a bad mood I will distract myself from the task with social media and resume when I feel fine.
+
+Doctor: Have you noticed any difficulties with memory, such as unable to register new information, forgetting recent events, or not able to recall older personal/factual events? 
+Patient: Yes I do, and only very lately. I find it very difficult to comprehend what I see and try reading. I also noticed forgetting recent events which where not very important but still to be considered. I also have difficulty in recalling but the least.
+
+Doctor: What do you do to feel better? For example, some people take caffeine, talk with people, or watch movies to feel better. 
+Patient: Sleep mostly. But if it is with communication gap, I only settle after conveying my last note. I also sing a song or try dancing in my room but I prefer privacy for this
+
+Doctor: Describe how supported you feel by others (e.g., friends, family) around you and how they help you? 
+Patient: I feel supported very less even from family. And so I don't expect any support from anyone and try to figure out all alone.
+
+Doctor: What do you usually do when you have a bad day or when you are not able to concentrate on work? 
+Patient: I sleep for hours or the entire day. I also get some ease after crying or talking about it. I used talk to myself which helped me figure out the situation and motivated to push through.
+
+Doctor:  Are you experiencing symptoms of stress, anxiety, or depression? If yes, describe the symptoms?
+Patient: Yes, all stress, anxiety and depression
+
+Doctor:  Are you doing anything (by self or help seeking) for the ongoing stress, anxiety, or depression, if any? If yes, what? 
+Patient: Yes, I'm reading books on self-development and self-improvement.
+

Sample Dataset/conv_3.txt

@@ -0,0 +1,47 @@
+Doctor: What is your patient ID?
+Patient: 103
+
+Doctor: What is your age?
+Patient: 18
+
+Doctor: What is your gender?
+Patient: Male
+
+Doctor: Please describe your social life at the *anonymized* campus. Are you actively participating in extracurricular activities, interacting with others, or taking initiative to socialize with others? 
+Patient: yes i have been envolve in various talks organised by the different council.I am trying to explore different sports.especially lawn tennis and football. I have made some good friends and interacting seniors helps a lot .
+
+
+Doctor:  Describe your typical daily Mood? 
+Patient: Confused at times to how to move ahead what to follow .Otherwise pretty chill when i am with myy friends which helps a lot
+
+Doctor:  Does your Mood remain steady or goes up and down throughout the day without any reason or on trivial matters? 
+Patient: not really if i am indulge in doing some work and have a plan of doing something throuhout the it kind just go strainght and remains steady
+
+Doctor: How do you handle day-to-day irritations or frustrations? 
+Patient: Just talking to someone either your friends or family helps to deal all these situations pretty well. Finding solution to the problems which is causing you troubles and just talk to yourself helps me finding peace 
+
+
+Doctor: How do you handle pressure related to academics? 
+Patient: Regular studies and doing right things on daily basis helps in pressure handling in academics.All i can say is having a regular plan and consistency helps a lot
+
+Doctor: Describe your ability to attend to the task at hand or concentrate on daily tasks (academic, non-academic)? 
+Patient: Having pateince and belief in your work you are doing helps me to concentrate on daily tasks. Trying to explore diffenrent things and making it interesting also helps
+
+Doctor: Have you noticed any difficulties with memory, such as unable to register new information, forgetting recent events, or not able to recall older personal/factual events? 
+Patient: yes these things happens at some point of time in your day t day life. recalling recnts events is i say has become much common 
+
+Doctor: What do you do to feel better? For example, some people take caffeine, talk with people, or watch movies to feel better. 
+Patient: I like talking to people either my friends or my family which helps me feel better. Music my kind of way to escape from the hectic day and have some peace
+
+Doctor: Describe how supported you feel by others (e.g., friends, family) around you and how they help you? 
+Patient: My family is very supportive in my recent yars where things wasn't going the way which i could have wished for but my family on my back helped me out from those loomy days
+
+Doctor: What do you usually do when you have a bad day or when you are not able to concentrate on work? 
+Patient:  I just put my  headphones up and just go for a walk and trying to speak with myself r just chill with my friends which refereshes the mood
+
+Doctor:  Are you experiencing symptoms of stress, anxiety, or depression? If yes, describe the symptoms?
+Patient: nope
+
+Doctor:  Are you doing anything (by self or help seeking) for the ongoing stress, anxiety, or depression, if any? If yes, what? 
+Patient: nope
+

code_bart.py

@@ -0,0 +1,30 @@
+from transformers import BartForConditionalGeneration, BartTokenizer
+from transformers import pipeline
+
+# Replace *Path* with the model path
+model_path = "./fine_tune_model_bart_large_25"
+
+# Replace **Path** with the tokenizer path
+tokenizer_path = "./fine_tune_tokenizer_bart_large_25"
+
+# Load the fine-tuned model
+model = BartForConditionalGeneration.from_pretrained(model_path, ignore_mismatched_sizes=True)
+
+# Load the tokenizer associated with the fine-tuned model
+tokenizer = BartTokenizer.from_pretrained(tokenizer_path)
+
+# Ensure the model is in evaluation mode
+model.eval()
+
+
+# Create a custom summarization pipeline
+gen_kwargs = {"length_penalty": 1.0, "num_beams": 8, "max_length": 700}
+custom_summarization_pipeline = pipeline('summarization', model=model, tokenizer=tokenizer, **gen_kwargs)
+
+file_path = "./9.txt" # Replace with the conversation file path to check others
+with open(file_path, 'r') as file:
+    text = file.read()
+
+# Call the custom summarization pipeline
+summary = custom_summarization_pipeline(text)
+print('Summary:\n',summary[0]['summary_text'])

code_pegasus.py

@@ -0,0 +1,31 @@
+from transformers import PegasusForConditionalGeneration, PegasusTokenizer
+from transformers import pipeline
+
+# Replace *Path* with the model path
+model_path = "./fine_tune_model_pegasus_50"
+
+# Replace **Path** with the tokenizer path
+tokenizer_path = "./fine_tune_tokenizer_pegasus_50"
+
+# Load the fine-tuned model
+model = PegasusForConditionalGeneration.from_pretrained(model_path, ignore_mismatched_sizes=True)
+
+# Load the tokenizer associated with the fine-tuned model
+tokenizer = PegasusTokenizer.from_pretrained(tokenizer_path)
+
+# Ensure the model is in evaluation mode
+model.eval()
+
+# Create a custom summarization pipeline
+gen_kwargs = {"length_penalty": 1.0, "num_beams": 8, "max_length": 700}
+custom_summarization_pipeline = pipeline('summarization', model=model, tokenizer=tokenizer, **gen_kwargs)
+
+
+file_path = "./9.txt" # Replace with the conversation file path to check others
+with open(file_path, 'r') as file:
+    text = file.read()
+
+# Call the custom summarization pipeline
+summary = custom_summarization_pipeline(text)
+
+print('Summary:\n',summary[0]['summary_text'])

fine_tune_model_bart_large_25/config.json

@@ -0,0 +1,70 @@
+{
+  "_name_or_path": "facebook/bart-large-cnn",
+  "_num_labels": 3,
+  "activation_dropout": 0.0,
+  "activation_function": "gelu",
+  "add_final_layer_norm": false,
+  "architectures": [
+    "BartForConditionalGeneration"
+  ],
+  "attention_dropout": 0.0,
+  "bos_token_id": 0,
+  "classif_dropout": 0.0,
+  "classifier_dropout": 0.0,
+  "d_model": 1024,
+  "decoder_attention_heads": 16,
+  "decoder_ffn_dim": 4096,
+  "decoder_layerdrop": 0.0,
+  "decoder_layers": 12,
+  "decoder_start_token_id": 2,
+  "dropout": 0.1,
+  "early_stopping": true,
+  "encoder_attention_heads": 16,
+  "encoder_ffn_dim": 4096,
+  "encoder_layerdrop": 0.0,
+  "encoder_layers": 12,
+  "eos_token_id": 2,
+  "force_bos_token_to_be_generated": true,
+  "forced_bos_token_id": 0,
+  "forced_eos_token_id": 2,
+  "gradient_checkpointing": false,
+  "id2label": {
+    "0": "LABEL_0",
+    "1": "LABEL_1",
+    "2": "LABEL_2"
+  },
+  "init_std": 0.02,
+  "is_encoder_decoder": true,
+  "label2id": {
+    "LABEL_0": 0,
+    "LABEL_1": 1,
+    "LABEL_2": 2
+  },
+  "length_penalty": 2.0,
+  "max_length": 142,
+  "max_position_embeddings": 1024,
+  "min_length": 56,
+  "model_type": "bart",
+  "no_repeat_ngram_size": 3,
+  "normalize_before": false,
+  "num_beams": 4,
+  "num_hidden_layers": 12,
+  "output_past": true,
+  "pad_token_id": 1,
+  "prefix": " ",
+  "scale_embedding": false,
+  "task_specific_params": {
+    "summarization": {
+      "early_stopping": true,
+      "length_penalty": 2.0,
+      "max_length": 142,
+      "min_length": 56,
+      "no_repeat_ngram_size": 3,
+      "num_beams": 4
+    }
+  },
+  "torch_dtype": "float32",
+  "transformers_version": "4.37.2",
+  "use_cache": true,
+  "vocab_size": 50264
+}

fine_tune_model_bart_large_25/generation_config.json

@@ -0,0 +1,16 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 0,
+  "decoder_start_token_id": 2,
+  "early_stopping": true,
+  "eos_token_id": 2,
+  "forced_bos_token_id": 0,
+  "forced_eos_token_id": 2,
+  "length_penalty": 2.0,
+  "max_length": 142,
+  "min_length": 56,
+  "no_repeat_ngram_size": 3,
+  "num_beams": 4,
+  "pad_token_id": 1,
+  "transformers_version": "4.37.2"
+}

fine_tune_model_bart_large_25/model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bb484458437e4416722396975f77f3829b2c4830e9ece28dbb45b92f4d57893c
+size 1625422896

fine_tune_model_pegasus_50/config.json

@@ -0,0 +1,124 @@
+{
+  "_name_or_path": "google/pegasus-large",
+  "activation_dropout": 0.1,
+  "activation_function": "relu",
+  "add_bias_logits": false,
+  "add_final_layer_norm": true,
+  "architectures": [
+    "PegasusForConditionalGeneration"
+  ],
+  "attention_dropout": 0.1,
+  "bos_token_id": 0,
+  "classif_dropout": 0.0,
+  "classifier_dropout": 0.0,
+  "d_model": 1024,
+  "decoder_attention_heads": 16,
+  "decoder_ffn_dim": 4096,
+  "decoder_layerdrop": 0.0,
+  "decoder_layers": 16,
+  "decoder_start_token_id": 0,
+  "dropout": 0.1,
+  "encoder_attention_heads": 16,
+  "encoder_ffn_dim": 4096,
+  "encoder_layerdrop": 0.0,
+  "encoder_layers": 16,
+  "eos_token_id": 1,
+  "extra_pos_embeddings": 1,
+  "force_bos_token_to_be_generated": false,
+  "forced_eos_token_id": 1,
+  "gradient_checkpointing": false,
+  "id2label": {
+    "0": "LABEL_0",
+    "1": "LABEL_1",
+    "2": "LABEL_2"
+  },
+  "init_std": 0.02,
+  "is_encoder_decoder": true,
+  "label2id": {
+    "LABEL_0": 0,
+    "LABEL_1": 1,
+    "LABEL_2": 2
+  },
+  "length_penalty": 0.8,
+  "max_length": 256,
+  "max_position_embeddings": 1024,
+  "model_type": "pegasus",
+  "normalize_before": true,
+  "normalize_embedding": false,
+  "num_beams": 8,
+  "num_hidden_layers": 16,
+  "pad_token_id": 0,
+  "scale_embedding": true,
+  "static_position_embeddings": true,
+  "task_specific_params": {
+    "summarization_aeslc": {
+      "length_penalty": 0.6,
+      "max_length": 32,
+      "max_position_embeddings": 512
+    },
+    "summarization_arxiv": {
+      "length_penalty": 0.8,
+      "max_length": 256,
+      "max_position_embeddings": 1024
+    },
+    "summarization_big_patent": {
+      "length_penalty": 0.7,
+      "max_length": 256,
+      "max_position_embeddings": 1024
+    },
+    "summarization_billsum": {
+      "length_penalty": 0.6,
+      "max_length": 256,
+      "max_position_embeddings": 1024
+    },
+    "summarization_cnn_dailymail": {
+      "length_penalty": 0.8,
+      "max_length": 128,
+      "max_position_embeddings": 1024
+    },
+    "summarization_gigaword": {
+      "length_penalty": 0.6,
+      "max_length": 32,
+      "max_position_embeddings": 128
+    },
+    "summarization_large": {
+      "length_penalty": 0.8,
+      "max_length": 256,
+      "max_position_embeddings": 1024
+    },
+    "summarization_multi_news": {
+      "length_penalty": 0.8,
+      "max_length": 256,
+      "max_position_embeddings": 1024
+    },
+    "summarization_newsroom": {
+      "length_penalty": 0.8,
+      "max_length": 128,
+      "max_position_embeddings": 512
+    },
+    "summarization_pubmed": {
+      "length_penalty": 0.8,
+      "max_length": 256,
+      "max_position_embeddings": 1024
+    },
+    "summarization_reddit_tifu": {
+      "length_penalty": 0.6,
+      "max_length": 128,
+      "max_position_embeddings": 512
+    },
+    "summarization_wikihow": {
+      "length_penalty": 0.6,
+      "max_length": 256,
+      "max_position_embeddings": 512
+    },
+    "summarization_xsum": {
+      "length_penalty": 0.8,
+      "max_length": 64,
+      "max_position_embeddings": 512
+    }
+  },
+  "torch_dtype": "float32",
+  "transformers_version": "4.37.2",
+  "use_cache": true,
+  "vocab_size": 96103
+}

fine_tune_model_pegasus_50/generation_config.json

@@ -0,0 +1,12 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 0,
+  "decoder_start_token_id": 0,
+  "eos_token_id": 1,
+  "forced_eos_token_id": 1,
+  "length_penalty": 0.8,
+  "max_length": 256,
+  "num_beams": 8,
+  "pad_token_id": 0,
+  "transformers_version": "4.37.2"
+}

fine_tune_model_pegasus_50/model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b6e47f9f260ed65c81b6c49fccc4fe01c129c1c08920ae92896d303e80d13e41
+size 2283652852

fine_tune_tokenizer_bart_large_25/special_tokens_map.json

@@ -0,0 +1,15 @@
+{
+  "bos_token": "<s>",
+  "cls_token": "<s>",
+  "eos_token": "</s>",
+  "mask_token": {
+    "content": "<mask>",
+    "lstrip": true,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": "<pad>",
+  "sep_token": "</s>",
+  "unk_token": "<unk>"
+}

fine_tune_tokenizer_bart_large_25/tokenizer_config.json

@@ -0,0 +1,57 @@
+{
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<pad>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "3": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50264": {
+      "content": "<mask>",
+      "lstrip": true,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<s>",
+  "clean_up_tokenization_spaces": true,
+  "cls_token": "<s>",
+  "eos_token": "</s>",
+  "errors": "replace",
+  "mask_token": "<mask>",
+  "model_max_length": 1024,
+  "pad_token": "<pad>",
+  "sep_token": "</s>",
+  "tokenizer_class": "BartTokenizer",
+  "trim_offsets": true,
+  "unk_token": "<unk>"
+}

fine_tune_tokenizer_pegasus_50/special_tokens_map.json

@@ -0,0 +1,110 @@
+{
+  "additional_special_tokens": [
+    "<mask_1>",
+    "<unk_2>",
+    "<unk_3>",
+    "<unk_4>",
+    "<unk_5>",
+    "<unk_6>",
+    "<unk_7>",
+    "<unk_8>",
+    "<unk_9>",
+    "<unk_10>",
+    "<unk_11>",
+    "<unk_12>",
+    "<unk_13>",
+    "<unk_14>",
+    "<unk_15>",
+    "<unk_16>",
+    "<unk_17>",
+    "<unk_18>",
+    "<unk_19>",
+    "<unk_20>",
+    "<unk_21>",
+    "<unk_22>",
+    "<unk_23>",
+    "<unk_24>",
+    "<unk_25>",
+    "<unk_26>",
+    "<unk_27>",
+    "<unk_28>",
+    "<unk_29>",
+    "<unk_30>",
+    "<unk_31>",
+    "<unk_32>",
+    "<unk_33>",
+    "<unk_34>",
+    "<unk_35>",
+    "<unk_36>",
+    "<unk_37>",
+    "<unk_38>",
+    "<unk_39>",
+    "<unk_40>",
+    "<unk_41>",
+    "<unk_42>",
+    "<unk_43>",
+    "<unk_44>",
+    "<unk_45>",
+    "<unk_46>",
+    "<unk_47>",
+    "<unk_48>",
+    "<unk_49>",
+    "<unk_50>",
+    "<unk_51>",
+    "<unk_52>",
+    "<unk_53>",
+    "<unk_54>",
+    "<unk_55>",
+    "<unk_56>",
+    "<unk_57>",
+    "<unk_58>",
+    "<unk_59>",
+    "<unk_60>",
+    "<unk_61>",
+    "<unk_62>",
+    "<unk_63>",
+    "<unk_64>",
+    "<unk_65>",
+    "<unk_66>",
+    "<unk_67>",
+    "<unk_68>",
+    "<unk_69>",
+    "<unk_70>",
+    "<unk_71>",
+    "<unk_72>",
+    "<unk_73>",
+    "<unk_74>",
+    "<unk_75>",
+    "<unk_76>",
+    "<unk_77>",
+    "<unk_78>",
+    "<unk_79>",
+    "<unk_80>",
+    "<unk_81>",
+    "<unk_82>",
+    "<unk_83>",
+    "<unk_84>",
+    "<unk_85>",
+    "<unk_86>",
+    "<unk_87>",
+    "<unk_88>",
+    "<unk_89>",
+    "<unk_90>",
+    "<unk_91>",
+    "<unk_92>",
+    "<unk_93>",
+    "<unk_94>",
+    "<unk_95>",
+    "<unk_96>",
+    "<unk_97>",
+    "<unk_98>",
+    "<unk_99>",
+    "<unk_100>",
+    "<unk_101>",
+    "<unk_102>"
+  ],
+  "eos_token": "</s>",
+  "mask_token": "<mask_2>",
+  "pad_token": "<pad>",
+  "unk_token": "<unk>"
+}

fine_tune_tokenizer_pegasus_50/spiece.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0015189ef36359283fec8b93cf6d9ce51bca37eb1101defc68a53b394913b96c
+size 1912529

fine_tune_tokenizer_pegasus_50/tokenizer_config.json

@@ -0,0 +1,967 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<pad>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "<mask_1>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "3": {
+      "content": "<mask_2>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "4": {
+      "content": "<unk_2>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "5": {
+      "content": "<unk_3>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "6": {
+      "content": "<unk_4>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "7": {
+      "content": "<unk_5>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "8": {
+      "content": "<unk_6>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "9": {
+      "content": "<unk_7>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "10": {
+      "content": "<unk_8>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "11": {
+      "content": "<unk_9>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "12": {
+      "content": "<unk_10>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "13": {
+      "content": "<unk_11>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "14": {
+      "content": "<unk_12>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "15": {
+      "content": "<unk_13>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "16": {
+      "content": "<unk_14>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "17": {
+      "content": "<unk_15>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "18": {
+      "content": "<unk_16>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "19": {
+      "content": "<unk_17>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "20": {
+      "content": "<unk_18>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "21": {
+      "content": "<unk_19>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "22": {
+      "content": "<unk_20>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "23": {
+      "content": "<unk_21>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "24": {
+      "content": "<unk_22>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "25": {
+      "content": "<unk_23>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "26": {
+      "content": "<unk_24>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "27": {
+      "content": "<unk_25>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "28": {
+      "content": "<unk_26>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "29": {
+      "content": "<unk_27>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "30": {
+      "content": "<unk_28>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "31": {
+      "content": "<unk_29>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32": {
+      "content": "<unk_30>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "33": {
+      "content": "<unk_31>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "34": {
+      "content": "<unk_32>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "35": {
+      "content": "<unk_33>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "36": {
+      "content": "<unk_34>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "37": {
+      "content": "<unk_35>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "38": {
+      "content": "<unk_36>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "39": {
+      "content": "<unk_37>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "40": {
+      "content": "<unk_38>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "41": {
+      "content": "<unk_39>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "42": {
+      "content": "<unk_40>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "43": {
+      "content": "<unk_41>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "44": {
+      "content": "<unk_42>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "45": {
+      "content": "<unk_43>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "46": {
+      "content": "<unk_44>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "47": {
+      "content": "<unk_45>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "48": {
+      "content": "<unk_46>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "49": {
+      "content": "<unk_47>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50": {
+      "content": "<unk_48>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "51": {
+      "content": "<unk_49>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "52": {
+      "content": "<unk_50>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "53": {
+      "content": "<unk_51>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "54": {
+      "content": "<unk_52>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "55": {
+      "content": "<unk_53>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "56": {
+      "content": "<unk_54>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "57": {
+      "content": "<unk_55>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "58": {
+      "content": "<unk_56>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "59": {
+      "content": "<unk_57>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "60": {
+      "content": "<unk_58>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "61": {
+      "content": "<unk_59>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "62": {
+      "content": "<unk_60>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "63": {
+      "content": "<unk_61>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "64": {
+      "content": "<unk_62>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "65": {
+      "content": "<unk_63>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "66": {
+      "content": "<unk_64>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "67": {
+      "content": "<unk_65>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "68": {
+      "content": "<unk_66>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "69": {
+      "content": "<unk_67>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "70": {
+      "content": "<unk_68>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "71": {
+      "content": "<unk_69>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "72": {
+      "content": "<unk_70>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "73": {
+      "content": "<unk_71>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "74": {
+      "content": "<unk_72>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "75": {
+      "content": "<unk_73>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "76": {
+      "content": "<unk_74>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "77": {
+      "content": "<unk_75>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "78": {
+      "content": "<unk_76>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "79": {
+      "content": "<unk_77>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "80": {
+      "content": "<unk_78>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "81": {
+      "content": "<unk_79>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "82": {
+      "content": "<unk_80>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "83": {
+      "content": "<unk_81>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "84": {
+      "content": "<unk_82>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "85": {
+      "content": "<unk_83>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "86": {
+      "content": "<unk_84>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "87": {
+      "content": "<unk_85>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "88": {
+      "content": "<unk_86>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "89": {
+      "content": "<unk_87>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "90": {
+      "content": "<unk_88>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "91": {
+      "content": "<unk_89>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "92": {
+      "content": "<unk_90>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "93": {
+      "content": "<unk_91>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "94": {
+      "content": "<unk_92>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "95": {
+      "content": "<unk_93>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "96": {
+      "content": "<unk_94>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "97": {
+      "content": "<unk_95>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "98": {
+      "content": "<unk_96>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "99": {
+      "content": "<unk_97>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100": {
+      "content": "<unk_98>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "101": {
+      "content": "<unk_99>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "102": {
+      "content": "<unk_100>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "103": {
+      "content": "<unk_101>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "104": {
+      "content": "<unk_102>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "105": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "additional_special_tokens": [
+    "<mask_1>",
+    "<unk_2>",
+    "<unk_3>",
+    "<unk_4>",
+    "<unk_5>",
+    "<unk_6>",
+    "<unk_7>",
+    "<unk_8>",
+    "<unk_9>",
+    "<unk_10>",
+    "<unk_11>",
+    "<unk_12>",
+    "<unk_13>",
+    "<unk_14>",
+    "<unk_15>",
+    "<unk_16>",
+    "<unk_17>",
+    "<unk_18>",
+    "<unk_19>",
+    "<unk_20>",
+    "<unk_21>",
+    "<unk_22>",
+    "<unk_23>",
+    "<unk_24>",
+    "<unk_25>",
+    "<unk_26>",
+    "<unk_27>",
+    "<unk_28>",
+    "<unk_29>",
+    "<unk_30>",
+    "<unk_31>",
+    "<unk_32>",
+    "<unk_33>",
+    "<unk_34>",
+    "<unk_35>",
+    "<unk_36>",
+    "<unk_37>",
+    "<unk_38>",
+    "<unk_39>",
+    "<unk_40>",
+    "<unk_41>",
+    "<unk_42>",
+    "<unk_43>",
+    "<unk_44>",
+    "<unk_45>",
+    "<unk_46>",
+    "<unk_47>",
+    "<unk_48>",
+    "<unk_49>",
+    "<unk_50>",
+    "<unk_51>",
+    "<unk_52>",
+    "<unk_53>",
+    "<unk_54>",
+    "<unk_55>",
+    "<unk_56>",
+    "<unk_57>",
+    "<unk_58>",
+    "<unk_59>",
+    "<unk_60>",
+    "<unk_61>",
+    "<unk_62>",
+    "<unk_63>",
+    "<unk_64>",
+    "<unk_65>",
+    "<unk_66>",
+    "<unk_67>",
+    "<unk_68>",
+    "<unk_69>",
+    "<unk_70>",
+    "<unk_71>",
+    "<unk_72>",
+    "<unk_73>",
+    "<unk_74>",
+    "<unk_75>",
+    "<unk_76>",
+    "<unk_77>",
+    "<unk_78>",
+    "<unk_79>",
+    "<unk_80>",
+    "<unk_81>",
+    "<unk_82>",
+    "<unk_83>",
+    "<unk_84>",
+    "<unk_85>",
+    "<unk_86>",
+    "<unk_87>",
+    "<unk_88>",
+    "<unk_89>",
+    "<unk_90>",
+    "<unk_91>",
+    "<unk_92>",
+    "<unk_93>",
+    "<unk_94>",
+    "<unk_95>",
+    "<unk_96>",
+    "<unk_97>",
+    "<unk_98>",
+    "<unk_99>",
+    "<unk_100>",
+    "<unk_101>",
+    "<unk_102>"
+  ],
+  "clean_up_tokenization_spaces": true,
+  "eos_token": "</s>",
+  "full_tokenizer_file": null,
+  "mask_token": "<mask_2>",
+  "mask_token_sent": "<mask_1>",
+  "model_max_length": 1024,
+  "offset": 103,
+  "pad_token": "<pad>",
+  "sp_model_kwargs": {},
+  "tokenizer_class": "PegasusTokenizer",
+  "unk_token": "<unk>"
+}

requirements.txt

@@ -0,0 +1,2 @@
+torch=2.0.1
+transformers=4.40.1