Instructions to use ShakhawatShanin/Bangla-Text-Summarization with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use ShakhawatShanin/Bangla-Text-Summarization with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="ShakhawatShanin/Bangla-Text-Summarization", filename="Bangla_Text_Summarization/bangla_summarization.Q8_0.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use ShakhawatShanin/Bangla-Text-Summarization with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf ShakhawatShanin/Bangla-Text-Summarization:Q8_0 # Run inference directly in the terminal: llama-cli -hf ShakhawatShanin/Bangla-Text-Summarization:Q8_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf ShakhawatShanin/Bangla-Text-Summarization:Q8_0 # Run inference directly in the terminal: llama-cli -hf ShakhawatShanin/Bangla-Text-Summarization:Q8_0
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf ShakhawatShanin/Bangla-Text-Summarization:Q8_0 # Run inference directly in the terminal: ./llama-cli -hf ShakhawatShanin/Bangla-Text-Summarization:Q8_0
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf ShakhawatShanin/Bangla-Text-Summarization:Q8_0 # Run inference directly in the terminal: ./build/bin/llama-cli -hf ShakhawatShanin/Bangla-Text-Summarization:Q8_0
Use Docker
docker model run hf.co/ShakhawatShanin/Bangla-Text-Summarization:Q8_0
- LM Studio
- Jan
- Ollama
How to use ShakhawatShanin/Bangla-Text-Summarization with Ollama:
ollama run hf.co/ShakhawatShanin/Bangla-Text-Summarization:Q8_0
- Unsloth Studio new
How to use ShakhawatShanin/Bangla-Text-Summarization with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for ShakhawatShanin/Bangla-Text-Summarization to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for ShakhawatShanin/Bangla-Text-Summarization to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for ShakhawatShanin/Bangla-Text-Summarization to start chatting
- Docker Model Runner
How to use ShakhawatShanin/Bangla-Text-Summarization with Docker Model Runner:
docker model run hf.co/ShakhawatShanin/Bangla-Text-Summarization:Q8_0
- Lemonade
How to use ShakhawatShanin/Bangla-Text-Summarization with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull ShakhawatShanin/Bangla-Text-Summarization:Q8_0
Run and chat with the model
lemonade run user.Bangla-Text-Summarization-Q8_0
List all available models
lemonade list
| <html lang="en"> | |
| <head> | |
| <meta charset="UTF-8"> | |
| <meta name="viewport" content="width=device-width, initial-scale=1.0"> | |
| <title>Bangla AI Text Summarizer</title> | |
| <!-- Bootstrap CSS --> | |
| <link href="https://cdnjs.cloudflare.com/ajax/libs/bootstrap/5.3.2/css/bootstrap.min.css" rel="stylesheet"> | |
| <!-- Font Awesome --> | |
| <link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/font-awesome/6.4.0/css/all.min.css"> | |
| <!-- Google Fonts: Poppins --> | |
| <link href="https://fonts.googleapis.com/css2?family=Poppins:wght@400;500;600&display=swap" rel="stylesheet"> | |
| <!-- Tailwind CSS --> | |
| <script src="https://cdn.tailwindcss.com"></script> | |
| <script> | |
| tailwind.config = { | |
| theme: { | |
| extend: { | |
| colors: { | |
| 'dark-bg': '#1f2c34', | |
| 'dark-bg-alt': '#1b1b2f', | |
| 'chat-bg': '#222831', | |
| 'header-bg': '#30475e', | |
| 'footer-bg': '#393e46', | |
| 'accent': '#00adb5', | |
| 'accent-hover': '#00b8c4', | |
| 'dark-light': '#393e46', | |
| 'text-light': '#eeeeee', | |
| }, | |
| }, | |
| }, | |
| }; | |
| </script> | |
| </head> | |
| <body class="font-poppins bg-gradient-to-br from-dark-bg to-dark-bg-alt min-h-screen"> | |
| <div class="chat-container flex justify-center items-center min-h-screen p-5"> | |
| <div class="chat-box w-[550px] max-w-[95%] h-[750px] bg-chat-bg rounded-3xl flex flex-col overflow-hidden shadow-2xl"> | |
| <div class="chat-header flex items-center p-4 bg-header-bg text-white rounded-t-3xl"> | |
| <img src="{{ url_for('static', filename='icon.png') }}" class="chat-avatar w-[55px] h-[55px] mr-3"> | |
| <div> | |
| <h5 class="mb-0 text-lg font-semibold">Bangla LLM Text Summarizer</h5> | |
| <small class="text-white/80 text-sm">Powered by Shanin</small> | |
| </div> | |
| </div> | |
| <div id="chatBody" class="chat-body flex-1 overflow-y-auto p-4"> | |
| <!-- Messages will appear here --> | |
| </div> | |
| <div class="chat-footer p-4 bg-footer-bg rounded-b-3xl"> | |
| <form id="messageForm" class="flex"> | |
| <input type="text" id="text" name="msg" class="form-control flex-1 rounded-full px-4 py-3 bg-chat-bg border border-accent text-text-light placeholder:text-text-light/50 focus:outline-none focus:ring-0 me-2" placeholder="Type a message..." required> | |
| <button type="submit" class="btn btn-accent rounded-full bg-accent text-white px-5 py-3 hover:bg-accent-hover"><i class="fas fa-paper-plane"></i></button> | |
| </form> | |
| </div> | |
| </div> | |
| </div> | |
| <!-- jQuery --> | |
| <script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/3.7.1/jquery.min.js"></script> | |
| <!-- Bootstrap JS --> | |
| <script src="https://cdnjs.cloudflare.com/ajax/libs/bootstrap/5.3.2/js/bootstrap.bundle.min.js"></script> | |
| <script> | |
| $(document).ready(function() { | |
| $("#messageForm").on("submit", function(event) { | |
| event.preventDefault(); | |
| const date = new Date(); | |
| const str_time = date.getHours().toString().padStart(2,'0') + ":" + date.getMinutes().toString().padStart(2,'0'); | |
| const rawText = $("#text").val(); | |
| $("#text").val(""); | |
| // User message | |
| const userHtml = ` | |
| <div class="message user-message mb-3 flex justify-end"> | |
| <div class="msg-text bg-accent text-white p-3 rounded-3xl max-w-[80%] break-words shadow-md relative"> | |
| ${rawText} <span class="time text-[10px] absolute -bottom-4 right-2 text-white/50">${str_time}</span> | |
| </div> | |
| </div>`; | |
| $("#chatBody").append(userHtml).scrollTop($("#chatBody")[0].scrollHeight); | |
| // Call Flask API | |
| $.post("/get", { msg: rawText }, function(data) { | |
| const botHtml = ` | |
| <div class="message bot-message mb-3 flex justify-start"> | |
| <div class="msg-text bg-dark-light text-text-light p-3 rounded-3xl max-w-[80%] break-words shadow-md relative"> | |
| ${data} <span class="time text-[10px] absolute -bottom-4 right-2 text-white/50">${str_time}</span> | |
| </div> | |
| </div>`; | |
| $("#chatBody").append(botHtml).scrollTop($("#chatBody")[0].scrollHeight); | |
| }); | |
| }); | |
| }); | |
| </script> | |
| </body> | |
| </html> |