copilot-swe-agent[bot] akashkolte commited on
Commit
9bd888d
Β·
1 Parent(s): af1ab1c

Add LICENSE and improve README for multimodal AAC chatbot

Browse files

Co-authored-by: akashkolte <23047489+akashkolte@users.noreply.github.com>

Files changed (2) hide show
  1. LICENSE +3 -0
  2. README.md +103 -2
LICENSE ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ Copyright (c) 2026 akashkolte
2
+
3
+ All rights reserved. No permission is granted to use, copy, modify, or distribute this software.
README.md CHANGED
@@ -1,2 +1,103 @@
1
- # multimodal_aac_chatbot
2
- A multimodal chatbot for AAC users
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Multimodal AAC Chatbot
2
+
3
+ A multimodal chatbot designed to empower **Augmentative and Alternative Communication (AAC)** users β€” enabling more natural, accessible, and expressive conversations through the power of AI.
4
+
5
+ ---
6
+
7
+ ## What is AAC?
8
+
9
+ **Augmentative and Alternative Communication (AAC)** refers to tools, strategies, and technologies that help people who have difficulty with spoken or written communication. AAC users may include individuals with:
10
+
11
+ - Autism Spectrum Disorder (ASD)
12
+ - Cerebral Palsy
13
+ - ALS / Motor Neurone Disease
14
+ - Aphasia
15
+ - Down Syndrome
16
+ - Or any other condition that impacts verbal communication
17
+
18
+ AAC tools range from low-tech picture boards to high-tech speech-generating devices. This project brings the power of modern AI chatbots to the AAC community.
19
+
20
+ ---
21
+
22
+ ## About This Project
23
+
24
+ The **Multimodal AAC Chatbot** is an AI-powered conversational assistant built with AAC users in mind. It accepts multiple input modalities β€” such as text, images, and symbols β€” and generates clear, accessible responses to support communication.
25
+
26
+ ### Key Features
27
+
28
+ - πŸ—£οΈ **Multimodal Input** β€” Communicate using text, images, symbols, or a combination of all three
29
+ - πŸ€– **AI-Powered Responses** β€” Leverages large language models (LLMs) to generate natural and context-aware replies
30
+ - β™Ώ **Accessibility First** β€” Designed from the ground up for users with communication challenges
31
+ - 🧩 **AAC-Friendly Interface** β€” Supports common AAC workflows and symbol-based communication
32
+ - πŸ’¬ **Conversational Context** β€” Maintains conversation history for more coherent, multi-turn dialogues
33
+
34
+ ---
35
+
36
+ ## Getting Started
37
+
38
+ ### Prerequisites
39
+
40
+ - Python 3.8 or higher
41
+ - pip
42
+
43
+ ### Installation
44
+
45
+ 1. **Clone the repository**
46
+ ```bash
47
+ git clone https://github.com/akashkolte/multimodal_aac_chatbot.git
48
+ cd multimodal_aac_chatbot
49
+ ```
50
+
51
+ 2. **Install dependencies**
52
+ ```bash
53
+ pip install -r requirements.txt
54
+ ```
55
+
56
+ 3. **Run the chatbot**
57
+ ```bash
58
+ python app.py
59
+ ```
60
+
61
+ ---
62
+
63
+ ## Usage
64
+
65
+ Once running, users can interact with the chatbot by:
66
+
67
+ - Typing a text message
68
+ - Uploading an image or symbol to describe their intent
69
+ - Combining symbols and short text phrases as AAC users typically do
70
+
71
+ The chatbot will interpret the input and respond in a clear, friendly manner.
72
+
73
+ ---
74
+
75
+ ## Project Structure
76
+
77
+ ```
78
+ multimodal_aac_chatbot/
79
+ β”œβ”€β”€ app.py # Main application entry point
80
+ β”œβ”€β”€ requirements.txt # Python dependencies
81
+ β”œβ”€β”€ README.md # Project documentation
82
+ └── LICENSE # License information
83
+ ```
84
+
85
+ ---
86
+
87
+ ## Contributing
88
+
89
+ This project is currently under active development. Feedback and suggestions from the AAC community and researchers are very welcome β€” please open an issue to share your thoughts.
90
+
91
+ > **Note:** This software is proprietary. All rights are reserved. Any use, copying, modification, or distribution requires explicit written permission from the author.
92
+
93
+ ---
94
+
95
+ ## License
96
+
97
+ All rights reserved. No permission is granted to use, copy, modify, or distribute this software. See the [LICENSE](LICENSE) file for details.
98
+
99
+ ---
100
+
101
+ ## Acknowledgements
102
+
103
+ This project is dedicated to the AAC community and the researchers, caregivers, and developers working to make communication more accessible for everyone.