azlaan428 commited on
Commit
2f495b0
·
1 Parent(s): 7dd2c52

docs: update STATUS.md — migrated to Qwen2.5-72B on AMD MI300X

Browse files
Files changed (1) hide show
  1. STATUS.md +15 -13
STATUS.md CHANGED
@@ -1,11 +1,11 @@
1
  # ARIA Project Status
2
- _Last updated: May 3, 2026_
3
 
4
  ## What Was Built
5
 
6
  Multi-agent pipeline in agent/agent.py with 5 stages:
7
 
8
- 1. Query Architect: generates 5 MeSH-optimised PubMed queries via Groq
9
  2. Literature Scout: fetches all queries sequentially with rate limiting
10
  3. PRISMA Filter: automatic inclusion/exclusion screening with one-line reasons, user can override any decision
11
  4. Evidence Synthesiser: structured synthesis with Background, Key Findings, Level of Evidence, Conflicting Evidence, Research Gaps, Clinical Implications
@@ -24,12 +24,14 @@ Additional features completed:
24
  * Follow-up Q&A: ask follow-up questions after synthesis, answered using already-fetched papers
25
  * Query refinement suggestions: 3 AI-generated follow-up research questions based on synthesis gaps
26
  * Session history: queries saved to sessions.json, reloadable from sidebar
27
- * Rate limit retry logic: automatic backoff on Groq 429 errors
28
  * SSL patch for PubMed Entrez on corporate/university networks
29
  * Signature: Azlaan Mohammad 2026 in footer
30
 
31
- ## UI Updates (May 3 2026)
32
 
 
 
33
  * PRISMA screening panel with cyan/red inclusion dots and override buttons
34
  * Follow-up Q&A input block appears after synthesis
35
  * Suggested follow-up queries panel with clickable buttons
@@ -44,13 +46,13 @@ Additional features completed:
44
 
45
  ## Tech Stack
46
 
47
- * LLM: Groq LLaMA-3.1-8B-Instant (migration to Llama 3.3 70B on AMD MI300X planned)
48
  * Agent Framework: LangGraph + LangChain
49
  * Literature Retrieval: BioPython Entrez / PubMed NCBI
50
  * Web Framework: Flask with SSE streaming
51
  * PDF: ReportLab
52
  * Frontend: HTML, CSS, vanilla JS
53
- * Runtime: Windows 11, Python 3.11, RTX 3060 12GB
54
 
55
  ## API Endpoints
56
 
@@ -69,18 +71,18 @@ Additional features completed:
69
 
70
  ## Environment
71
 
72
- * GROQ_API_KEY set via $env:GROQ_API_KEY in PowerShell
 
73
  * Python venv at ./venv
74
  * Start server: venv\Scripts\activate && python app.py
75
- * AMD MI300X credits available on lablab.ai (instance not yet spun up)
76
 
77
  ## What Remains Before May 11
78
 
79
- 1. Spin up AMD MI300X instance and migrate inference to vLLM + Llama 3.3 70B
80
- 2. Concept document for lablab.ai submission (window opens May 11)
81
- 3. Demo video (under 3 minutes)
82
- 4. LinkedIn post with #AMDDevHackathon
83
- 5. Submit on lablab.ai
84
 
85
  ## GitHub
86
 
 
1
  # ARIA Project Status
2
+ _Last updated: May 4, 2026_
3
 
4
  ## What Was Built
5
 
6
  Multi-agent pipeline in agent/agent.py with 5 stages:
7
 
8
+ 1. Query Architect: generates 5 MeSH-optimised PubMed queries via Qwen2.5-72B on AMD MI300X
9
  2. Literature Scout: fetches all queries sequentially with rate limiting
10
  3. PRISMA Filter: automatic inclusion/exclusion screening with one-line reasons, user can override any decision
11
  4. Evidence Synthesiser: structured synthesis with Background, Key Findings, Level of Evidence, Conflicting Evidence, Research Gaps, Clinical Implications
 
24
  * Follow-up Q&A: ask follow-up questions after synthesis, answered using already-fetched papers
25
  * Query refinement suggestions: 3 AI-generated follow-up research questions based on synthesis gaps
26
  * Session history: queries saved to sessions.json, reloadable from sidebar
27
+ * Rate limit retry logic: automatic backoff on API errors
28
  * SSL patch for PubMed Entrez on corporate/university networks
29
  * Signature: Azlaan Mohammad 2026 in footer
30
 
31
+ ## UI Updates (May 4 2026)
32
 
33
+ * Model badge updated to Qwen2.5-72B on AMD MI300X
34
+ * Subtitle and footer updated to reflect AMD MI300X inference
35
  * PRISMA screening panel with cyan/red inclusion dots and override buttons
36
  * Follow-up Q&A input block appears after synthesis
37
  * Suggested follow-up queries panel with clickable buttons
 
46
 
47
  ## Tech Stack
48
 
49
+ * LLM: Qwen2.5-72B-Instruct on AMD MI300X via vLLM 0.17.1
50
  * Agent Framework: LangGraph + LangChain
51
  * Literature Retrieval: BioPython Entrez / PubMed NCBI
52
  * Web Framework: Flask with SSE streaming
53
  * PDF: ReportLab
54
  * Frontend: HTML, CSS, vanilla JS
55
+ * Runtime: Windows 11, Python 3.11, RTX 3060 12GB (local) + AMD MI300X 192GB (inference)
56
 
57
  ## API Endpoints
58
 
 
71
 
72
  ## Environment
73
 
74
+ * VLLM_BASE_URL=http://165.245.141.245:8000/v1
75
+ * VLLM_API_KEY=EMPTY
76
  * Python venv at ./venv
77
  * Start server: venv\Scripts\activate && python app.py
78
+ * AMD MI300X instance: 165.245.141.245 (DigitalOcean ATL1, 192GB VRAM)
79
 
80
  ## What Remains Before May 11
81
 
82
+ 1. Concept document for lablab.ai submission (window opens May 11)
83
+ 2. Demo video (under 3 minutes)
84
+ 3. LinkedIn post with #AMDDevHackathon
85
+ 4. Submit on lablab.ai
 
86
 
87
  ## GitHub
88