Spaces:

RayMelius
/

StockEx

Running

RayMelius Claude Opus 4.6 commited on Mar 6

Commit

12ad701

1 Parent(s): 80289a0

Remove legacy docs, backup copies, and artifacts

Deleted:
- IMPROVEMENT_PLAN.md, README_OPTIQ.md — obsolete planning docs
- StockEx_Developer_Guide.html, StockEx_Technical_Guide.md,
StockEx_User_Guide.html — superseded by README.md
- dashboard/templates/index - Copy (6).html — accidental backup
- dashboard/templates/index_Matcher.html — unused alternate template
- matcher/matcher - Copy.py — accidental backup

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Files changed (8) hide show

IMPROVEMENT_PLAN.md +0 -271
README_OPTIQ.md +0 -73
StockEx_Developer_Guide.html +0 -569
StockEx_Technical_Guide.md +0 -814
StockEx_User_Guide.html +0 -428
dashboard/templates/index - Copy (6).html +0 -198
dashboard/templates/index_Matcher.html +0 -194
matcher/matcher - Copy.py +0 -135

IMPROVEMENT_PLAN.md DELETED Viewed

@@ -1,271 +0,0 @@
-# KafkaTradingSystem Improvement Plan
-> **Created:** 2026-02-03
-> **Status:** ✅ Core implementation complete (Phases 1-5 done)
-> **Last Updated:** 2026-02-03
-> **Resume:** Share this file with Claude to continue from where we left off
----
-## Overview
-This plan outlines improvements to transform the trading system from a demo/prototype into a more robust, production-like system. Improvements are organized by priority and complexity.
----
-## Phase 1: Real-Time Dashboard (WebSocket/SSE)
-**Problem:** Dashboard polls `/data` every 2 seconds (`setInterval(refresh, 2000)`), causing unnecessary load and delayed updates.
-**Solution:** Implement Server-Sent Events (SSE) for real-time push updates.
-### Tasks
-- [x] **1.1** Add SSE endpoint to `dashboard/dashboard.py` ✅
-  - Create `/stream` endpoint using Flask's `Response` with `text/event-stream`
-  - Push events when new orders/trades/snapshots arrive from Kafka
-  - File: `dashboard/dashboard.py`
-- [x] **1.2** Update dashboard frontend to use SSE ✅
-  - Replace `setInterval(refresh, 2000)` with `EventSource('/stream')`
-  - Handle reconnection on disconnect
-  - File: `dashboard/templates/index.html`
-- [x] **1.3** Add connection status indicator ✅
-  - Show connected/disconnected state in UI
-  - File: `dashboard/templates/index.html`
-### Why SSE over WebSocket?
-- Simpler implementation (HTTP-based, no special protocol)
-- One-way server-to-client is sufficient for this use case
-- Better browser support and automatic reconnection
----
-## Phase 2: SQLite Persistence
-**Problem:** All data is in-memory; order books and trades lost on restart.
-**Solution:** Add SQLite database for persistence with in-memory caching.
-### Tasks
-- [x] **2.1** Create database schema and initialization ✅
-  - Tables: `orders`, `trades`, `order_book_entries`
-  - Add migration/init script
-  - New file: `matcher/database.py`
-- [x] **2.2** Modify matcher to persist trades ✅
-  - Write trades to SQLite when matched
-  - Load recent trades on startup
-  - File: `matcher/matcher.py`
-- [x] **2.3** Persist order book state ✅
-  - Save resting orders to database
-  - Restore order books on matcher restart
-  - File: `matcher/matcher.py`
-- [x] **2.4** Add trade history endpoint ✅
-  - `GET /trades?symbol=X&limit=N&offset=M`
-  - Support filtering and pagination
-  - File: `matcher/matcher.py`
-- [x] **2.5** Add Docker volume for database persistence ✅
-  - Mount SQLite file to host
-  - File: `docker-compose.yml`
-### Schema Design
-```sql
-CREATE TABLE trades (
-    id INTEGER PRIMARY KEY AUTOINCREMENT,
-    symbol TEXT NOT NULL,
-    price REAL NOT NULL,
-    quantity INTEGER NOT NULL,
-    buy_order_id TEXT,
-    sell_order_id TEXT,
-    timestamp REAL NOT NULL,
-    created_at DATETIME DEFAULT CURRENT_TIMESTAMP
-);
-CREATE TABLE order_book (
-    id INTEGER PRIMARY KEY AUTOINCREMENT,
-    cl_ord_id TEXT UNIQUE,
-    symbol TEXT NOT NULL,
-    side TEXT NOT NULL,  -- 'BUY' or 'SELL'
-    price REAL,
-    quantity INTEGER NOT NULL,
-    remaining_qty INTEGER NOT NULL,
-    status TEXT DEFAULT 'OPEN',  -- OPEN, FILLED, CANCELLED
-    timestamp REAL NOT NULL,
-    created_at DATETIME DEFAULT CURRENT_TIMESTAMP
-);
-CREATE INDEX idx_trades_symbol ON trades(symbol);
-CREATE INDEX idx_trades_timestamp ON trades(timestamp);
-CREATE INDEX idx_orderbook_symbol_side ON order_book(symbol, side);
-```
----
-## Phase 3: FIX Protocol Improvements
-**Problem:** Basic FIX handling with no validation, no execution reports, no order management.
-### Tasks
-- [x] **3.1** Add FIX message validation ✅
-  - Validate required fields (ClOrdID, Symbol, Side, OrderQty)
-  - Validate field formats and ranges
-  - Return Reject (35=3) for invalid messages
-  - File: `fix_oeg/fix_oeg_server.py`
-- [x] **3.2** Send Execution Reports back to clients ✅
-  - Send 35=8 (ExecutionReport) for order acknowledgment
-  - Send fill reports when trades occur
-  - Requires Kafka consumer for trades topic in fix_oeg
-  - File: `fix_oeg/fix_oeg_server.py`
-- [x] **3.3** Support Order Cancel Request (35=F) ✅
-  - Parse cancel requests
-  - Publish to orders Kafka topic (with type=cancel)
-  - Files: `fix_oeg/fix_oeg_server.py`
-- [x] **3.4** Support Order Cancel/Replace (35=G) ✅
-  - Parse modify requests
-  - Implement price/quantity amendments
-  - Files: `fix_oeg/fix_oeg_server.py`, `matcher/matcher.py`
-- [ ] **3.5** Add session-level validation (DEFERRED)
-  - Sequence number checking handled by QuickFIX engine
-  - Heartbeat/TestRequest handled automatically
-  - File: `fix_oeg/fix_oeg_server.py`
-### Execution Report Fields (35=8)
-```
-Tag 35 = 8 (ExecutionReport)
-Tag 37 = OrderID (exchange-assigned)
-Tag 11 = ClOrdID (client order ID)
-Tag 17 = ExecID
-Tag 20 = ExecTransType (0=New)
-Tag 39 = OrdStatus (0=New, 1=PartialFill, 2=Filled)
-Tag 150 = ExecType (0=New, F=Trade)
-Tag 55 = Symbol
-Tag 54 = Side
-Tag 38 = OrderQty
-Tag 44 = Price
-Tag 32 = LastShares (fill qty)
-Tag 31 = LastPx (fill price)
-Tag 14 = CumQty
-Tag 151 = LeavesQty
-Tag 6 = AvgPx
-```
----
-## Phase 4: Enhanced Order Types
-**Problem:** Only limit orders supported.
-### Tasks
-- [x] **4.1** Support Market Orders ✅
-  - Match immediately at best available price
-  - No price field required (OrdType=1)
-  - File: `matcher/matcher.py`
-- [x] **4.2** Support IOC (Immediate-or-Cancel) ✅
-  - TimeInForce=3: Fill what's available, cancel rest
-  - File: `matcher/matcher.py`
-- [x] **4.3** Support FOK (Fill-or-Kill) ✅
-  - TimeInForce=4: Fill entire order or reject
-  - File: `matcher/matcher.py`
-- [x] **4.4** Support GTC (Good-Till-Cancel) ✅
-  - TimeInForce=1: Persist until explicitly cancelled
-  - Implemented via SQLite persistence (Phase 2)
-  - File: `matcher/matcher.py`
----
-## Phase 5: Monitoring & Observability
-### Tasks
-- [x] **5.1** Add health check endpoints ✅
-  - `/health` endpoint for matcher, dashboard, frontend
-  - Check Kafka/DB connectivity and service stats
-  - Files: `matcher/matcher.py`, `dashboard/dashboard.py`, `frontend/frontend.py`
-- [x] **5.2** Add structured logging ✅
-  - JSON log format for parsing
-  - Include correlation IDs
-  - New file: `shared/logging_utils.py`
-- [x] **5.3** Add metrics endpoint ✅
-  - Order count, trade count, latency stats
-  - Prometheus-compatible format (`/metrics` endpoint)
-  - File: `matcher/matcher.py`
-- [ ] **5.4** Add Kafka lag monitoring (OPTIONAL)
-  - Track consumer group lag
-  - Alert on high lag
-  - New file: `shared/monitoring.py`
----
-## Phase 6: Testing & Quality
-### Tasks
-- [x] **6.1** Add unit tests for matcher ✅
-  - Test matching logic (full/partial fills, price-time priority)
-  - Test order types (market, limit, IOC, FOK)
-  - Test cancel and amend operations
-  - New file: `matcher/test_matcher.py`
-- [ ] **6.2** Add integration tests (OPTIONAL)
-  - End-to-end order flow tests
-  - FIX client to trade execution
-  - New directory: `tests/`
-- [ ] **6.3** Add load testing script (OPTIONAL)
-  - Generate high-volume order flow
-  - Measure latency and throughput
-  - New file: `tests/load_test.py`
----
-## Implementation Order (Recommended)
-1. **Phase 1** (Real-Time Dashboard) - Quick win, improves UX
-2. **Phase 2** (SQLite Persistence) - Foundation for reliability
-3. **Phase 3.1-3.2** (FIX Validation + Execution Reports) - Core trading functionality
-4. **Phase 5.1** (Health Checks) - Operational necessity
-5. **Phase 4.1** (Market Orders) - Common order type
-6. **Phase 3.3** (Order Cancellation) - Essential for trading
-7. Remaining phases as needed
----
-## Quick Reference: Key Files
-| Component | Main File | Port |
-|-----------|-----------|------|
-| FIX Gateway | `fix_oeg/fix_oeg_server.py` | 5001 |
-| Matcher | `matcher/matcher.py` | 6000 |
-| Dashboard | `dashboard/dashboard.py` | 5005 |
-| Frontend | `frontend/frontend.py` | 5000 |
-| Config | `shared/config.py` | - |
----
-## How to Continue
-When resuming work, tell Claude:
-1. Which phase/task to work on (e.g., "Let's implement Phase 1.1")
-2. Or ask Claude to pick the next logical task
-Each task is designed to be implementable in a single session.

README_OPTIQ.md DELETED Viewed

@@ -1,73 +0,0 @@
-# StockEx — Euronext/OPTIQ Trading System Emulator
-## Overview
-**StockEx** is a real-time trading simulation platform inspired by Euronext OPTIQ. It provides a complete order flow from FIX protocol entry through matching engine to trade execution, with live visualization via a web dashboard.
-## Architecture
-| Component | Description |
-|-----------|-------------|
-| **FIX OEG** | QuickFIX acceptor receiving FIX 4.4 orders |
-| **Kafka** | Message backbone (topics: `orders`, `snapshots`, `trades`) |
-| **Matcher** | Order matching engine with price-time priority |
-| **MDF** | Market Data Feeder publishing BBO snapshots |
-| **Dashboard** | Real-time web UI with SSE streaming |
-## Data Flow
-```
-FIX Client → FIX OEG → Kafka [orders] → Matcher → Kafka [trades]
-                                            ↓
-MDF → Kafka [snapshots] ───────────→ Dashboard (Flask)
-```
-## Dashboard Features
-- **Orders Panel** — Live order feed with Edit/Cancel actions
-- **Market Snapshot** — Best Bid/Ask with spread, mid price, and scrolling ticker
-- **Trades Panel** — Executed trades with value calculation
-- **Order Book** — Depth of book per symbol (bids/asks)
-- **Trade Chart** — Price and volume visualization
-- **Trading Statistics** — Volume, Value, VWAP per symbol with bar charts
-![Trading Dashboard](screenshots/dashboard.png)
-## Quick Start
-```bash
-docker compose up --build
-```
-Open dashboard: **http://localhost:5005**
-## Directory Structure
-```
-StockEx/
-├── docker-compose.yml
-├── fix_oeg/          # FIX Order Entry Gateway
-├── fix-ui-client/    # FIX test clients
-├── matcher/          # Order matching engine
-├── md_feeder/        # Market data simulator
-├── dashboard/        # Flask web dashboard
-├── frontend/         # Manual order entry UI
-├── shared/           # Common config and utilities
-└── shared_data/      # Securities and state files
-```
-## Configuration
-| Variable | Default | Description |
-|----------|---------|-------------|
-| `KAFKA_BOOTSTRAP` | kafka:9092 | Kafka broker address |
-| `TICK_SIZE` | 0.05 | Minimum price increment |
-| `ORDERS_PER_MIN` | 8 | MDF order generation rate |
-## Requirements
-- Docker & Docker Compose
-- Ports: 5005 (Dashboard), 6000 (Matcher), 9092 (Kafka)
----
-*StockEx v1.0 — Trading Simulation Platform*

StockEx_Developer_Guide.html DELETED Viewed

@@ -1,569 +0,0 @@
-<!DOCTYPE html>
-<html>
-<head>
-  <meta charset="utf-8">
-  <title>StockEx - Developer Guide</title>
-  <style>
-    @page { margin: 1.5cm; size: A4; }
-    body { font-family: 'Segoe UI', Arial, sans-serif; max-width: 900px; margin: 0 auto; padding: 20px; line-height: 1.5; color: #333; font-size: 11pt; }
-    h1 { color: #1a1a2e; border-bottom: 3px solid #4CAF50; padding-bottom: 10px; font-size: 24pt; }
-    h2 { color: #2e7d32; margin-top: 25px; border-bottom: 1px solid #ddd; padding-bottom: 5px; font-size: 16pt; page-break-after: avoid; }
-    h3 { color: #1565c0; margin-top: 18px; font-size: 13pt; }
-    h4 { color: #555; margin-top: 12px; font-size: 11pt; }
-    table { width: 100%; border-collapse: collapse; margin: 12px 0; font-size: 10pt; }
-    th, td { border: 1px solid #ddd; padding: 8px; text-align: left; }
-    th { background: #f5f5f5; font-weight: bold; }
-    tr:nth-child(even) { background: #fafafa; }
-    .header { text-align: center; margin-bottom: 25px; }
-    .subtitle { color: #666; font-size: 14pt; }
-    .version { color: #999; font-size: 10pt; }
-    .section { page-break-inside: avoid; margin-bottom: 20px; }
-    .highlight { background: #e8f5e9; padding: 12px; border-radius: 5px; margin: 10px 0; border-left: 4px solid #4CAF50; }
-    .info { background: #e3f2fd; padding: 12px; border-radius: 5px; margin: 10px 0; border-left: 4px solid #2196F3; }
-    .warning { background: #fff3e0; padding: 12px; border-radius: 5px; margin: 10px 0; border-left: 4px solid #ff9800; }
-    .code-block { background: #263238; color: #aed581; padding: 15px; border-radius: 5px; font-family: 'Consolas', monospace; font-size: 10pt; overflow-x: auto; margin: 10px 0; white-space: pre; }
-    .json { background: #37474f; color: #80cbc4; }
-    code { background: #f5f5f5; padding: 2px 6px; border-radius: 3px; font-family: 'Consolas', monospace; font-size: 10pt; }
-    .green { color: #2e7d32; }
-    .red { color: #c62828; }
-    .blue { color: #1565c0; }
-    hr { border: none; border-top: 1px solid #ddd; margin: 25px 0; }
-    .footer { text-align: center; color: #666; font-size: 9pt; margin-top: 30px; padding-top: 15px; border-top: 1px solid #ddd; }
-    .toc { background: #fafafa; padding: 15px; border-radius: 5px; margin: 15px 0; columns: 2; }
-    .toc ul { margin: 0; padding-left: 20px; }
-    .toc li { margin: 4px 0; font-size: 10pt; }
-    .arch-diagram { background: #f5f5f5; padding: 15px; border-radius: 5px; font-family: 'Consolas', monospace; white-space: pre; font-size: 9pt; overflow-x: auto; line-height: 1.3; }
-    .module-box { border: 1px solid #ddd; border-radius: 6px; padding: 12px; margin: 12px 0; background: #fafafa; page-break-inside: avoid; }
-    .module-box h4 { margin: 0 0 8px 0; color: #1a1a2e; border-bottom: 1px solid #eee; padding-bottom: 5px; }
-    .port { display: inline-block; background: #e3f2fd; padding: 2px 8px; border-radius: 3px; font-family: monospace; font-size: 9pt; margin-right: 5px; }
-    .tech { display: inline-block; background: #f3e5f5; padding: 2px 8px; border-radius: 3px; font-size: 9pt; margin-right: 5px; }
-    .endpoint { font-family: monospace; background: #e8f5e9; padding: 2px 6px; border-radius: 3px; }
-    .two-col { display: flex; gap: 20px; }
-    .two-col > div { flex: 1; }
-    .screenshot { text-align: center; margin: 15px 0; }
-    .screenshot img { max-width: 100%; border: 1px solid #ddd; border-radius: 5px; }
-  </style>
-</head>
-<body>
-<div class="header">
-  <h1>StockEx Trading Platform</h1>
-  <p class="subtitle">Developer & Technical Guide</p>
-  <p class="version">Version 1.0 | Euronext OPTIQ Inspired</p>
-</div>
-<div class="toc">
-  <strong>Contents</strong>
-  <ul>
-    <li>1. Overview</li>
-    <li>2. Architecture</li>
-    <li>3. Modules</li>
-    <li>4. Database Persistence</li>
-    <li>5. Data Flow Diagrams</li>
-    <li>6. Kafka Topics</li>
-    <li>7. Message Formats</li>
-    <li>8. SSE Events</li>
-    <li>9. Configuration</li>
-    <li>10. Development</li>
-  </ul>
-</div>
-<hr>
-<div class="section">
-  <h2>1. Overview</h2>
-  <p><strong>StockEx</strong> is a real-time trading simulation platform providing complete order-to-trade lifecycle emulation. Built with microservices architecture using Docker containers.</p>
-  <div class="two-col">
-    <div class="highlight">
-      <strong>Core Features</strong>
-      <ul style="margin:5px 0; padding-left:20px;">
-        <li>FIX 4.4 protocol gateway</li>
-        <li>Price-time priority matching</li>
-        <li>Kafka event streaming</li>
-        <li>SSE real-time dashboard</li>
-        <li>SQLite persistence</li>
-      </ul>
-    </div>
-    <div class="info">
-      <strong>Tech Stack</strong>
-      <ul style="margin:5px 0; padding-left:20px;">
-        <li>Python 3.11 / Flask</li>
-        <li>QuickFIX/Python</li>
-        <li>Apache Kafka 7.5</li>
-        <li>Docker Compose</li>
-        <li>SQLite</li>
-      </ul>
-    </div>
-  </div>
-</div>
-<div class="section">
-  <h2>2. System Architecture</h2>
-  <div class="arch-diagram">
-┌───────���─────────┐     ┌─────────────────┐     ┌─────────────────┐
-│  FIX UI Client  │     │  FIX UI Client  │     │    Frontend     │
-│    (Port 5002)  │     │    (Port 5003)  │     │   (Port 5000)   │
-└────────┬────────┘     └────────┬────────┘     └────────┬────────┘
-         │ FIX 4.4               │ FIX 4.4               │ HTTP/JSON
-         └───────────────┬───────┴───────────────────────┘
-                         ▼
-         ┌───────────────────────────────┐
-         │     FIX OEG (Port 5001)       │
-         │   QuickFIX Order Gateway      │
-         └───────────────┬───────────────┘
-                         │ JSON
-                         ▼
-┌────────────────────────────────────────────────────────────────────┐
-│                    APACHE KAFKA (Port 9092)                        │
-│  ┌──────────┐      ┌──────────┐      ┌──────────┐                 │
-│  │  orders  │      │  trades  │      │ snapshots│                 │
-│  └──────────┘      └──────────┘      └──────────┘                 │
-└─────┬─────────────────┬─────────────────┬─────────────────────────┘
-      │                 │                 │
-      ▼                 │                 ▼
-┌─────────────┐         │         ┌─────────────┐
-│   Matcher   │─────────┘         │  MD Feeder  │
-│ (Port 6000) │                   │    (MDF)    │
-│             │                   │             │
-│ Order Book  │◄──────────────────│ Price Sim   │
-│ Trade Exec  │                   │ BBO Publish │
-└─────────────┘                   └─────────────┘
-      │
-      ▼ REST API
-┌─────────────────────────────────────────┐
-│         Dashboard (Port 5005)           │
-│  Orders │ Trades │ Book │ Chart │ Stats │
-└─────────────────────────────────────────┘
-  </div>
-</div>
-<div class="section">
-  <h2>3. Module Specifications</h2>
-  <div class="module-box">
-    <h4>Kafka Message Broker</h4>
-    <span class="port">9092</span> <span class="port">29092 (host)</span> <span class="tech">Confluent 7.5.0</span>
-    <p>Central event bus. All order flow distributed via topics. Zookeeper (port 2181) for coordination.</p>
-  </div>
-  <div class="module-box">
-    <h4>FIX Order Entry Gateway</h4>
-    <span class="port">5001</span> <span class="tech">QuickFIX/Python</span>
-    <p>FIX 4.4 acceptor. Receives NewOrderSingle (D), OrderCancelRequest (F), OrderCancelReplaceRequest (G). Normalizes to JSON → Kafka <code>orders</code>.</p>
-  </div>
-  <div class="module-box">
-    <h4>Matcher Engine</h4>
-    <span class="port">6000</span> <span class="tech">Python/Flask/SQLite</span>
-    <p>Consumes <code>orders</code>, matches with price-time priority, publishes <code>trades</code>. Maintains order book per symbol. SQLite persistence.</p>
-    <table>
-      <tr><th>Endpoint</th><th>Method</th><th>Description</th></tr>
-      <tr><td><span class="endpoint">/orderbook/&lt;symbol&gt;</span></td><td>GET</td><td>Order book depth</td></tr>
-      <tr><td><span class="endpoint">/trades</span></td><td>GET</td><td>Recent trades</td></tr>
-      <tr><td><span class="endpoint">/health</span></td><td>GET</td><td>Health + stats</td></tr>
-    </table>
-  </div>
-  <div class="module-box">
-    <h4>Market Data Feeder (MDF)</h4>
-    <span class="tech">Python</span>
-    <p>Simulates market activity. 90% passive orders (book building), 10% aggressive (trades). Publishes BBO snapshots.</p>
-    <p>Output: <code>orders</code> + <code>snapshots</code> topics</p>
-  </div>
-  <div class="module-box">
-    <h4>Dashboard</h4>
-    <span class="port">5005</span> <span class="tech">Flask/SSE/JavaScript</span>
-    <p>Real-time web UI. Consumes Kafka + Matcher API. Server-Sent Events for live streaming. Edit/Cancel order management.</p>
-    <table>
-      <tr><th>Endpoint</th><th>Method</th><th>Description</th></tr>
-      <tr><td><span class="endpoint">/stream</span></td><td>GET</td><td>SSE event stream</td></tr>
-      <tr><td><span class="endpoint">/data</span></td><td>GET</td><td>Polling fallback</td></tr>
-      <tr><td><span class="endpoint">/order/cancel</span></td><td>POST</td><td>Cancel order</td></tr>
-      <tr><td><span class="endpoint">/order/amend</span></td><td>POST</td><td>Amend order</td></tr>
-    </table>
-  </div>
-  <div class="module-box">
-    <h4>FIX UI Clients</h4>
-    <span class="port">5002</span> <span class="port">5003</span> <span class="tech">QuickFIX/Flask</span>
-    <p>Web-based FIX initiators. Connect to FIX OEG for institutional order submission.</p>
-  </div>
-</div>
-<div class="section">
-  <h2>4. Database Persistence</h2>
-  <div class="info">
-    <strong>Storage:</strong> SQLite database at <code>/app/data/matcher.db</code><br>
-    <strong>Docker Volume:</strong> <code>stockex_matcher_data</code> (survives container restarts)
-  </div>
-  <h4>4.1 Database Schema</h4>
-  <div class="module-box">
-    <h4>order_book — All Orders</h4>
-    <table>
-      <tr><th>Column</th><th>Type</th><th>Description</th></tr>
-      <tr><td><code>id</code></td><td>INTEGER</td><td>Auto-increment primary key</td></tr>
-      <tr><td><code>cl_ord_id</code></td><td>TEXT</td><td>Unique client order ID</td></tr>
-      <tr><td><code>symbol</code></td><td>TEXT</td><td>Security (ALPHA, EXAE, etc.)</td></tr>
-      <tr><td><code>side</code></td><td>TEXT</td><td>BUY / SELL</td></tr>
-      <tr><td><code>price</code></td><td>REAL</td><td>Limit price</td></tr>
-      <tr><td><code>quantity</code></td><td>INTEGER</td><td>Original order quantity</td></tr>
-      <tr><td><code>remaining_qty</code></td><td>INTEGER</td><td>Unfilled quantity</td></tr>
-      <tr><td><code>status</code></td><td>TEXT</td><td>OPEN / FILLED / CANCELLED</td></tr>
-      <tr><td><code>timestamp</code></td><td>REAL</td><td>Order entry time (Unix)</td></tr>
-      <tr><td><code>created_at</code></td><td>DATETIME</td><td>DB insert timestamp</td></tr>
-    </table>
-  </div>
-  <div class="module-box">
-    <h4>trades — Executed Trades</h4>
-    <table>
-      <tr><th>Column</th><th>Type</th><th>Description</th></tr>
-      <tr><td><code>id</code></td><td>INTEGER</td><td>Auto-increment primary key</td></tr>
-      <tr><td><code>symbol</code></td><td>TEXT</td><td>Traded security</td></tr>
-      <tr><td><code>price</code></td><td>REAL</td><td>Execution price</td></tr>
-      <tr><td><code>quantity</code></td><td>INTEGER</td><td>Traded quantity</td></tr>
-      <tr><td><code>buy_order_id</code></td><td>TEXT</td><td>Buyer's cl_ord_id</td></tr>
-      <tr><td><code>sell_order_id</code></td><td>TEXT</td><td>Seller's cl_ord_id</td></tr>
-      <tr><td><code>timestamp</code></td><td>REAL</td><td>Trade time (Unix)</td></tr>
-      <tr><td><code>created_at</code></td><td>DATETIME</td><td>DB insert timestamp</td></tr>
-    </table>
-  </div>
-  <h4>4.2 Database Functions</h4>
-  <table>
-    <tr><th>Function</th><th>Description</th></tr>
-    <tr><td><code>save_order(order)</code></td><td>Insert new order into order_book</td></tr>
-    <tr><td><code>update_order_quantity(id, qty)</code></td><td>Update remaining_qty after partial fill</td></tr>
-    <tr><td><code>cancel_order(cl_ord_id)</code></td><td>Set status = 'CANCELLED'</td></tr>
-    <tr><td><code>save_trade(trade)</code></td><td>Insert executed trade</td></tr>
-    <tr><td><code>get_open_orders(symbol, side)</code></td><td>Query open orders for matching</td></tr>
-    <tr><td><code>load_order_books()</code></td><td>Restore order books on startup</td></tr>
-    <tr><td><code>get_trades(symbol, limit)</code></td><td>Retrieve recent trades</td></tr>
-    <tr><td><code>delete_filled_orders(days)</code></td><td>Cleanup old filled/cancelled orders</td></tr>
-  </table>
-  <h4>4.3 Indexes</h4>
-  <div class="code-block">CREATE INDEX idx_trades_symbol ON trades(symbol);
-CREATE INDEX idx_trades_timestamp ON trades(timestamp);
-CREATE INDEX idx_orderbook_symbol_side ON order_book(symbol, side);
-CREATE INDEX idx_orderbook_status ON order_book(status);
-CREATE INDEX idx_orderbook_cl_ord_id ON order_book(cl_ord_id);</div>
-</div>
-<div class="section">
-  <h2>5. Data Flow Diagrams</h2>
-  <h4>4.1 Order Entry Flow</h4>
-  <div class="arch-diagram">
-   ┌──────────────┐
-   │  FIX Client  │
-   └──────┬───────┘
-          │ FIX 4.4 NewOrderSingle (35=D)
-          ▼
-   ┌──────────────┐
-   │   FIX OEG    │  Validate → Normalize → Generate cl_ord_id
-   └──────┬───────┘
-          │ JSON
-          ▼
-   ┌──────────────┐
-   │    Kafka     │  Topic: orders
-   │   [orders]   │
-   └──────┬───────┘
-          │
-    ┌─────┴─────┐
-    ▼           ▼
-┌────────┐  ┌���──────────┐
-│Matcher │  │ Dashboard │
-└────────┘  └───────────┘
-  </div>
-  <h4>4.2 Order Matching Flow</h4>
-  <div class="arch-diagram">
-                    ┌─────────────────┐
-                    │  Incoming Order │
-                    │   (from Kafka)  │
-                    └────────┬────────┘
-                             │
-                             ▼
-                    ┌─────────────────┐
-                    │  Parse & Validate│
-                    └────────┬────────┘
-                             │
-              ┌──────────────┴──────────────┐
-              ▼                             ▼
-       ┌────────────┐                ┌────────────┐
-       │  BUY Order │                │ SELL Order │
-       └──────┬─────┘                └──────┬─────┘
-              │                             │
-              ▼                             ▼
-    ┌──────────────────┐         ┌──────────────────┐
-    │ Check SELL book  │         │ Check BUY book   │
-    │ for price ≤ bid  │         │ for price ≥ ask  │
-    └────────┬─────────┘         └────────┬─────────┘
-             │                            │
-      ┌──────┴──────┐              ┌──────┴──────┐
-      ▼             ▼              ▼             ▼
-  ┌───────┐    ┌────────┐     ┌───────┐    ┌────────┐
-  │ Match │    │No Match│     │ Match │    │No Match│
-  │ Found │    │        │     │ Found │    │        │
-  └───┬───┘    └───┬────┘     └───┬───┘    └───┬────┘
-      │            │              │            │
-      ▼            ▼              ▼            ▼
-  ┌───────┐    ┌────────┐     ┌───────┐    ┌────────┐
-  │Execute│    │Add to  │     │Execute│    │Add to  │
-  │ Trade │    │BUY Book│     │ Trade │    │SELLBook│
-  └───┬───┘    └────────┘     └───┬───┘    └────────┘
-      │                           │
-      └───────────┬───────────────┘
-                  ▼
-           ┌────────────┐
-           │Kafka:trades│
-           └────────────┘
-  </div>
-  <h4>4.3 Real-time Dashboard Flow</h4>
-  <div class="arch-diagram">
-┌─────────────────────────────────────────────────────────────────┐
-│                         BROWSER                                 │
-│  ┌─────────────────────────────────────────────────────────┐   │
-│  │                    Dashboard UI                          │   │
-│  │  ┌─────────┐ ┌─────────┐ ┌─────────┐ ┌─────────────────┐│   │
-│  │  │ Orders  │ │ Trades  │ │  Book   │ │    Statistics   ││   │
-│  │  └────▲────┘ └────▲────┘ └────▲────┘ └────────▲────────┘│   │
-│  └───────┼───────────┼───────────┼───────────────┼──────────┘   │
-│          │           │           │               │              │
-│          └───────────┴─────┬─────┴───────────────┘              │
-│                            │                                    │
-│                    ┌───────▼────────┐                          │
-│                    │ EventSource    │  SSE Connection          │
-│                    │ /stream        │                          │
-│                    └───────┬────────┘                          │
-└─���──────────────────────────┼────────────────────────────────────┘
-                             │ HTTP (SSE)
-                             ▼
-┌────────────────────────────────────────────────────────────────┐
-│                      DASHBOARD SERVER                          │
-│                                                                │
-│   ┌──────────────┐      ┌──────────────┐     ┌────────────┐   │
-│   │Kafka Consumer│─────▶│ SSE Broadcast│────▶│  Clients   │   │
-│   │ (orders,     │      │   Queue      │     │  Queue[]   │   │
-│   │  trades,     │      └──────────────┘     └────────────┘   │
-│   │  snapshots)  │                                            │
-│   └──────────────┘                                            │
-│                                                                │
-│   ┌──────────────┐      ┌──────────────┐                      │
-│   │  REST API    │◀────▶│   Matcher    │  /orderbook, /trades │
-│   │  /data       │      │   Proxy      │                      │
-│   └──────────────┘      └──────────────┘                      │
-└────────────────────────────────────────────────────────────────┘
-  </div>
-  <h4>4.4 Complete System Interaction</h4>
-  <div class="arch-diagram">
-          ┌─────────┐ ┌─────────┐ ┌─────────┐
-          │FIX Cli 1│ │FIX Cli 2│ │Frontend │
-          └────┬────┘ └────┬────┘ └────┬────┘
-               │           │           │
-               └─────┬─────┴───────────┘
-                     │
-                     ▼
-              ┌─────────────┐
-              │   FIX OEG   │◄──── FIX 4.4 Protocol
-              └──────┬──────┘
-                     │
-                     ▼
-    ┌────────────────────────────────────┐
-    │            KAFKA CLUSTER           │
-    │  ┌────────┐┌────────┐┌──────────┐ │
-    │  │orders  ││trades  ││snapshots │ │
-    │  └───┬────┘└───▲────┘└────▲─────┘ │
-    └──────┼─────────┼──────────┼───────┘
-           │         │          │
-     ┌─────┼─────────┼──────────┼─────┐
-     │     ▼         │          │     │
-     │ ┌────────┐    │          │     │
-     │ │MATCHER │────┘          │     │
-     │ │        │               │     │
-     │ │ Book   │               │     │
-     │ │ Match  │               │     │
-     │ │ Trade  │               │     │
-     │ └────────┘               │     │
-     │     ▲                    │     │
-     │     │ REST               │     │
-     │     │                    │     │
-     │ ┌───┴────────────────────┴──┐  │
-     │ │        DASHBOARD          │  │
-     │ │   (SSE + Kafka Consumer)  │  │
-     │ └───────────────────────────┘  │
-     │                                │
-     │ ┌───────────────────────────┐  │
-     │ │      MD FEEDER (MDF)      │──┘
-     │ │   Orders + Snapshots      │
-     │ └───────────────────────────┘
-     │              DOCKER NETWORK
-     └────────────────────────────────┘
-  </div>
-  <h4>4.5 Message Sequence: New Order to Trade</h4>
-  <div class="arch-diagram">
-FIX Client    FIX OEG      Kafka       Matcher     Dashboard
-    │            │           │            │            │
-    │──35=D────▶│            │            │            │
-    │NewOrder   │            │            │            │
-    │           │──JSON────▶│            │            │
-    │           │  [orders] │            │            │
-    │           │           │──consume──▶│            │
-    │           │           │            │            │
-    │           │           │            │──match()   │
-    │           │           │            │            │
-    │           │           │◀──trade────│            │
-    │           │           │  [trades]  │            │
-    │           │           │            │            │
-    │           │           │──────────────consume───▶│
-    │           │           │            │            │
-    │           │           │            │     render()
-    │           │           │            │            │
-  </div>
-</div>
-<div class="section">
-  <h2>6. Kafka Topics</h2>
-  <table>
-    <tr><th>Topic</th><th>Producers</th><th>Consumers</th><th>Content</th></tr>
-    <tr><td><code>orders</code></td><td>FIX OEG, MDF, Frontend</td><td>Matcher, Dashboard</td><td>New/Cancel/Amend orders</td></tr>
-    <tr><td><code>trades</code></td><td>Matcher</td><td>Dashboard, Consumer</td><td>Executed trades</td></tr>
-    <tr><td><code>snapshots</code></td><td>MDF</td><td>Dashboard</td><td>BBO updates</td></tr>
-  </table>
-</div>
-<div class="section">
-  <h2>7. Message Formats</h2>
-  <h4>Order (New)</h4>
-  <div class="code-block json">{
-  "symbol": "ALPHA",
-  "side": "BUY",
-  "price": 25.50,
-  "quantity": 100,
-  "cl_ord_id": "MDF-1234567890-1",
-  "timestamp": 1234567890.123,
-  "source": "MDF"
-}</div>
-  <h4>Order (Cancel)</h4>
-  <div class="code-block json">{
-  "type": "cancel",
-  "orig_cl_ord_id": "MDF-1234567890-1",
-  "symbol": "ALPHA",
-  "timestamp": 1234567890.456
-}</div>
-  <h4>Order (Amend)</h4>
-  <div class="code-block json">{
-  "type": "amend",
-  "orig_cl_ord_id": "MDF-1234567890-1",
-  "cl_ord_id": "amend-1234567890",
-  "symbol": "ALPHA",
-  "quantity": 150,
-  "price": 25.45,
-  "timestamp": 1234567890.789
-}</div>
-  <h4>Trade</h4>
-  <div class="code-block json">{
-  "symbol": "ALPHA",
-  "price": 25.50,
-  "quantity": 100,
-  "buy_order_id": "order-123",
-  "sell_order_id": "order-456",
-  "timestamp": 1234567890.123
-}</div>
-  <h4>Snapshot (BBO)</h4>
-  <div class="code-block json">{
-  "symbol": "ALPHA",
-  "best_bid": 25.45,
-  "best_ask": 25.55,
-  "bid_size": 500,
-  "ask_size": 300,
-  "timestamp": 1234567890.123,
-  "source": "MDF"
-}</div>
-</div>
-<div class="section">
-  <h2>8. SSE Events</h2>
-  <table>
-    <tr><th>Event</th><th>Data</th><th>Trigger</th></tr>
-    <tr><td><code>connected</code></td><td>{status}</td><td>Client connects</td></tr>
-    <tr><td><code>init</code></td><td>{orders, bbos, trades}</td><td>Initial state dump</td></tr>
-    <tr><td><code>order</code></td><td>Order JSON</td><td>New order received</td></tr>
-    <tr><td><code>trade</code></td><td>Trade JSON</td><td>Trade executed</td></tr>
-    <tr><td><code>snapshot</code></td><td>BBO JSON</td><td>Price update</td></tr>
-  </table>
-</div>
-<div class="section">
-  <h2>9. Configuration</h2>
-  <table>
-    <tr><th>Variable</th><th>Default</th><th>Description</th></tr>
-    <tr><td><code>KAFKA_BOOTSTRAP</code></td><td>kafka:9092</td><td>Broker address</td></tr>
-    <tr><td><code>MATCHER_URL</code></td><td>http://matcher:6000</td><td>Matcher API</td></tr>
-    <tr><td><code>TICK_SIZE</code></td><td>0.05</td><td>Min price increment</td></tr>
-    <tr><td><code>ORDERS_PER_MIN</code></td><td>8</td><td>MDF rate</td></tr>
-    <tr><td><code>KAFKA_RETRIES</code></td><td>30</td><td>Connection retries</td></tr>
-  </table>
-  <h4>Securities (shared_data/securities.txt)</h4>
-  <div class="code-block">#SYMBOL  start_price  current_price
-ALPHA    25.00        25.00
-EXAE     42.00        42.00
-PEIR     18.50        18.50
-QUEST    12.75        12.75</div>
-</div>
-<div class="section">
-  <h2>10. Development Commands</h2>
-  <h4>Build & Run</h4>
-  <div class="code-block">docker compose up --build        # Start all
-docker compose up -d --build     # Background
-docker compose logs -f dashboard # Follow logs
-docker compose down              # Stop all</div>
-  <h4>Reset Data</h4>
-  <div class="code-block">docker compose down
-docker volume rm stockex_matcher_data
-docker compose up -d</div>
-  <h4>Container Access</h4>
-  <div class="code-block">docker exec -it matcher bash
-docker exec -it dashboard bash
-docker logs matcher --tail 50</div>
-  <h4>API Testing</h4>
-  <div class="code-block">curl http://localhost:6000/orderbook/ALPHA
-curl http://localhost:6000/trades
-curl http://localhost:5005/data</div>
-</div>
-<div class="screenshot">
-  <img src="screenshots/dashboard.png" alt="StockEx Dashboard">
-  <p style="font-size:10pt; color:#666;"><em>StockEx Trading Dashboard - Real-time Market View</em></p>
-</div>
-<hr>
-<div class="footer">
-  <strong>StockEx Trading Platform v1.0</strong><br>
-  Developer Guide | Euronext OPTIQ Inspired<br>
-  <p style="margin-top:10px;">Print to PDF: Ctrl+P → Save as PDF</p>
-</div>
-</body>
-</html>

StockEx_Technical_Guide.md DELETED Viewed

@@ -1,814 +0,0 @@
-# StockEx Trading Platform
-## Complete Technical & Developer Guide v1.0
----
-## Table of Contents
-1. [Introduction](#1-introduction)
-2. [System Architecture](#2-system-architecture)
-3. [Module Descriptions](#3-module-descriptions)
-4. [Dashboard User Interface](#4-dashboard-user-interface)
-5. [Data Flow & Messaging](#5-data-flow--messaging)
-6. [Configuration](#6-configuration)
-7. [Quick Reference](#7-quick-reference)
-8. [Troubleshooting](#8-troubleshooting)
----
-## 1. Introduction
-**StockEx** is a comprehensive real-time trading simulation platform inspired by Euronext OPTIQ. It provides a complete electronic trading ecosystem including order entry via FIX protocol, order matching engine, market data distribution, and live visualization through a web dashboard.
-### Key Features
-- **FIX 4.4 Protocol Support** — Institutional-grade order entry via QuickFIX
-- **Real-time Order Matching** — Price-time priority matching engine with SQLite persistence
-- **Live Market Data Streaming** — Kafka-based event distribution
-- **Web Dashboard with SSE** — Real-time updates without page refresh
-- **Order Management** — Edit and Cancel capabilities from the UI
-- **Trading Analytics** — Volume, Value, VWAP statistics with visualizations
-### Access URLs
-| Service | URL | Purpose |
-|---------|-----|---------|
-| Dashboard | http://localhost:5005 | Main trading view |
-| Frontend | http://localhost:5000 | Manual order entry |
-| FIX Client 1 | http://localhost:5002 | FIX order submission |
-| FIX Client 2 | http://localhost:5003 | FIX order submission |
-| Matcher API | http://localhost:6000 | REST API for order book/trades |
----
-## 2. System Architecture
-### High-Level Architecture Diagram
-```
-┌─────────────────┐     ┌─────────────────┐     ┌─────────────────┐
-│  FIX UI Client  │     │  FIX UI Client  │     │    Frontend     │
-│    (Port 5002)  │     │    (Port 5003)  │     │   (Port 5000)   │
-└────────┬────────┘     └────────┬────────┘     └────────┬────────┘
-         │                       │                       │
-         │ FIX 4.4               │ FIX 4.4               │ HTTP
-         ▼                       ▼                       ▼
-┌────────────────────────────────────────────────────────────────┐
-│                      FIX OEG (Port 5001)                       │
-│                   QuickFIX Order Entry Gateway                 │
-└────────────────────────────────┬───────────────────────────────┘
-                                 │
-                                 ▼ Kafka [orders]
-┌────────────────────────────────────────────────────────────────┐
-│                    Apache Kafka (Port 9092)                    │
-│              Topics: orders, trades, snapshots                 │
-└───────┬────────────────────┬───────────────────────┬───────────┘
-        │                    │                       │
-        ▼                    ▼                       ▼
-┌───────────────┐    ┌───────────────┐      ┌───────────────┐
-│    Matcher    │    │  MD Feeder    │      │   Dashboard   │
-│  (Port 6000)  │    │   (MDF)       │      │  (Port 5005)  │
-│               │    │               │      │               │
-│ Order Book    │    │ Price Sim     │      │ Web UI + SSE  │
-│ Trade Match   │    │ BBO Publish   │      │ Real-time     │
-└───────────────┘    └───────────────┘      └───────────────┘
-```
-### Component Summary
-| Component | Technology | Port | Function |
-|-----------|------------|------|----------|
-| Zookeeper | Confluent 7.5.0 | 2181 | Kafka coordination |
-| Kafka | Confluent 7.5.0 | 9092, 29092 | Message streaming |
-| FIX OEG | QuickFIX/Python | 5001 | FIX protocol gateway |
-| Matcher | Python/Flask/SQLite | 6000 | Order matching engine |
-| MDF | Python | - | Market data simulation |
-| Dashboard | Flask/SSE | 5005 | Real-time web UI |
-| Frontend | Flask | 5000 | Manual order entry |
-| FIX Clients | QuickFIX/Flask | 5002, 5003 | FIX order UI |
----
-## 3. Module Descriptions
-### 3.1 Zookeeper
-**Port:** 2181
-Apache Zookeeper provides distributed coordination for the Kafka cluster. It manages broker metadata, topic configurations, and cluster membership.
-- **Image:** confluentinc/cp-zookeeper:7.5.0
-- **Dependencies:** None
-- **Environment:** `ZOOKEEPER_CLIENT_PORT=2181`
----
-### 3.2 Apache Kafka
-**Ports:** 9092 (internal), 29092 (host access)
-Apache Kafka serves as the central message backbone for the entire trading system. All order flow, trade executions, and market data are distributed through Kafka topics.
-- **Image:** confluentinc/cp-kafka:7.5.0
-- **Dependencies:** Zookeeper
-**Topics:**
-| Topic | Purpose | Producers | Consumers |
-|-------|---------|-----------|-----------|
-| `orders` | Order flow | FIX OEG, MDF, Frontend | Matcher, Dashboard |
-| `trades` | Executed trades | Matcher | Dashboard, Consumer |
-| `snapshots` | BBO updates | MDF | Dashboard, Snapshot Viewer |
----
-### 3.3 FIX Order Entry Gateway (FIX OEG)
-**Port:** 5001
-The FIX OEG is a QuickFIX/Python acceptor that receives orders via FIX 4.4 protocol from institutional clients. It validates incoming FIX messages, normalizes them to JSON format, and publishes to the Kafka `orders` topic.
-**Supported FIX Messages:**
-| Message Type | Tag 35 | Description |
-|--------------|--------|-------------|
-| NewOrderSingle | D | New order submission |
-| OrderCancelRequest | F | Cancel existing order |
-| OrderCancelReplaceRequest | G | Modify existing order |
-**Key Functions:**
-- FIX session management (logon, heartbeat, logout)
-- Message validation and normalization
-- Order ID generation
-- Kafka publishing
----
-### 3.4 FIX UI Clients
-**Ports:** 5002 (Client 1), 5003 (Client 2)
-Web-based FIX initiator clients that connect to the FIX OEG. They provide a user interface for submitting orders via FIX protocol, simulating institutional trading terminals.
-**Features:**
-- New Order Single submission
-- Order cancellation
-- Order amendment
-- Real-time execution reports
-**Configuration Files:**
-- `client1.cfg` — FIX session config for Client 1
-- `client2.cfg` — FIX session config for Client 2
----
-### 3.5 Matcher (Order Matching Engine)
-**Port:** 6000
-The core matching engine that maintains order books for all securities. It consumes orders from Kafka, attempts to match them using price-time priority, and publishes resulting trades.
-**Matching Algorithm:** Price-Time Priority (FIFO)
-- Buy orders sorted by price descending (highest first)
-- Sell orders sorted by price ascending (lowest first)
-- Within same price level, earlier orders have priority
-**Persistence:** SQLite database (`/app/data/matcher.db`)
-- Order book survives container restarts
-- Volume-mapped for data durability
-**REST API Endpoints:**
-| Endpoint | Method | Description |
-|----------|--------|-------------|
-| `/orderbook/<symbol>` | GET | Get order book depth for symbol |
-| `/trades` | GET | Get recent trades |
-| `/health` | GET | Health check with statistics |
-**Order Book Response Example:**
-```json
-{
-  "symbol": "ALPHA",
-  "bids": [
-    {"price": 25.45, "quantity": 100, "cl_ord_id": "MDF-123"},
-    {"price": 25.40, "quantity": 200, "cl_ord_id": "MDF-124"}
-  ],
-  "asks": [
-    {"price": 25.55, "quantity": 150, "cl_ord_id": "MDF-125"},
-    {"price": 25.60, "quantity": 100, "cl_ord_id": "MDF-126"}
-  ]
-}
-```
----
-### 3.6 Market Data Feeder (MDF)
-**Port:** Internal only
-Simulates market data by generating random orders and publishing Best Bid/Offer (BBO) snapshots. Creates realistic market activity with configurable order rates and price movements.
-**Order Generation:**
-- **90% Passive Orders** — Placed away from mid price to build order book
-- **10% Aggressive Orders** — Cross the spread to generate trades
-**Price Simulation:**
-- Small random drift (±2 ticks) with 10% probability
-- Prices bounded by minimum (1.00)
-- Half spread: 0.10 (10 cents)
-**Output:**
-- Orders → Kafka `orders` topic
-- Snapshots → Kafka `snapshots` topic
-**Configuration:**
-| Variable | Default | Description |
-|----------|---------|-------------|
-| `ORDERS_PER_MIN` | 8 | Order generation rate |
-| `TICK_SIZE` | 0.05 | Minimum price increment |
----
-### 3.7 Dashboard
-**Port:** 5005
-Real-time web dashboard providing comprehensive market visualization. Uses Server-Sent Events (SSE) for live streaming updates without page refresh.
-**Technology Stack:**
-- Backend: Python/Flask
-- Frontend: HTML5/CSS3/JavaScript
-- Streaming: Server-Sent Events (SSE)
-- Data: Kafka consumer + REST API calls to Matcher
-**Features:**
-| Panel | Description |
-|-------|-------------|
-| Orders | Live order feed with Edit/Cancel actions |
-| Market Snapshot | BBO table with scrolling ticker tape |
-| Trades | Executed trades with value calculation |
-| Order Book | Depth of book per symbol |
-| Trade Chart | Price line + volume bars visualization |
-| Trading Statistics | Aggregated metrics with bar charts |
-**SSE Events:**
-| Event | Data | Trigger |
-|-------|------|---------|
-| `connected` | Status | Initial connection |
-| `init` | Full state | On connect |
-| `order` | Order JSON | New order received |
-| `trade` | Trade JSON | Trade executed |
-| `snapshot` | BBO JSON | Price update |
----
-### 3.8 Frontend (Manual Order Entry)
-**Port:** 5000
-Simple web interface for manual order submission. Allows users to enter orders directly without FIX protocol.
-**Features:**
-- Symbol selection dropdown
-- Side selection (BUY/SELL)
-- Price and quantity input
-- Submit order to Kafka
----
-### 3.9 Consumer (Debug Utility)
-**Port:** Internal only
-Debug utility that consumes and logs messages from Kafka `trades` topic. Outputs trade information to console for monitoring.
-**Output Format:**
-```
-TRADE: ALPHA - 100 @ 25.50
-TRADE: EXAE - 50 @ 42.10
-```
----
-### 3.10 Snapshot Viewer
-**Port:** Internal only
-Utility service that subscribes to the `snapshots` topic and logs BBO updates. Writes to log files in `/app/logs` for analysis.
----
-## 4. Dashboard User Interface
-### 4.1 Orders Panel
-Displays real-time incoming orders with full management capabilities.
-| Column | Description |
-|--------|-------------|
-| Symbol | Stock ticker (ALPHA, EXAE, PEIR, QUEST) |
-| Side | BUY (green) or SELL (red) |
-| Qty | Order quantity in shares |
-| Price | Limit price |
-| Source | Order origin (MDF, FIX, Manual) |
-| Time | Order timestamp |
-| Actions | Edit / Cancel buttons |
-**Order Actions:**
-- **Edit** — Opens modal to modify quantity and/or price (sends amend to Kafka)
-- **Cancel** — Sends cancel request to Kafka
-- **Row Selection** — Click row to select, use header buttons for actions
----
-### 4.2 Market Snapshot
-Shows Best Bid/Offer (BBO) for all securities with real-time updates.
-| Column | Description |
-|--------|-------------|
-| Symbol | Security identifier |
-| Best Bid | Highest buy price (green) |
-| Best Ask | Lowest sell price (red) |
-| Spread | Ask - Bid difference |
-| Mid | Midpoint: (Bid + Ask) / 2 |
-| Updated | Last update timestamp |
-**Ticker Tape:**
-- Scrolling bar at bottom shows recent trades
-- ▲ Green: Price up from previous
-- ▼ Red: Price down from previous
-- ● Yellow: No change
-- Hover to pause scrolling
----
-### 4.3 Trades Panel
-Lists all executed trades with calculated values.
-| Column | Description |
-|--------|-------------|
-| Symbol | Traded security |
-| Qty | Executed quantity |
-| Price | Execution price |
-| Value | Trade value (Qty × Price) |
-| Time | Execution timestamp |
----
-### 4.4 Order Book
-Displays full market depth for selected symbol.
-**Controls:**
-- **Symbol Dropdown** — Select security to view
-- **Refresh Button** — Manual refresh (auto-refreshes every 3 seconds)
-**Display:**
-- **Left Side:** Bid Qty | Bid Price (green, sorted price descending)
-- **Right Side:** Ask Price | Ask Qty (red, sorted price ascending)
-- **Header:** Shows count of bids and asks
----
-### 4.5 Trade Chart
-Visual representation of trade activity over time.
-**Elements:**
-- **Green Line** — Price trend connecting trade execution prices
-- **Blue Bars** — Volume per trade
-- **Y-Axis** — Price scale
-- **X-Axis** — Trade sequence (last 100 trades)
-**Controls:**
-- Symbol dropdown to filter by security or view all
----
-### 4.6 Trading Statistics
-Aggregated metrics calculated from all trades.
-| Metric | Description | Formula |
-|--------|-------------|---------|
-| Trades | Count of executed trades | COUNT(*) |
-| Volume | Total shares traded | Σ Quantity |
-| Value | Total monetary value | Σ (Qty × Price) |
-| Start | First trade price | First price in session |
-| Last | Most recent price | Latest price |
-| VWAP | Volume-Weighted Average Price | Σ(Qty × Price) / Σ Qty |
-**Bar Charts:**
-- Grouped by symbol showing Volume (green) and Value (blue) side by side
-- Normalized to maximum value in dataset
----
-## 5. Data Flow & Messaging
-### 5.1 Order Entry Flow
-```
-   ┌──────────────┐
-   │  FIX Client  │
-   └──────┬───────┘
-          │ FIX 4.4 NewOrderSingle (35=D)
-          ▼
-   ┌──────────────┐
-   │   FIX OEG    │  Validate → Normalize → Generate cl_ord_id
-   └──────┬───────┘
-          │ JSON
-          ▼
-   ┌──────────────┐
-   │    Kafka     │  Topic: orders
-   │   [orders]   │
-   └──────┬───────┘
-          │
-    ┌─────┴─────┐
-    ▼           ▼
-┌────────┐  ┌───────────┐
-│Matcher │  │ Dashboard │
-└────────┘  └───────────┘
-```
-### 5.2 Order Matching Flow
-```
-                    ┌─────────────────┐
-                    │  Incoming Order │
-                    │   (from Kafka)  │
-                    └────────┬────────┘
-                             │
-                             ▼
-                    ┌─────────────────┐
-                    │  Parse & Validate│
-                    └────────┬────────┘
-                             │
-              ┌──────────────┴──────────────┐
-              ▼                             ▼
-       ┌────────────┐                ┌────────────┐
-       │  BUY Order │                │ SELL Order │
-       └──────┬─────┘                └──────┬─────┘
-              │                             │
-              ▼                             ▼
-    ┌──────────────────┐         ┌──────────────────┐
-    │ Check SELL book  │         │ Check BUY book   │
-    │ for price ≤ bid  │         │ for price ≥ ask  │
-    └────────┬─────────┘         └────────┬─────────┘
-             │                            │
-      ┌──────┴──────┐              ┌──────┴──────┐
-      ▼             ▼              ▼             ▼
-  ┌───────┐    ┌────────┐     ┌───────┐    ┌────────┐
-  │ Match │    │No Match│     │ Match │    │No Match│
-  │ Found │    │        │     │ Found │    │        │
-  └───┬───┘    └───┬────┘     └───┬───┘    └───┬────┘
-      │            │              │            │
-      ▼            ▼              ▼            ▼
-  ┌───────┐    ┌────────┐     ┌───────┐    ┌────────┐
-  │Execute│    │Add to  │     │Execute│    │Add to  │
-  │ Trade │    │BUY Book│     │ Trade │    │SELLBook│
-  └───┬───┘    └────────┘     └───┬───┘    └────────┘
-      │                           │
-      └───────────┬───────────────┘
-                  ▼
-           ┌────────────┐
-           │Kafka:trades│
-           └────────────┘
-```
-### 5.3 Real-time Dashboard Flow
-```
-┌─────────────────────────────────────────────────────────────────┐
-│                         BROWSER                                 │
-│  ┌─────────────────────────────────────────────────────────┐   │
-│  │                    Dashboard UI                          │   │
-│  │  ┌─────────┐ ┌─────────┐ ┌─────────┐ ┌─────────────────┐│   │
-│  │  │ Orders  │ │ Trades  │ │  Book   │ │    Statistics   ││   │
-│  │  └────▲────┘ └────▲────┘ └────▲────┘ └────────▲────────┘│   │
-│  └───────┼───────────┼───────────┼───────────────┼──────────┘   │
-│          └───────────┴─────┬─────┴───────────────┘              │
-│                    ┌───────▼────────┐                          │
-│                    │ EventSource    │  SSE Connection          │
-│                    │ /stream        │                          │
-│                    └───────┬────────┘                          │
-└────────────────────────────┼────────────────────────────────────┘
-                             │ HTTP (SSE)
-                             ▼
-┌────────────────────────────────────────────────────────────────┐
-│                      DASHBOARD SERVER                          ��
-│   ┌──────────────┐      ┌──────────────┐     ┌────────────┐   │
-│   │Kafka Consumer│─────▶│ SSE Broadcast│────▶│  Clients   │   │
-│   │ (orders,     │      │   Queue      │     │  Queue[]   │   │
-│   │  trades,     │      └──────────────┘     └────────────┘   │
-│   │  snapshots)  │                                            │
-│   └──────────────┘                                            │
-└────────────────────────────────────────────────────────────────┘
-```
-### 5.4 Complete System Interaction
-```
-          ┌─────────┐ ┌─────────┐ ┌─────────┐
-          │FIX Cli 1│ │FIX Cli 2│ │Frontend │
-          └────┬────┘ └────┬────┘ └────┬────┘
-               └─────┬─────┴───────────┘
-                     ▼
-              ┌─────────────┐
-              │   FIX OEG   │◄──── FIX 4.4 Protocol
-              └──────┬──────┘
-                     ▼
-    ┌────────────────────────────────────┐
-    │            KAFKA CLUSTER           │
-    │  ┌────────┐┌────────┐┌──────────┐ │
-    │  │orders  ││trades  ││snapshots │ │
-    │  └───┬────┘└───▲────┘└────▲─────┘ │
-    └──────┼─────────┼──────────┼───────┘
-           │         │          │
-     ┌─────┼─────────┼──────────┼─────┐
-     │     ▼         │          │     │
-     │ ┌────────┐    │          │     │
-     │ │MATCHER │────┘          │     │
-     │ │ Book   │               │     │
-     │ │ Match  │               │     │
-     │ └────────┘               │     │
-     │     ▲                    │     │
-     │     │ REST               │     │
-     │ ┌───┴────────────────────┴──┐  │
-     │ │        DASHBOARD          │  │
-     │ │   (SSE + Kafka Consumer)  │  │
-     │ └───────────────────────────┘  │
-     │ ┌───────────────────────────┐  │
-     │ │      MD FEEDER (MDF)      │──┘
-     │ │   Orders + Snapshots      │
-     │ └───────────────────────────┘
-     └────────────────────────────────┘
-```
-### 5.5 Message Sequence: New Order to Trade
-```
-FIX Client    FIX OEG      Kafka       Matcher     Dashboard
-    │            │           │            │            │
-    │──35=D────▶│            │            │            │
-    │NewOrder   │            │            │            │
-    │           │──JSON────▶│            │            │
-    │           │  [orders] │            │            │
-    │           │           │──consume──▶│            │
-    │           │           │            │──match()   │
-    │           │           │◀──trade────│            │
-    │           │           │  [trades]  │            │
-    │           │           │──────────────consume───▶│
-    │           │           │            │     render()
-```
----
-### 5.6 Message Formats
-**Order Message:**
-```json
-{
-  "symbol": "ALPHA",
-  "side": "BUY",
-  "price": 25.50,
-  "quantity": 100,
-  "cl_ord_id": "MDF-1234567890-1",
-  "timestamp": 1234567890.123,
-  "source": "MDF"
-}
-```
-**Cancel Message:**
-```json
-{
-  "type": "cancel",
-  "orig_cl_ord_id": "MDF-1234567890-1",
-  "symbol": "ALPHA",
-  "timestamp": 1234567890.456
-}
-```
-**Amend Message:**
-```json
-{
-  "type": "amend",
-  "orig_cl_ord_id": "MDF-1234567890-1",
-  "cl_ord_id": "amend-1234567890",
-  "symbol": "ALPHA",
-  "quantity": 150,
-  "price": 25.45,
-  "timestamp": 1234567890.789
-}
-```
-**Trade Message:**
-```json
-{
-  "symbol": "ALPHA",
-  "price": 25.50,
-  "quantity": 100,
-  "buy_order_id": "order-123",
-  "sell_order_id": "order-456",
-  "timestamp": 1234567890.123
-}
-```
-**Snapshot Message:**
-```json
-{
-  "symbol": "ALPHA",
-  "best_bid": 25.45,
-  "best_ask": 25.55,
-  "bid_size": 500,
-  "ask_size": 300,
-  "timestamp": 1234567890.123,
-  "source": "MDF"
-}
-```
----
-## 6. Configuration
-### 6.1 Environment Variables
-| Variable | Default | Description |
-|----------|---------|-------------|
-| `KAFKA_BOOTSTRAP` | kafka:9092 | Kafka broker address |
-| `MATCHER_URL` | http://matcher:6000 | Matcher API endpoint |
-| `TICK_SIZE` | 0.05 | Minimum price increment |
-| `ORDERS_PER_MIN` | 8 | MDF order generation rate |
-| `SECURITIES_FILE` | /app/data/securities.txt | Securities configuration |
-| `KAFKA_RETRIES` | 30 | Connection retry attempts |
-| `KAFKA_RETRY_DELAY` | 2 | Seconds between retries |
-### 6.2 Securities Configuration
-File: `shared_data/securities.txt`
-```
-#SYMBOL	<start_price>	<current_price>
-ALPHA	25.00	25.00
-PEIR	18.50	18.50
-EXAE	42.00	42.00
-QUEST	12.75	12.75
-```
-| Symbol | Start Price | Description |
-|--------|-------------|-------------|
-| ALPHA | 25.00 | Test Security A |
-| EXAE | 42.00 | Test Security B |
-| PEIR | 18.50 | Test Security C |
-| QUEST | 12.75 | Test Security D |
-### 6.3 Docker Volumes
-| Volume | Path | Purpose |
-|--------|------|---------|
-| `matcher_data` | /app/data | SQLite database persistence |
-| `shared_data` | /app/data | Securities and order ID files |
-| `logs` | /app/logs | Snapshot viewer logs |
----
-## 7. Quick Reference
-### 7.1 Starting the System
-```bash
-# Start all services
-docker compose up --build
-# Start in background
-docker compose up -d --build
-# View logs
-docker compose logs -f dashboard
-docker compose logs -f matcher
-# Stop all services
-docker compose down
-# Reset matcher database
-docker volume rm stockex_matcher_data
-```
-### 7.2 Dashboard Actions
-| Action | How To |
-|--------|--------|
-| View order book depth | Select symbol from Order Book dropdown |
-| Edit an order | Click Edit button on order row |
-| Cancel an order | Click Cancel button on order row |
-| Filter trade chart | Select symbol from Trade Chart dropdown |
-| Pause ticker tape | Hover mouse over the ticker |
-| Select order row | Click on the row |
-| Bulk actions | Select row, use header Edit/Cancel buttons |
-### 7.3 Connection Status
-| Status | Indicator | Meaning |
-|--------|-----------|---------|
-| Live | ● Green | Connected to SSE stream |
-| Connecting | ● Yellow | Establishing connection |
-| Disconnected | ● Red | Connection lost, auto-reconnecting |
-### 7.4 API Endpoints
-**Matcher API (Port 6000):**
-| Endpoint | Method | Description |
-|----------|--------|-------------|
-| `/orderbook/<symbol>` | GET | Order book for symbol |
-| `/trades` | GET | Recent trades list |
-| `/health` | GET | Service health status |
-**Dashboard API (Port 5005):**
-| Endpoint | Method | Description |
-|----------|--------|-------------|
-| `/` | GET | Main dashboard page |
-| `/data` | GET | Current state (polling fallback) |
-| `/stream` | GET | SSE event stream |
-| `/orderbook/<symbol>` | GET | Proxy to matcher |
-| `/order/cancel` | POST | Cancel order request |
-| `/order/amend` | POST | Amend order request |
----
-## 8. Troubleshooting
-### Orders/Trades Panel Empty
-1. Check Kafka connection:
-   ```bash
-   docker logs dashboard | grep "Kafka"
-   ```
-2. Verify MDF is producing:
-   ```bash
-   docker logs stockex-md_feeder-1 --tail 10
-   ```
-3. Restart dashboard:
-   ```bash
-   docker restart dashboard
-   ```
-### Order Book Empty
-1. Check matcher is receiving orders:
-   ```bash
-   docker logs matcher | grep "received"
-   ```
-2. Verify matcher Kafka consumer connected:
-   ```bash
-   docker logs matcher | grep "consumer connected"
-   ```
-3. Reset matcher database if corrupted:
-   ```bash
-   docker compose down
-   docker volume rm stockex_matcher_data
-   docker compose up -d
-   ```
-### Connection Status Shows Disconnected
-1. SSE stream timeout — will auto-reconnect after 3 seconds
-2. Check dashboard container is running:
-   ```bash
-   docker ps | grep dashboard
-   ```
-3. Check browser console for errors (F12)
-### Prices Going Negative or Extreme
-1. Old bug in MDF — update to latest version
-2. Reset securities file:
-   ```
-   #SYMBOL	<start_price>	<current_price>
-   ALPHA	25.00	25.00
-   PEIR	18.50	18.50
-   EXAE	42.00	42.00
-   QUEST	12.75	12.75
-   ```
-3. Restart MDF and matcher:
-   ```bash
-   docker restart stockex-md_feeder-1 matcher
-   ```
----
-## Document Information
-- **Version:** 1.0
-- **Platform:** StockEx Trading Simulation
-- **Inspired by:** Euronext OPTIQ
----
-*StockEx v1.0 — Trading Simulation Platform*

StockEx_User_Guide.html DELETED Viewed

@@ -1,428 +0,0 @@
-<!DOCTYPE html>
-<html>
-<head>
-  <meta charset="utf-8">
-  <title>StockEx User Guide</title>
-  <style>
-    @page { margin: 2cm; }
-    body { font-family: Arial, sans-serif; max-width: 900px; margin: 0 auto; padding: 20px; line-height: 1.6; color: #333; }
-    h1 { color: #1a1a2e; border-bottom: 3px solid #4CAF50; padding-bottom: 10px; }
-    h2 { color: #2e7d32; margin-top: 30px; border-bottom: 1px solid #ddd; padding-bottom: 5px; page-break-after: avoid; }
-    h3 { color: #1565c0; margin-top: 20px; }
-    h4 { color: #555; margin-top: 15px; }
-    table { width: 100%; border-collapse: collapse; margin: 15px 0; font-size: 14px; }
-    th, td { border: 1px solid #ddd; padding: 10px; text-align: left; }
-    th { background: #f5f5f5; font-weight: bold; }
-    .header { text-align: center; margin-bottom: 30px; }
-    .subtitle { color: #666; font-size: 18px; }
-    .section { page-break-inside: avoid; margin-bottom: 25px; }
-    .highlight { background: #e8f5e9; padding: 15px; border-radius: 5px; margin: 10px 0; border-left: 4px solid #4CAF50; }
-    .info { background: #e3f2fd; padding: 15px; border-radius: 5px; margin: 10px 0; border-left: 4px solid #2196F3; }
-    .warning { background: #fff3e0; padding: 15px; border-radius: 5px; margin: 10px 0; border-left: 4px solid #ff9800; }
-    .green { color: #2e7d32; }
-    .red { color: #c62828; }
-    .blue { color: #1565c0; }
-    .screenshot { text-align: center; margin: 20px 0; }
-    .screenshot img { max-width: 100%; border: 1px solid #ddd; border-radius: 5px; box-shadow: 0 2px 8px rgba(0,0,0,0.1); }
-    hr { border: none; border-top: 1px solid #ddd; margin: 30px 0; }
-    .footer { text-align: center; color: #666; font-size: 12px; margin-top: 40px; padding-top: 20px; border-top: 1px solid #ddd; }
-    .toc { background: #fafafa; padding: 20px; border-radius: 5px; margin: 20px 0; }
-    .toc ul { margin: 0; padding-left: 20px; }
-    .toc li { margin: 5px 0; }
-    .arch-diagram { background: #f5f5f5; padding: 20px; border-radius: 5px; font-family: monospace; white-space: pre; font-size: 12px; overflow-x: auto; }
-    code { background: #f5f5f5; padding: 2px 6px; border-radius: 3px; font-family: monospace; }
-    .module-box { border: 1px solid #ddd; border-radius: 8px; padding: 15px; margin: 15px 0; background: #fafafa; }
-    .module-box h4 { margin-top: 0; color: #1a1a2e; }
-    .port { display: inline-block; background: #e3f2fd; padding: 2px 8px; border-radius: 3px; font-family: monospace; font-size: 12px; }
-  </style>
-</head>
-<body>
-<div class="header">
-  <h1>StockEx Trading Dashboard</h1>
-  <p class="subtitle">Complete User & Technical Guide v1.0</p>
-</div>
-<div class="toc">
-  <strong>Table of Contents</strong>
-  <ul>
-    <li>1. Introduction</li>
-    <li>2. System Architecture</li>
-    <li>3. Module Descriptions</li>
-    <li>4. Dashboard User Interface</li>
-    <li>5. Data Flow & Messaging</li>
-    <li>6. Configuration</li>
-    <li>7. Quick Reference</li>
-  </ul>
-</div>
-<hr>
-<div class="section">
-  <h2>1. Introduction</h2>
-  <p><strong>StockEx</strong> is a comprehensive real-time trading simulation platform inspired by Euronext OPTIQ. It provides a complete electronic trading ecosystem including order entry, matching engine, market data distribution, and live visualization.</p>
-  <div class="highlight">
-    <strong>Key Features:</strong>
-    <ul>
-      <li>FIX 4.4 protocol support for institutional order entry</li>
-      <li>Real-time order matching with price-time priority</li>
-      <li>Live market data streaming via Kafka</li>
-      <li>Web-based dashboard with Server-Sent Events (SSE)</li>
-      <li>Order management (Edit/Cancel) capabilities</li>
-      <li>Trading analytics and statistics</li>
-    </ul>
-  </div>
-  <div class="info">
-    <strong>Access URLs:</strong><br>
-    Dashboard: <code>http://localhost:5005</code><br>
-    Frontend (Order Entry): <code>http://localhost:5000</code><br>
-    FIX Gateway: <code>localhost:5001</code><br>
-    Matcher API: <code>http://localhost:6000</code>
-  </div>
-</div>
-<div class="screenshot">
-  <img src="screenshots/dashboard.png" alt="Trading Dashboard">
-  <p><em>StockEx Trading Dashboard - Real-time Market View</em></p>
-</div>
-<div class="section">
-  <h2>2. System Architecture</h2>
-  <div class="arch-diagram">
-┌─────────────────┐     ┌─────────────────┐     ┌─────────────────┐
-│  FIX UI Client  │     │  FIX UI Client  │     │    Frontend     │
-│    (Port 5002)  │     │    (Port 5003)  │     │   (Port 5000)   │
-└────────┬────────┘     └────────┬────────┘     └────────┬────────┘
-         │                       │                       │
-         │ FIX 4.4               │ FIX 4.4               │ HTTP
-         ▼                       ▼                       ▼
-┌─��──────────────────────────────────────────────────────────────┐
-│                      FIX OEG (Port 5001)                       │
-│                   QuickFIX Order Entry Gateway                 │
-└────────────────────────────────┬───────────────────────────────┘
-                                 │
-                                 ▼ Kafka [orders]
-┌────────────────────────────────────────────────────────────────┐
-│                    Apache Kafka (Port 9092)                    │
-│              Topics: orders, trades, snapshots                 │
-└───────┬────────────────────┬───────────────────────┬───────────┘
-        │                    │                       │
-        ▼                    ▼                       ▼
-┌───────────────┐    ┌───────────────┐      ┌───────────────┐
-│    Matcher    │    │  MD Feeder    │      │   Dashboard   │
-│  (Port 6000)  │    │   (MDF)       │      │  (Port 5005)  │
-│               │    │               │      │               │
-│ Order Book    │    │ Price Sim     │      │ Web UI + SSE  │
-│ Trade Match   │    │ BBO Publish   │      │ Real-time     │
-└───────────────┘    └───────────────┘      └───────────────┘
-  </div>
-</div>
-<div class="section">
-  <h2>3. Module Descriptions</h2>
-  <div class="module-box">
-    <h4>Zookeeper</h4>
-    <p><span class="port">Port 2181</span></p>
-    <p>Apache Zookeeper provides distributed coordination for the Kafka cluster. It manages broker metadata, topic configurations, and cluster membership.</p>
-    <table>
-      <tr><th>Function</th><td>Kafka cluster coordination</td></tr>
-      <tr><th>Technology</th><td>Confluent Zookeeper 7.5.0</td></tr>
-      <tr><th>Dependencies</th><td>None</td></tr>
-    </table>
-  </div>
-  <div class="module-box">
-    <h4>Kafka Message Broker</h4>
-    <p><span class="port">Port 9092</span> <span class="port">Port 29092 (host)</span></p>
-    <p>Apache Kafka serves as the central message backbone for the entire system. All order flow, trade executions, and market data are distributed through Kafka topics.</p>
-    <table>
-      <tr><th>Function</th><td>Message streaming and event distribution</td></tr>
-      <tr><th>Technology</th><td>Confluent Kafka 7.5.0</td></tr>
-      <tr><th>Topics</th><td><code>orders</code>, <code>trades</code>, <code>snapshots</code></td></tr>
-      <tr><th>Dependencies</th><td>Zookeeper</td></tr>
-    </table>
-  </div>
-  <div class="module-box">
-    <h4>FIX Order Entry Gateway (FIX OEG)</h4>
-    <p><span class="port">Port 5001</span></p>
-    <p>The FIX OEG is a QuickFIX/Python acceptor that receives orders via FIX 4.4 protocol from institutional clients. It validates incoming messages, normalizes them to JSON format, and publishes to the Kafka <code>orders</code> topic.</p>
-    <table>
-      <tr><th>Function</th><td>FIX protocol order reception and normalization</td></tr>
-      <tr><th>Technology</th><td>QuickFIX/Python</td></tr>
-      <tr><th>Protocol</th><td>FIX 4.4</td></tr>
-      <tr><th>Message Types</th><td>NewOrderSingle (D), OrderCancelRequest (F), OrderCancelReplaceRequest (G)</td></tr>
-      <tr><th>Output</th><td>Kafka <code>orders</code> topic</td></tr>
-    </table>
-  </div>
-  <div class="module-box">
-    <h4>FIX UI Clients</h4>
-    <p><span class="port">Port 5002 (Client 1)</span> <span class="port">Port 5003 (Client 2)</span></p>
-    <p>Web-based FIX initiator clients that connect to the FIX OEG. They provide a user interface for submitting orders via FIX protocol, simulating institutional trading terminals.</p>
-    <table>
-      <tr><th>Function</th><td>FIX order submission interface</td></tr>
-      <tr><th>Technology</th><td>QuickFIX/Python + Flask</td></tr>
-      <tr><th>Features</th><td>New Order, Cancel, Amend</td></tr>
-      <tr><th>Connection</th><td>FIX 4.4 to FIX OEG</td></tr>
-    </table>
-  </div>
-  <div class="module-box">
-    <h4>Matcher (Order Matching Engine)</h4>
-    <p><span class="port">Port 6000</span></p>
-    <p>The core matching engine that maintains order books for all securities. It consumes orders from Kafka, attempts to match them using price-time priority, and publishes resulting trades. Provides REST API for order book and trade queries.</p>
-    <table>
-      <tr><th>Function</th><td>Order matching, trade execution, order book management</td></tr>
-      <tr><th>Technology</th><td>Python/Flask with SQLite persistence</td></tr>
-      <tr><th>Algorithm</th><td>Price-Time Priority (FIFO)</td></tr>
-      <tr><th>Input</th><td>Kafka <code>orders</code> topic</td></tr>
-      <tr><th>Output</th><td>Kafka <code>trades</code> topic</td></tr>
-      <tr><th>API Endpoints</th><td><code>/orderbook/&lt;symbol&gt;</code>, <code>/trades</code>, <code>/health</code></td></tr>
-    </table>
-  </div>
-  <div class="module-box">
-    <h4>Market Data Feeder (MDF)</h4>
-    <p><span class="port">Internal</span></p>
-    <p>Simulates market data by generating random orders and publishing Best Bid/Offer (BBO) snapshots. Creates realistic market activity with configurable order rates and price movements.</p>
-    <table>
-      <tr><th>Function</th><td>Market simulation and BBO publishing</td></tr>
-      <tr><th>Technology</th><td>Python</td></tr>
-      <tr><th>Output</th><td>Kafka <code>orders</code> and <code>snapshots</code> topics</td></tr>
-      <tr><th>Order Mix</th><td>90% passive (book building), 10% aggressive (trades)</td></tr>
-      <tr><th>Rate</th><td>Configurable (default: 8 orders/minute)</td></tr>
-    </table>
-  </div>
-  <div class="module-box">
-    <h4>Dashboard</h4>
-    <p><span class="port">Port 5005</span></p>
-    <p>Real-time web dashboard providing comprehensive market visualization. Uses Server-Sent Events (SSE) for live streaming updates without page refresh. Displays orders, trades, market snapshots, order book depth, and trading statistics.</p>
-    <table>
-      <tr><th>Function</th><td>Real-time market visualization and order management</td></tr>
-      <tr><th>Technology</th><td>Python/Flask + JavaScript</td></tr>
-      <tr><th>Streaming</th><td>Server-Sent Events (SSE)</td></tr>
-      <tr><th>Input</th><td>Kafka topics + Matcher REST API</td></tr>
-      <tr><th>Features</th><td>Orders, Trades, BBO, Order Book, Charts, Statistics</td></tr>
-    </table>
-  </div>
-  <div class="module-box">
-    <h4>Frontend (Manual Order Entry)</h4>
-    <p><span class="port">Port 5000</span></p>
-    <p>Simple web interface for manual order submission. Allows users to enter orders directly without FIX protocol, useful for testing and demonstration.</p>
-    <table>
-      <tr><th>Function</th><td>Manual order entry interface</td></tr>
-      <tr><th>Technology</th><td>Python/Flask</td></tr>
-      <tr><th>Output</th><td>Kafka <code>orders</code> topic</td></tr>
-    </table>
-  </div>
-  <div class="module-box">
-    <h4>Consumer (Debug)</h4>
-    <p><span class="port">Internal</span></p>
-    <p>Debug utility that consumes and logs messages from Kafka topics. Useful for monitoring message flow and troubleshooting.</p>
-  </div>
-  <div class="module-box">
-    <h4>Snapshot Viewer</h4>
-    <p><span class="port">Internal</span></p>
-    <p>Utility service that subscribes to the <code>snapshots</code> topic and logs BBO updates. Writes to log files for analysis.</p>
-  </div>
-</div>
-<div class="section">
-  <h2>4. Dashboard User Interface</h2>
-  <h3>4.1 Orders Panel</h3>
-  <p>Displays real-time incoming orders with full management capabilities.</p>
-  <table>
-    <tr><th>Column</th><th>Description</th></tr>
-    <tr><td>Symbol</td><td>Stock ticker (ALPHA, EXAE, PEIR, QUEST)</td></tr>
-    <tr><td>Side</td><td><span class="green">BUY</span> (green) or <span class="red">SELL</span> (red)</td></tr>
-    <tr><td>Qty</td><td>Order quantity in shares</td></tr>
-    <tr><td>Price</td><td>Limit price</td></tr>
-    <tr><td>Source</td><td>Order origin (MDF, FIX, Manual)</td></tr>
-    <tr><td>Time</td><td>Order timestamp</td></tr>
-    <tr><td>Actions</td><td><span class="blue">Edit</span> / <span class="red">Cancel</span> buttons</td></tr>
-  </table>
-  <p><strong>Row Selection:</strong> Click any row to select, then use header buttons for bulk actions.</p>
-  <h3>4.2 Market Snapshot</h3>
-  <p>Shows Best Bid/Offer (BBO) for all securities with real-time updates.</p>
-  <table>
-    <tr><th>Column</th><th>Description</th></tr>
-    <tr><td>Symbol</td><td>Security identifier</td></tr>
-    <tr><td>Best Bid</td><td>Highest buy price <span class="green">(green)</span></td></tr>
-    <tr><td>Best Ask</td><td>Lowest sell price <span class="red">(red)</span></td></tr>
-    <tr><td>Spread</td><td>Ask - Bid difference</td></tr>
-    <tr><td>Mid</td><td>Midpoint: (Bid + Ask) / 2</td></tr>
-    <tr><td>Updated</td><td>Last update timestamp</td></tr>
-  </table>
-  <p><strong>Ticker Tape:</strong> Scrolling bar at bottom displays recent trades with price direction (▲ green up, ▼ red down).</p>
-  <h3>4.3 Trades Panel</h3>
-  <p>Lists all executed trades with calculated values.</p>
-  <table>
-    <tr><th>Column</th><th>Description</th></tr>
-    <tr><td>Symbol</td><td>Traded security</td></tr>
-    <tr><td>Qty</td><td>Executed quantity</td></tr>
-    <tr><td>Price</td><td>Execution price</td></tr>
-    <tr><td>Value</td><td>Trade value (Qty × Price)</td></tr>
-    <tr><td>Time</td><td>Execution timestamp</td></tr>
-  </table>
-  <h3>4.4 Order Book</h3>
-  <p>Displays full market depth for selected symbol.</p>
-  <ul>
-    <li>Select symbol from dropdown menu</li>
-    <li>Click <strong>Refresh</strong> to update (auto-refreshes every 3 seconds)</li>
-    <li><span class="green">Bid Qty / Bid Price</span> — Buy orders sorted by price (highest first)</li>
-    <li><span class="red">Ask Price / Ask Qty</span> — Sell orders sorted by price (lowest first)</li>
-    <li>Header shows total bid and ask counts</li>
-  </ul>
-  <h3>4.5 Trade Chart</h3>
-  <p>Visual representation of trade activity over time.</p>
-  <ul>
-    <li><span class="green">Green line</span> — Price trend connecting trade prices</li>
-    <li><span class="blue">Blue bars</span> — Volume per trade</li>
-    <li>Dropdown to filter by symbol or view all</li>
-    <li>Displays last 100 trades</li>
-  </ul>
-  <h3>4.6 Trading Statistics</h3>
-  <p>Aggregated metrics calculated from all trades.</p>
-  <table>
-    <tr><th>Metric</th><th>Description</th></tr>
-    <tr><td>Trades</td><td>Number of executed trades</td></tr>
-    <tr><td>Volume</td><td>Total shares traded</td></tr>
-    <tr><td>Value</td><td>Total monetary value (Σ Qty × Price)</td></tr>
-    <tr><td>Start</td><td>First trade price (opening)</td></tr>
-    <tr><td>Last</td><td>Most recent trade price</td></tr>
-    <tr><td>VWAP</td><td>Volume-Weighted Average Price</td></tr>
-  </table>
-  <p><strong>Bar Charts:</strong> Visual comparison showing <span class="green">Volume</span> and <span class="blue">Value</span> per symbol side by side.</p>
-</div>
-<div class="section">
-  <h2>5. Data Flow & Messaging</h2>
-  <h3>5.1 Kafka Topics</h3>
-  <table>
-    <tr><th>Topic</th><th>Producers</th><th>Consumers</th><th>Content</th></tr>
-    <tr><td><code>orders</code></td><td>FIX OEG, MDF, Frontend</td><td>Matcher, Dashboard</td><td>New orders, cancels, amends</td></tr>
-    <tr><td><code>trades</code></td><td>Matcher</td><td>Dashboard, Consumer</td><td>Executed trades</td></tr>
-    <tr><td><code>snapshots</code></td><td>MDF</td><td>Dashboard, Snapshot Viewer</td><td>BBO updates</td></tr>
-  </table>
-  <h3>5.2 Message Formats</h3>
-  <h4>Order Message</h4>
-  <div class="arch-diagram" style="font-size: 11px;">{
-  "symbol": "ALPHA",
-  "side": "BUY",
-  "price": 25.50,
-  "quantity": 100,
-  "cl_ord_id": "MDF-1234567890-1",
-  "timestamp": 1234567890.123,
-  "source": "MDF"
-}</div>
-  <h4>Trade Message</h4>
-  <div class="arch-diagram" style="font-size: 11px;">{
-  "symbol": "ALPHA",
-  "price": 25.50,
-  "quantity": 100,
-  "buy_order_id": "order-123",
-  "sell_order_id": "order-456",
-  "timestamp": 1234567890.123
-}</div>
-  <h4>Snapshot Message</h4>
-  <div class="arch-diagram" style="font-size: 11px;">{
-  "symbol": "ALPHA",
-  "best_bid": 25.45,
-  "best_ask": 25.55,
-  "bid_size": 500,
-  "ask_size": 300,
-  "timestamp": 1234567890.123,
-  "source": "MDF"
-}</div>
-</div>
-<div class="section">
-  <h2>6. Configuration</h2>
-  <table>
-    <tr><th>Variable</th><th>Default</th><th>Description</th></tr>
-    <tr><td><code>KAFKA_BOOTSTRAP</code></td><td>kafka:9092</td><td>Kafka broker address</td></tr>
-    <tr><td><code>MATCHER_URL</code></td><td>http://matcher:6000</td><td>Matcher API endpoint</td></tr>
-    <tr><td><code>TICK_SIZE</code></td><td>0.05</td><td>Minimum price increment</td></tr>
-    <tr><td><code>ORDERS_PER_MIN</code></td><td>8</td><td>MDF order generation rate</td></tr>
-    <tr><td><code>SECURITIES_FILE</code></td><td>/app/data/securities.txt</td><td>Securities configuration</td></tr>
-  </table>
-  <h3>6.1 Supported Securities</h3>
-  <table>
-    <tr><th>Symbol</th><th>Start Price</th><th>Description</th></tr>
-    <tr><td>ALPHA</td><td>25.00</td><td>Test Security A</td></tr>
-    <tr><td>EXAE</td><td>42.00</td><td>Test Security B</td></tr>
-    <tr><td>PEIR</td><td>18.50</td><td>Test Security C</td></tr>
-    <tr><td>QUEST</td><td>12.75</td><td>Test Security D</td></tr>
-  </table>
-</div>
-<div class="section">
-  <h2>7. Quick Reference</h2>
-  <h3>7.1 Starting the System</h3>
-  <div class="highlight">
-    <code>docker compose up --build</code>
-  </div>
-  <h3>7.2 Service URLs</h3>
-  <table>
-    <tr><th>Service</th><th>URL</th><th>Purpose</th></tr>
-    <tr><td>Dashboard</td><td>http://localhost:5005</td><td>Main trading view</td></tr>
-    <tr><td>Frontend</td><td>http://localhost:5000</td><td>Manual order entry</td></tr>
-    <tr><td>FIX Client 1</td><td>http://localhost:5002</td><td>FIX order submission</td></tr>
-    <tr><td>FIX Client 2</td><td>http://localhost:5003</td><td>FIX order submission</td></tr>
-    <tr><td>Matcher API</td><td>http://localhost:6000</td><td>REST API</td></tr>
-  </table>
-  <h3>7.3 Dashboard Actions</h3>
-  <table>
-    <tr><th>Action</th><th>How To</th></tr>
-    <tr><td>View order book depth</td><td>Select symbol from Order Book dropdown</td></tr>
-    <tr><td>Edit an order</td><td>Click <span class="blue">Edit</span> button on order row</td></tr>
-    <tr><td>Cancel an order</td><td>Click <span class="red">Cancel</span> button on order row</td></tr>
-    <tr><td>Filter trade chart</td><td>Select symbol from Trade Chart dropdown</td></tr>
-    <tr><td>Pause ticker tape</td><td>Hover mouse over the ticker</td></tr>
-    <tr><td>Select multiple orders</td><td>Click rows, use header Edit/Cancel buttons</td></tr>
-  </table>
-  <h3>7.4 Connection Status Indicators</h3>
-  <table>
-    <tr><th>Status</th><th>Indicator</th><th>Meaning</th></tr>
-    <tr><td>Live</td><td><span class="green">● Green</span></td><td>Connected to real-time stream</td></tr>
-    <tr><td>Connecting</td><td><span style="color:#ffc107;">● Yellow</span></td><td>Establishing connection</td></tr>
-    <tr><td>Disconnected</td><td><span class="red">● Red</span></td><td>Connection lost, auto-reconnecting</td></tr>
-  </table>
-</div>
-<hr>
-<div class="footer">
-  <p><strong>StockEx v1.0</strong> — Trading Simulation Platform</p>
-  <p>Inspired by Euronext OPTIQ</p>
-  <p style="margin-top: 15px; font-size: 11px;">To create PDF: Open in browser → Print (Ctrl+P) → Save as PDF</p>
-</div>
-</body>
-</html>

dashboard/templates/index - Copy (6).html DELETED Viewed

@@ -1,198 +0,0 @@
-<!doctype html>
-<html>
-<head>
-  <meta charset="utf-8"/>
-  <title>Trading Dashboard</title>
-  <style>
-    body { font-family: Arial, sans-serif; margin: 20px; background: #f7f7f7; }
-    h2 { margin: 5px 0; }
-    .container { display: grid; grid-template-columns: 1fr 1fr; grid-gap: 20px; }
-    .panel {
-      background: #fff;
-      border-radius: 8px;
-      padding: 10px;
-      box-shadow: 0 2px 4px rgba(0,0,0,0.1);
-      height: 400px;
-      display: flex;
-      flex-direction: column;
-    }
-    .panel pre {
-      flex-grow: 1;
-      overflow-y: scroll;
-      background: #fafafa;
-      padding: 10px;
-      margin: 0;
-      border-radius: 6px;
-      font-size: 13px;
-      white-space: pre;
-      font-family: monospace;
-    }
-    table {
-      width: 100%;
-      border-collapse: collapse;
-      font-size: 13px;
-    }
-    th, td {
-      border: 1px solid #ccc;
-      padding: 4px;
-      text-align: center;
-    }
-    .updated {
-      animation: flash 1s ease-in-out;
-    }
-    @keyframes flash {
-      from { background: yellow; }
-      to   { background: transparent; }
-    }
-  </style>
-</head>
-<body>
-  <h1>📊 Trading Dashboard</h1>
-  <div class="container">
-    <div class="panel">
-      <h2>📝 Orders</h2>
-      <pre id="orders"></pre>
-    </div>
-    <div class="panel">
-      <h2>💹 BBOs (from Order Book API)</h2>
-      <pre id="book"></pre>
-    </div>
-    <div class="panel">
-      <h2>🤝 Trades</h2>
-      <pre id="trades"></pre>
-    </div>
-    <div class="panel">
-      <h2>📖 Full Order Book</h2>
-      <label for="symbol-select">Select symbol:</label>
-      <select id="symbol-select" onchange="refresh()"></select>
-      <div id="full-book" style="flex-grow:1; overflow-y:scroll;"></div>
-    </div>
-    <div class="panel">
-      <h2>📊 Market Snapshots (BBO)</h2>
-      <table id="bbos-table">
-        <thead>
-          <tr>
-            <th>Symbol</th>
-            <th>Best Bid</th>
-            <th>Best Ask</th>
-            <th>Timestamp</th>
-            <th>Source</th>
-          </tr>
-        </thead>
-        <tbody id="bbos-body"></tbody>
-      </table>
-    </div>
-  </div>
-  <script>
-    function fmtOrder(o) {
-      const sym = (o.symbol ?? "?").padEnd(6);
-      const side = (o.type ?? o.side ?? "?").padEnd(6);
-      const qty = String(o.quantity ?? o.qty ?? "?").padStart(6);
-      const price = o.price !== undefined ? Number(o.price).toFixed(2).padStart(8) : "   -   ";
-      const src = (o.source ?? "?").padEnd(5);
-      const ts = o.timestamp ? new Date(o.timestamp * 1000).toLocaleTimeString() : "-";
-      return `${sym} | ${side} | ${qty} @ ${price} | ${src} | ${ts}\n`;
-    }
-    function fmtTrade(t) {
-      const sym = (t.symbol ?? "?").padEnd(6);
-      const qty = String(t.quantity ?? t.qty ?? "-").padStart(6);
-      const price = t.price !== undefined ? Number(t.price).toFixed(2).padStart(8) : "   -   ";
-      const ts = t.timestamp ? new Date(t.timestamp * 1000).toLocaleTimeString() : "-";
-      return `${sym} | ${qty} x ${price} | ${ts}\n`;
-    }
-    function renderOrderBook(book) {
-      const bids = (book.buy || []).sort((a,b) => b.price - a.price);
-      const asks = (book.sell || []).sort((a,b) => a.price - b.price);
-      const maxRows = Math.max(bids.length, asks.length);
-      let html = "<table><tr><th>Bid Size</th><th>Bid Price</th><th>Ask Price</th><th>Ask Size</th></tr>";
-      for (let i=0; i<maxRows; i++) {
-        const b = bids[i] || {};
-        const a = asks[i] || {};
-        html += `<tr>
-          <td>${b.quantity ?? ""}</td>
-          <td>${b.price !== undefined ? Number(b.price).toFixed(2) : ""}</td>
-          <td>${a.price !== undefined ? Number(a.price).toFixed(2) : ""}</td>
-          <td>${a.quantity ?? ""}</td>
-        </tr>`;
-      }
-      html += "</table>";
-      return html;
-    }
-    async function refresh() {
-      try {
-        const r = await fetch("/data");
-        const data = await r.json();
-        // Orders
-        document.getElementById("orders").textContent =
-          data.orders.slice().reverse().map(fmtOrder).join("");
-        // Trades
-        document.getElementById("trades").textContent =
-          data.trades.slice().reverse().map(fmtTrade).join("");
-        // Book JSON dump
-        document.getElementById("book").textContent =
-          JSON.stringify(data.book ?? {}, null, 2);
-        // Snapshots → fill table
-        const tbody = document.getElementById("bbos-body");
-        tbody.innerHTML = "";
-        for (const [symbol, snap] of Object.entries(data.bbos)) {
-          const row = document.createElement("tr");
-          row.innerHTML = `
-            <td>${symbol}</td>
-            <td>${snap.best_bid !== null ? Number(snap.best_bid).toFixed(2) : "-"}</td>
-            <td>${snap.best_ask !== null ? Number(snap.best_ask).toFixed(2) : "-"}</td>
-            <td>${snap.timestamp ? new Date(snap.timestamp*1000).toLocaleTimeString() : "-"}</td>
-            <td>${snap.source ?? "-"}</td>
-          `;
-          row.classList.add("updated");
-          setTimeout(() => row.classList.remove("updated"), 1000);
-          tbody.appendChild(row);
-        }
-        // Populate dropdown once
-        const sel = document.getElementById("symbol-select");
-        if (!sel.options.length) {
-          const symbols = [...new Set([
-            ...Object.keys(data.bbos),
-            ...(data.book?.buy || []).map(o => o.symbol),
-            ...(data.book?.sell || []).map(o => o.symbol)
-          ])];
-          symbols.forEach(sym => {
-            const opt = document.createElement("option");
-            opt.value = sym;
-            opt.textContent = sym;
-            sel.appendChild(opt);
-          });
-        }
-        // Render order book for selected symbol
-        const sym = sel.value;
-        if (sym) {
-          const bookForSymbol = {
-            buy: (data.book?.buy || []).filter(o => o.symbol === sym),
-            sell: (data.book?.sell || []).filter(o => o.symbol === sym),
-          };
-          document.getElementById("full-book").innerHTML = renderOrderBook(bookForSymbol);
-        }
-      } catch(e) {
-        console.error("Refresh error", e);
-      }
-    }
-    setInterval(refresh, 2000);
-    refresh();
-  </script>
-</body>
-</html>

dashboard/templates/index_Matcher.html DELETED Viewed

@@ -1,194 +0,0 @@
-<!doctype html>
-<html>
-<head>
-  <meta charset="utf-8"/>
-  <title>Trading Dashboard</title>
-  <style>
-    body { font-family: Arial, sans-serif; margin: 20px; background: #f7f7f7; }
-    h2 { margin: 5px 0; }
-    .container { display: grid; grid-template-columns: 1fr 1fr; grid-gap: 20px; }
-    .panel {
-      background: #fff;
-      border-radius: 8px;
-      padding: 10px;
-      box-shadow: 0 2px 4px rgba(0,0,0,0.1);
-      height: 400px;
-      display: flex;
-      flex-direction: column;
-    }
-    .panel pre {
-      flex-grow: 1;
-      overflow-y: scroll;
-      background: #fafafa;
-      padding: 10px;
-      margin: 0;
-      border-radius: 6px;
-      font-size: 13px;
-      white-space: pre;
-      font-family: monospace;
-    }
-    table {
-      width: 100%;
-      border-collapse: collapse;
-      font-size: 13px;
-    }
-    th, td {
-      border: 1px solid #ccc;
-      padding: 4px;
-      text-align: center;
-    }
-    .updated {
-      animation: flash 1s ease-in-out;
-    }
-    @keyframes flash {
-      from { background: yellow; }
-      to   { background: transparent; }
-    }
-  </style>
-</head>
-<body>
-  <h1>📊 Trading Dashboard</h1>
-  <div class="container">
-    <div class="panel">
-      <h2>📝 Orders</h2>
-      <pre id="orders"></pre>
-    </div>
-    <div class="panel">
-      <h2>💹 BBOs (from Order Book API)</h2>
-      <pre id="book"></pre>
-    </div>
-    <div class="panel">
-      <h2>🤝 Trades</h2>
-      <pre id="trades"></pre>
-    </div>
-    <div class="panel">
-      <h2>📖 Full Order Book</h2>
-      <label for="symbol-select">Select symbol:</label>
-      <select id="symbol-select" onchange="refresh()"></select>
-      <div id="full-book" style="flex-grow:1; overflow-y:scroll;"></div>
-    </div>
-    <div class="panel">
-      <h2>📊 Market Snapshots (BBO)</h2>
-      <table id="bbos-table">
-        <thead>
-          <tr>
-            <th>Symbol</th>
-            <th>Best Bid</th>
-            <th>Best Ask</th>
-            <th>Timestamp</th>
-          </tr>
-        </thead>
-        <tbody id="bbos-body"></tbody>
-      </table>
-    </div>
-  </div>
-  <script>
-    function fmtOrder(o) {
-      const sym = o.symbol ?? "?";
-      const side = o.type ?? o.side ?? "?";
-      const price = o.price !== undefined ? Number(o.price).toFixed(2) : "?";
-      const qty = o.quantity ?? o.qty ?? "?";
-      return `${sym} | ${side} | ${qty} @ ${price}\n`;
-    }
-    function fmtTrade(t) {
-      const sym = (t.symbol ?? "?").padEnd(6);
-      const qty = String(t.quantity ?? t.qty ?? "-").padStart(6);
-      const price = t.price !== undefined ? Number(t.price).toFixed(2).padStart(8) : "   -   ";
-      const ts = t.timestamp ? new Date(t.timestamp * 1000).toLocaleTimeString() : "-";
-      return `${sym} | ${qty} x ${price} | ${ts}\n`;
-    }
-    function renderOrderBook(book) {
-      const bids = (book.buy || []).sort((a,b) => b.price - a.price);
-      const asks = (book.sell || []).sort((a,b) => a.price - b.price);
-      const maxRows = Math.max(bids.length, asks.length);
-      let html = "<table><tr><th>Bid Size</th><th>Bid Price</th><th>Ask Price</th><th>Ask Size</th></tr>";
-      for (let i=0; i<maxRows; i++) {
-        const b = bids[i] || {};
-        const a = asks[i] || {};
-        html += `<tr>
-          <td>${b.quantity ?? ""}</td>
-          <td>${b.price !== undefined ? Number(b.price).toFixed(2) : ""}</td>
-          <td>${a.price !== undefined ? Number(a.price).toFixed(2) : ""}</td>
-          <td>${a.quantity ?? ""}</td>
-        </tr>`;
-      }
-      html += "</table>";
-      return html;
-    }
-    async function refresh() {
-      try {
-        const r = await fetch("/data");
-        const data = await r.json();
-        // Orders
-        document.getElementById("orders").textContent =
-          data.orders.slice().reverse().map(fmtOrder).join("");
-        // Trades
-        document.getElementById("trades").textContent =
-          data.trades.slice().reverse().map(fmtTrade).join("");
-        // Book JSON dump
-        document.getElementById("book").textContent =
-          JSON.stringify(data.book, null, 2);
-        // Snapshots → fill table
-        const tbody = document.getElementById("bbos-body");
-        tbody.innerHTML = "";
-        for (const [symbol, snap] of Object.entries(data.bbos)) {
-          const row = document.createElement("tr");
-          row.innerHTML = `
-            <td>${symbol}</td>
-            <td>${snap.best_bid !== null ? Number(snap.best_bid).toFixed(2) : "-"}</td>
-            <td>${snap.best_ask !== null ? Number(snap.best_ask).toFixed(2) : "-"}</td>
-            <td>${snap.timestamp ? new Date(snap.timestamp*1000).toLocaleTimeString() : "-"}</td>
-          `;
-          row.classList.add("updated");
-          setTimeout(() => row.classList.remove("updated"), 1000);
-          tbody.appendChild(row);
-        }
-        // Populate dropdown once
-        const sel = document.getElementById("symbol-select");
-        if (!sel.options.length) {
-          const symbols = [...new Set([
-            ...Object.keys(data.bbos),
-            ...(data.book.buy || []).map(o => o.symbol),
-            ...(data.book.sell || []).map(o => o.symbol)
-          ])];
-          symbols.forEach(sym => {
-            const opt = document.createElement("option");
-            opt.value = sym;
-            opt.textContent = sym;
-            sel.appendChild(opt);
-          });
-        }
-        // Render order book for selected symbol
-        const sym = sel.value;
-        if (sym) {
-          const bookForSymbol = {
-            buy: (data.book.buy || []).filter(o => o.symbol === sym),
-            sell: (data.book.sell || []).filter(o => o.symbol === sym),
-          };
-          document.getElementById("full-book").innerHTML = renderOrderBook(bookForSymbol);
-        }
-      } catch(e) {
-        console.error("Refresh error", e);
-      }
-    }
-    setInterval(refresh, 2000);
-    refresh();
-  </script>
-</body>
-</html>

matcher/matcher - Copy.py DELETED Viewed

@@ -1,135 +0,0 @@
-import threading, time, json
-from flask import Flask, jsonify
-from kafka import KafkaConsumer, KafkaProducer
-from kafka.errors import NoBrokersAvailable
-BOOTSTRAP = 'kafka:9092'
-import json, sys, datetime
-def jlog(event_type, payload):
-    out = {
-        "ts": datetime.datetime.utcnow().isoformat() + "Z",
-        "component": "matcher",
-        "event": event_type,
-        "payload": payload
-    }
-    sys.stdout.write(json.dumps(out, default=str) + "\n")
-    sys.stdout.flush()
-app = Flask(__name__)
-order_book = {'buy': [], 'sell': []}
-trades = []
-producer = None
-def create_kafka_producer(retries=20, delay=2):
-    global producer
-    for i in range(retries):
-        try:
-            producer = KafkaProducer(
-                bootstrap_servers=BOOTSTRAP,
-                value_serializer=lambda v: json.dumps(v).encode('utf-8')
-            )
-            print('Producer connected')
-            return
-        except NoBrokersAvailable:
-            print('Producer: Kafka not ready, retry', i)
-            time.sleep(delay)
-    raise RuntimeError('Producer: cannot connect to Kafka')
-def create_kafka_consumer(topic='orders', retries=20, delay=2):
-    for i in range(retries):
-        try:
-            consumer = KafkaConsumer(
-                topic,
-                bootstrap_servers=BOOTSTRAP,
-                value_deserializer=lambda m: json.loads(m.decode('utf-8')),
-                auto_offset_reset='earliest',
-                enable_auto_commit=True,
-                group_id='matcher-group'
-            )
-            print('Consumer connected to topic', topic)
-            return consumer
-        except NoBrokersAvailable:
-            print('Consumer: Kafka not ready, retry', i)
-            time.sleep(delay)
-    raise RuntimeError('Consumer: cannot connect to Kafka')
-def find_match(order):
-    side = order['type']
-    opp = 'sell' if side == 'buy' else 'buy'
-    candidates = [o for o in order_book[opp] if o['symbol'] == order['symbol'] and o['quantity'] > 0]
-    if not candidates:
-        return None
-    # best-price matching: for buy -> lowest sell price; for sell -> highest buy price
-    if side == 'buy':
-        valid = [o for o in candidates if o['price'] <= order['price']]
-        if not valid: return None
-        best_price = min(o['price'] for o in valid)
-        bests = [o for o in valid if o['price'] == best_price]
-        return min(bests, key=lambda x: x['timestamp'])
-    else:
-        valid = [o for o in candidates if o['price'] >= order['price']]
-        if not valid: return None
-        best_price = max(o['price'] for o in valid)
-        bests = [o for o in valid if o['price'] == best_price]
-        return min(bests, key=lambda x: x['timestamp'])
-def process_order(order):
-    print('Processing order:', order)
-    while order['quantity'] > 0:
-        matched = find_match(order)
-        if not matched:
-            order_book[order['type']].append(order.copy())
-            print('Added to book:', order)
-            return
-        traded_qty = min(order['quantity'], matched['quantity'])
-        trade_price = matched['price']
-        trade = {
-            'buy_order_id': order['order_id'] if order['type']=='buy' else matched['order_id'],
-            'sell_order_id': matched['order_id'] if order['type']=='buy' else order['order_id'],
-            'symbol': order['symbol'],
-            'price': trade_price,
-            'quantity': traded_qty,
-            'timestamp': time.time()
-        }
-        trades.append(trade)
-        if producer:
-            producer.send('trades', value=trade)
-            producer.flush()
-        print('TRADE:', trade)
-        order['quantity'] -= traded_qty
-        matched['quantity'] -= traded_qty
-        if matched['quantity'] == 0:
-            try:
-                order_book['sell' if order['type']=='buy' else 'buy'].remove(matched)
-                print('Removed matched from book:', matched)
-            except ValueError:
-                pass
-def consumer_loop():
-    consumer = create_kafka_consumer('orders')
-    for msg in consumer:
-        try:
-            order = msg.value
-            order['price'] = float(order['price'])
-            order['quantity'] = int(order['quantity'])
-            order.setdefault('timestamp', time.time())
-            process_order(order)
-        except Exception as e:
-            print('Error processing message:', e)
-@app.route('/book')
-def get_book():
-    # present best bids/asks sorted
-    return jsonify(order_book)
-@app.route('/trades')
-def get_trades():
-    return jsonify(trades)
-if __name__ == '__main__':
-    create_kafka_producer()
-    t = threading.Thread(target=consumer_loop, daemon=True)
-    t.start()
-    app.run(host='0.0.0.0', port=6000)