scrapeRL / backend /requirements.txt
NeerajCodz's picture
fix: resolve scraper functionality and plugin issues
54ec9cb
# Core Framework
fastapi>=0.109.0
uvicorn[standard]>=0.27.0
pydantic>=2.5.0
pydantic-settings>=2.1.0
# HTTP Client
httpx>=0.26.0
certifi>=2024.2.2
# Vector Database
chromadb>=0.4.22
# HTML Processing
beautifulsoup4>=4.12.0
lxml>=5.1.0
# Search Providers
duckduckgo-search>=6.0.0
# LLM Providers
openai>=1.10.0
anthropic>=0.18.0
google-generativeai>=0.4.0
groq>=0.4.0
# Browser Automation
playwright>=1.41.0
# Tokenization
tiktoken>=0.5.0
# Utilities
numpy>=1.26.0
pandas>=2.2.0
tenacity>=8.2.0
structlog>=24.1.0
python-dotenv>=1.0.0
# Development
pytest>=8.0.0
pytest-asyncio>=0.23.0
pytest-cov>=4.1.0
ruff>=0.2.0
mypy>=1.8.0