Local LLM Chat API
A private chat service that runs on a local model and replies in Bangla or English.
- Streams replies token by token as NDJSON, or returns one JSON response
- Keeps the last 20 messages of each session as context
- Exports conversations as JSON or Markdown
- Runs with one Docker Compose command, with health checks and unit and API tests that don't need Ollama
- Python
- FastAPI
- Ollama
- Docker Compose
- pytest
| POST/api/chat | Full JSON reply |
| POST/api/chat/stream | Token stream |
| GET/api/sessions/{id}/export | JSON or Markdown |
| GET/health/ready | Model readiness |