🚀 Organizational LLM API of ITP/TTP

Welcome to the internal LLM infrastructure of ITP/TTP cluster. This service is part of our emerging AI stack aimed at assisting research, automation, and internal knowledge workflows.

🤖 Purpose

Provide fast and secure access to large language models (LLMs)
Automate repetitive research tasks like summarization, extraction, data cleaning
Experiment with organization-specific fine-tuning and prompt engineering
Support NLP-based tooling for internal platforms

🔐 API Access

Access to the API is secured with Bearer token authentication.

To perform queries, send a POST request to:

POST /llm/api/generate

With the Authorization header set:

Authorization: Bearer YOUR_API_KEY

Example request payload to a vanilla LLM model:

{
  "model": "llama3",
  "prompt": "What are the latest papers in quantum computing?"
}

📄 Docs

Full API documentation and usage examples coming soon. For now, reach out to the team managing llm.particle.kit.edu for support and credentials:

Bakar Chargeishvili

🛠️ Current Status

Service is up and running. If you're seeing this page, the frontend is alive. API may still be propagating through external network routes. Try again shortly if external access fails.