llmprobe
llmprobe is an MCP server, listed under model apis. It reaches anthropic, aws, azure, deepseek, groq, openai and together. It needs ANTHROPIC_API_KEY, AWS_SECRET_ACCESS_KEY, AZURE_OPENAI_API_KEY, DEEPSEEK_API_KEY, GROQ_API_KEY, OPENAI_API_KEY and TOGETHER_API_KEY to authenticate. Its repository has 7 GitHub stars and is licensed under MIT; we last read it on 2026-10-22.
Monitors LLM inference endpoints for synthetic traffic and performs CI smoke tests.
Install
Read from llmprobe’s own README, close to verbatim -- not written by us, and not guessed.
llmprobe probe
What it reaches, and what it needs
Reaches
anthropic, aws, azure, deepseek, groq, openai, together
Credential
ANTHROPIC_API_KEY, AWS_SECRET_ACCESS_KEY, AZURE_OPENAI_API_KEY, DEEPSEEK_API_KEY, GROQ_API_KEY, OPENAI_API_KEY, TOGETHER_API_KEY
Maintenance
Stars
7
State
listed
Licence
MIT
From the repository
Synthetic monitoring and CI smoke tests for LLM inference endpoints.
llmprobe compared with similar servers
| Server | Reaches | Needs | Stars | Last update | Licence |
|---|---|---|---|---|---|
| llmprobe (this page) | anthropic, aws, azure, deepseek, groq, openai, together | ANTHROPIC_API_KEY, AWS_SECRET_ACCESS_KEY, AZURE_OPENAI_API_KEY, DEEPSEEK_API_KEY, GROQ_API_KEY, OPENAI_API_KEY, TOGETHER_API_KEY | 7 | 2026-10-18 | MIT |
| just-prompt | anthropic, deepseek, gemini, groq, openai(4 shared) | ANTHROPIC_API_KEY, DEEPSEEK_API_KEY, GEMINI_API_KEY, GROQ_API_KEY, OPENAI_API_KEY | 739 | 2025-08-10 | — |
| cross-llm-mcp | anthropic, deepseek, gemini, huggingface, kimi, mistral, openai(3 shared) | ANTHROPIC_API_KEY, DEEPSEEK_API_KEY, GEMINI_API_KEY, HF_TOKEN, HUGGINGFACE_API_KEY, KIMI_API_KEY, MISTRAL_API_KEY, OPENAI_API_KEY | 16 | 2026-10-15 | MIT |
| doop | anthropic, azure, better(2 shared) | ANTHROPIC_API_KEY, AZURE_OPENAI_API_KEY, BETTER_AUTH_SECRET | 930 | 2026-10-22 | AGPL-3.0 |
| flama | anthropic, openai(2 shared) | None listed | 304 | 2026-10-13 | Apache-2.0 |
| schemagate | anthropic, entra, gemini, mysql, openai, postgres, schemagate(2 shared) | ANTHROPIC_API_KEY, ENTRA_CLIENT_SECRET, GEMINI_API_KEY, OPENAI_API_KEY, SCHEMAGATE_AUDIT_SIGNING_KEY | 105 | 2026-10-22 | Apache-2.0 |
Ranked by services in common with llmprobe, then by stars. Figures are from each repository when we last read it.
Common questions about llmprobe
- What does llmprobe do?
- Monitors LLM inference endpoints for synthetic traffic and performs CI smoke tests.
- How do I install llmprobe?
- Its own README gives this command: llmprobe probe. Run it where your MCP client can launch the server, and check the README for any settings it asks for.
- What does llmprobe connect to, and what does it need?
- It reaches anthropic, aws, azure, deepseek, groq, openai and together. The credentials we found in its source are ANTHROPIC_API_KEY, AWS_SECRET_ACCESS_KEY, AZURE_OPENAI_API_KEY, DEEPSEEK_API_KEY, GROQ_API_KEY, OPENAI_API_KEY and TOGETHER_API_KEY.
- Is llmprobe official and is it maintained?
- We found nothing naming it as a vendor’s official server. Its repository has 7 GitHub stars and its state in our directory is listed. Its last commit we recorded was on 2026-10-18.
- What licence does llmprobe use?
- The repository declares the MIT licence.
More MCP servers for model apis
- wigolo5,498 stars
- KiCAD-MCP-Server2,905 stars
- modelcontextprotocol2,589 stars
- paperbanana2,412 stars
- gemini-mcp-tool2,294 stars
- telegram-mcp1,879 stars