Instructions to use bencodez/Cipheron with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use bencodez/Cipheron with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf bencodez/Cipheron:Q4_K_M # Run inference directly in the terminal: llama cli -hf bencodez/Cipheron:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf bencodez/Cipheron:Q4_K_M # Run inference directly in the terminal: llama cli -hf bencodez/Cipheron:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf bencodez/Cipheron:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf bencodez/Cipheron:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf bencodez/Cipheron:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf bencodez/Cipheron:Q4_K_M
Use Docker
docker model run hf.co/bencodez/Cipheron:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use bencodez/Cipheron with Ollama:
ollama run hf.co/bencodez/Cipheron:Q4_K_M
- Unsloth Desktop
- Pi
How to use bencodez/Cipheron with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf bencodez/Cipheron:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "bencodez/Cipheron:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use bencodez/Cipheron with Docker Model Runner:
docker model run hf.co/bencodez/Cipheron:Q4_K_M
- Lemonade
How to use bencodez/Cipheron with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull bencodez/Cipheron:Q4_K_M
Run and chat with the model
lemonade run user.Cipheron-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use bencodez/Cipheron with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf bencodez/Cipheron:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default bencodez/Cipheron:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use bencodez/Cipheron with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf bencodez/Cipheron:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "bencodez/Cipheron:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
| \--- | |
| ## license: apache-2.0 | |
| # Cipheron | |
| **Cipheron** is a lightweight coding model designed for **secure code review**. | |
| It analyzes source code for common security vulnerabilities and attempts to explain the issue and provide a safer implementation. | |
| ## What Cipheron Is Good At | |
| Cipheron performs particularly well on: | |
| * **SQL injection** — identifies unsafe query construction and recommends parameterized queries. | |
| * **Command injection** — identifies unsafe shell command construction and recommends safer subprocess-based approaches. | |
| These vulnerability classes are strongly represented in its evaluation data. | |
| ## Known Limitations | |
| Cipheron has limited reliability across many security vulnerability categories. | |
| In testing, it struggled with: | |
| * Path traversal | |
| * Hardcoded secrets and API keys | |
| * Weak password hashing | |
| * Insecure deserialization | |
| * Reflected XSS | |
| * Complex multi-step security vulnerabilities | |
| For these cases, the model may produce changes that appear security-related but do not actually eliminate the underlying vulnerability. | |
| **Do not rely on Cipheron as a replacement for professional security review, static analysis, penetration testing, or a larger security-focused model.** | |
| Cipheron is best considered a lightweight, experimental tool for first-pass security analysis and secure-coding experimentation. | |
| ## Usage | |
| ```python | |
| from transformers import AutoModelForCausalLM, AutoTokenizer | |
| import torch | |
| model_id = "bencodez/Cipheron" | |
| tokenizer = AutoTokenizer.from_pretrained(model_id) | |
| model = AutoModelForCausalLM.from_pretrained( | |
| model_id, | |
| torch_dtype=torch.bfloat16 | |
| ) | |
| messages = [ | |
| { | |
| "role": "system", | |
| "content": ( | |
| "You are a secure coding assistant. " | |
| "Review code for security vulnerabilities " | |
| "and provide fixed, secure versions." | |
| ) | |
| }, | |
| { | |
| "role": "user", | |
| "content": """Review this code for security issues and fix it: | |
| def get_user(username): | |
| query = "SELECT * FROM users WHERE username = '" + username + "'" | |
| return db.execute(query)""" | |
| } | |
| ] | |
| input_ids = tokenizer.apply_chat_template( | |
| messages, | |
| add_generation_prompt=True, | |
| return_tensors="pt" | |
| ) | |
| with torch.no_grad(): | |
| output = model.generate( | |
| input_ids, | |
| max_new_tokens=250 | |
| ) | |
| response = tokenizer.decode( | |
| output[0][input_ids.shape[1]:], | |
| skip_special_tokens=True | |
| ) | |
| print(response) | |
| ``` | |
| ## Local Inference | |
| A quantized `Cipheron-Q8_0.gguf` version is available for lightweight local inference. | |
| Cipheron can be used with compatible local inference runtimes for CPU and other supported devices. | |
| ## Intended Use | |
| Cipheron is intended for: | |
| * Secure-coding education | |
| * Security experimentation | |
| * Offline code analysis | |
| * Vulnerability-detection research | |
| * Lightweight local development workflows | |
| ## Model Information | |
| | Property | Value | | |
| | -------------- | ---------------------------------- | | |
| | Model | Cipheron | | |
| | Parameters | 0.5B | | |
| | Architecture | Causal language model | | |
| | Primary domain | Secure coding | | |
| | Input | Source code and security questions | | |
| | Output | Security analysis and safer code | | |
| | License | Apache 2.0 | | |
| ## Disclaimer | |
| Cipheron is an experimental security-oriented coding model. | |
| Security output should always be independently verified before being used in production systems. A model-generated fix does not guarantee that a vulnerability has been completely eliminated. | |
| ## License | |
| Apache 2.0 | |