- Add extract_zip_flatten() to Streamlit RPCD for nested ZIP handling - Add bot whitelist to mitmproxy WAF (Facebook, Google, Bing crawlers) - Skip threat detection for whitelisted legitimate crawlers - Track Fabricator app and stats evolution in HISTORY.md Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| files | ||
| root/srv/mitmproxy/addons | ||
| Makefile | ||
| README.md | ||
SecuBox mitmproxy App
LXC container with mitmproxy for HTTPS traffic inspection and threat detection.
Components
| Component | Description |
|---|---|
| LXC Container | Debian-based container with mitmproxy |
| secubox_analytics.py | Threat detection addon for mitmproxy |
| haproxy_router.py | HAProxy backend routing addon |
| CrowdSec Integration | Threat logging for automatic IP banning |
Threat Detection Patterns
Attack Types Detected
| Category | Patterns |
|---|---|
| SQL Injection | UNION SELECT, OR 1=1, SLEEP(), BENCHMARK() |
| XSS | <script>, event handlers, javascript: URLs |
| Command Injection | ; cat, | ls, backticks, $() |
| Path Traversal | ../, %2e%2e/, file:// |
| SSRF | Internal IPs, metadata endpoints |
| XXE | <!ENTITY, SYSTEM, file:// |
| LDAP Injection | )( |
| Log4Shell | ${jndi:, ${env:, ldap:// |
| SSTI | {{...}}, ${...}, <%...%> |
| Prototype Pollution | proto, constructor[ |
| GraphQL Abuse | Deep nesting, introspection |
| JWT Attacks | alg:none, exposed tokens |
CVE Detection
| CVE | Description |
|---|---|
| CVE-2021-44228 | Log4Shell (Log4j RCE) |
| CVE-2021-41773 | Apache path traversal |
| CVE-2022-22965 | Spring4Shell |
| CVE-2023-34362 | MOVEit SQL injection |
| CVE-2024-3400 | PAN-OS command injection |
| CVE-2024-21887 | Ivanti Connect Secure |
| CVE-2024-1709 | ScreenConnect auth bypass |
| CVE-2024-27198 | TeamCity auth bypass |
Scanner Detection
Detects security scanners: sqlmap, nikto, nuclei, burpsuite, nmap, dirb, gobuster, ffuf, etc.
CrowdSec Integration
Threats are logged to /data/threats.log (mounted as /srv/mitmproxy/threats.log on host).
CrowdSec scenarios:
secubox/mitmproxy-attack- Bans after 3 high/critical attackssecubox/mitmproxy-scanner- Bans aggressive scannerssecubox/mitmproxy-ssrf- Bans external SSRF attemptssecubox/mitmproxy-cve- Immediate ban for CVE exploits
GeoIP
Install GeoLite2-Country.mmdb to /srv/mitmproxy/ for country detection:
curl -sL "https://github.com/P3TERX/GeoLite.mmdb/raw/download/GeoLite2-Country.mmdb" \
-o /srv/mitmproxy/GeoLite2-Country.mmdb
File Paths
| Path | Description |
|---|---|
/srv/mitmproxy/ |
Host bind mount directory |
/srv/mitmproxy/threats.log |
CrowdSec threat log |
/srv/mitmproxy/addons/ |
mitmproxy addon scripts |
/srv/mitmproxy/GeoLite2-Country.mmdb |
GeoIP database |
HAProxy Integration & Routing
Traffic Flow Architecture
┌─────────────────────────────────────────────────────────────────┐
│ INTERNET │
└─────────────────────────────────────────────────────────────────┘
│
▼
┌─────────────────────────────────────────────────────────────────┐
│ HAProxy (ports 80/443) │
│ ┌─────────────────────────────────────────────────────────┐ │
│ │ Frontend: Receives HTTPS requests │ │
│ │ ACL: Route by Host header to vhosts │ │
│ └─────────────────────────────────────────────────────────┘ │
│ │ │
│ ▼ │
│ ┌─────────────────────────────────────────────────────────┐ │
│ │ Backend: mitmproxy_inspector (127.0.0.1:8889) │ │
│ └─────────────────────────────────────────────────────────┘ │
└─────────────────────────────────────────────────────────────────┘
│
▼
┌─────────────────────────────────────────────────────────────────┐
│ mitmproxy LXC Container (port 8889) │
│ ┌─────────────────────────────────────────────────────────┐ │
│ │ haproxy_router.py: Routes by Host header │ │
│ │ secubox_analytics.py: Threat detection │ │
│ └─────────────────────────────────────────────────────────┘ │
│ │ │
│ Logs threats to /data/threats.log │
└─────────────────────────────────────────────────────────────────┘
│
▼
┌─────────────────────────────────────────────────────────────────┐
│ Backend Services │
│ ┌──────────┐ ┌──────────┐ ┌──────────┐ ┌──────────┐ │
│ │ Gitea │ │ Streamlit│ │ Glances │ │ LuCI │ │
│ │ :3000 │ │ :8501 │ │ :61208 │ │ :8081 │ │
│ └──────────┘ └──────────┘ └──────────┘ └──────────┘ │
└─────────────────────────────────────────────────────────────────┘
Sync Routes Command
Syncs HAProxy vhost configurations to mitmproxy routing table:
mitmproxyctl sync-routes
This generates /srv/mitmproxy/haproxy-routes.json:
{
"devel.cybermind.fr": ["192.168.255.1", 3000],
"play.cybermind.fr": ["192.168.255.1", 8501],
"glances.maegia.tv": ["192.168.255.1", 61208],
"factory.maegia.tv": ["192.168.255.1", 7331]
}
HAProxy Integration Commands
| Command | Description |
|---|---|
mitmproxyctl haproxy-enable |
Enable threat inspection for all vhosts |
mitmproxyctl haproxy-disable |
Disable inspection, restore direct backends |
mitmproxyctl sync-routes |
Regenerate routes from current HAProxy config |
Enabling HAProxy Inspection
# Enable inspection mode
mitmproxyctl haproxy-enable
# This will:
# 1. Create mitmproxy_inspector backend (127.0.0.1:8889)
# 2. Store original backends in UCI (haproxy.$vhost.original_backend)
# 3. Redirect all vhosts through mitmproxy
# 4. Sync route mappings
# 5. Restart services
Ports
| Port | Service |
|---|---|
| 8888 | mitmproxy (direct proxy mode) |
| 8889 | mitmproxy (HAProxy backend inspection) |
| 8081 | mitmweb UI |
haproxy_router.py Addon
The router addon:
- Loads routes from
/data/haproxy-routes.json - Routes requests by Host header to real backends
- Stores original host in
flow.metadata['original_host'] - Falls back to LuCI (127.0.0.1:8081) for unknown hosts
Route File Format
{
"hostname": ["ip", port],
"*.wildcard.domain": ["ip", port]
}
Supports wildcard matching with *.domain.tld patterns.
Dependencies
lxc- Container runtimecrowdsec- Threat intelligence (optional)geoip2- Python GeoIP library (optional)