secubox-openwrt/package/secubox/secubox-app-metacatalog

SecuBox Meta Cataloger

Virtual library system that aggregates MetaBlogizer sites, Streamlit apps, and other services into a unified catalog organized by themed Virtual Books.

Overview

┌─────────────────────────────────────────────────────────────────┐
│                    META CATALOGER                                │
│              "Bibliothèque Virtuelle SecuBox"                   │
├─────────────────────────────────────────────────────────────────┤
│  📚 VIRTUAL BOOKS (auto-generated collections)                  │
│  ├── 🔮 Divination & I-Ching                                    │
│  │   ├── lldh360.maegia.tv (HERMÈS·360 Oracle)                 │
│  │   └── yijing.gk2.secubox.in                                 │
│  ├── 🎮 Interactive Visualizations                              │
│  │   └── wall.maegia.tv (MAGIC·CHESS·360)                      │
│  ├── 📊 Data & Analytics                                        │
│  │   └── control.gk2.secubox.in (SecuBox Control)              │
│  └── 📝 Publications & Blogs                                    │
│      └── gandalf.maegia.tv                                      │
└─────────────────────────────────────────────────────────────────┘

CLI Commands

# Full catalog sync (scan + index + assign books + generate landing)
metacatalogctl sync

# Scan specific source
metacatalogctl scan                    # All sources
metacatalogctl scan metablogizer       # MetaBlogizer sites only
metacatalogctl scan streamlit          # Streamlit apps only

# Index management
metacatalogctl index list              # List all indexed entries
metacatalogctl index show <id>         # Show entry details
metacatalogctl index refresh           # Rebuild index

# Virtual books
metacatalogctl books list              # List all books with entry counts
metacatalogctl books show <book-id>    # Show book contents

# Search
metacatalogctl search <query>          # Full-text search across catalog

# Maintenance
metacatalogctl status                  # Show catalog statistics
metacatalogctl landing                 # Regenerate landing page only

UCI Configuration

The configuration is in /etc/config/metacatalog:

config metacatalog 'main'
    option enabled '1'
    option data_dir '/srv/metacatalog'
    option auto_scan_interval '3600'
    option landing_path '/www/metacatalog/index.html'

# Content sources
config source 'metablogizer'
    option enabled '1'
    option type 'metablogizer'
    option path '/srv/metablogizer/sites'

config source 'streamlit'
    option enabled '1'
    option type 'streamlit'
    option config '/etc/config/streamlit-forge'

# Virtual book definitions
config book 'divination'
    option name 'Divination & I-Ching'
    option icon '🔮'
    option color '#cc00ff'
    option description 'Outils oraculaires et systèmes divinatoires'
    list keywords 'iching'
    list keywords 'oracle'
    list keywords 'divination'
    list domain_patterns 'lldh'
    list domain_patterns 'yijing'

config book 'visualization'
    option name 'Interactive Visualizations'
    option icon '🎮'
    option color '#00ff88'
    list keywords 'canvas'
    list keywords 'animation'
    list domain_patterns 'wall'

File Structure

/etc/config/metacatalog          # UCI configuration
/usr/sbin/metacatalogctl         # CLI tool
/srv/metacatalog/
├── index.json                   # Main catalog index
├── books.json                   # Virtual books with entries
├── entries/                     # Individual entry JSON files
│   ├── lldh360-maegia-tv.json
│   └── ...
└── cache/                       # Scan cache
/www/metacatalog/
├── index.html                   # Landing page (Tao prism theme)
└── api/
    ├── index.json               # API: all entries
    └── books.json               # API: all books

Default Virtual Books

ID	Name	Icon	Keywords
divination	Divination & I-Ching	🔮	iching, oracle, hexagram, yijing, bazi
visualization	Interactive Visualizations	🎮	canvas, animation, 3d, game
analytics	Data & Analytics	📊	dashboard, data, analytics, metrics
publications	Publications & Blogs	📝	blog, article, press, news
security	Security Tools	🛡️	security, waf, firewall, crowdsec
media	Media & Entertainment	🎬	video, audio, streaming, media

Auto-Assignment

Entries are automatically assigned to books based on:

• Keywords: Matched against entry title, description, and extracted keywords
• Domain patterns: Matched against the entry domain name

Configure rules in UCI:

uci add_list metacatalog.divination.keywords='tarot'
uci add_list metacatalog.divination.domain_patterns='tarot'
uci commit metacatalog
metacatalogctl sync

Cron Integration

Hourly auto-sync is configured via /etc/cron.d/metacatalog:

0 * * * * root /usr/sbin/metacatalogctl sync --quiet >/dev/null 2>&1

API Access

Landing page and JSON APIs are available at:

• Landing: https://secubox.in/metacatalog/
• Entries: https://secubox.in/metacatalog/api/index.json
• Books: https://secubox.in/metacatalog/api/books.json

Dependencies

• jsonfilter - JSON parsing (libubox)
• coreutils-stat - File timestamps

Integration

• MetaBlogizer: Auto-scans /srv/metablogizer/sites/ for published sites
• Streamlit Forge: Reads /etc/config/streamlit-forge for app definitions
• HAProxy: Checks vhost SSL/WAF status for exposure info