Overview
Icelake is a sovereign European AI-driven data research workbench. Public datasets — weather, air quality, sovereign maps without tracking, geo and IoT — are already loaded and refreshed for you, alongside any data you ingest yourself via Prometheus, Loki, OpenTelemetry, or MQTT. Everything lands in ClickHouse — a columnar, open-source analytics engine — on European S3-backed storage, and is queryable through SQL, LogQL, PromQL, spreadsheet-style Sheets, and AI MasterMind in natural language. Open interfaces (PostgreSQL wire protocol, Prometheus and Loki APIs, CSV export) keep your data portable and independent from proprietary providers.
Architecture
Section titled “Architecture”Icelake follows a pipeline architecture designed for high-throughput, low-latency observability:
- Multi-Protocol Ingestion — Prometheus remote write, Loki push API, and OTLP protobuf
- ClickHouse Storage — Columnar, compressed tables on S3-backed object storage in Europe
- Query Engine — ClickHouse SQL via pgwire, LogQL for logs, PromQL for metrics — all on the same data
- Automatic Rollups — 10-minute, hourly and daily aggregates maintained at insert time for fast long-range charts
- Sheets — Upload CSVs of any size and work with them like a spreadsheet, with full version history
Technology Stack
Section titled “Technology Stack”| Technology | Purpose | Benefits |
|---|---|---|
| Rust | Core Runtime | Memory safety, zero-cost abstractions, speed |
| ClickHouse | Analytics Engine | Columnar, vectorized — tens of millions of rows in well under a second |
| PostgreSQL | Metadata & Catalog | Data set catalog, users, sheets and their versions |
| S3 | Object Storage | Cost-efficient, durable, scalable storage in Europe |
Getting Started
Section titled “Getting Started”- Architecture — Understand the data flow and multi-tenant model
- Prometheus — Configure Prometheus remote write ingestion
- Loki & LogQL — Set up log ingestion and LogQL queries
- OpenTelemetry — Ingest via OTLP protobuf endpoints
What’s New
Section titled “What’s New”- Sheets — Load any CSV, edit it like a spreadsheet, and ask it questions in natural language
- Geo & Public Datasets — DWD weather warnings, OpenAQ air quality, and Overture places joinable against your own data
- MQTT & IoT — Configure MQTT ingestion with TTN LoRaWAN auto-parsing
- AI MasterMind — Natural language chat analytics on ClickHouse
- Admin Dashboard — Manage data sources, teams, and analytics
- Home Assistant — HACS integration for smart home metrics
- Query Interfaces — Grafana, pgwire SQL, REST API, and Loki Query API
Community & Support
Section titled “Community & Support”- GitHub — Contribute to the project and report issues
- Discord — Join our community for discussions and support
- Documentation — Comprehensive guides and API references