Test Coverage Matrix¶

The following matrix details the test coverage across all repositories in the Edge Computing LLM platform.

Infrastructure and Provisioning (`k3s-nvidia-edge`)¶

Component	Test Type	Description	Status
K3s Installation	E2E	Verifies successful K3s installation on Ubuntu.	Automated
Containerd Config	Unit/E2E	Validates injection of NVIDIA runtime class.	Automated
GPU Passthrough	E2E	Tests if `nvidia-smi` works inside a test pod.	Automated
Air-gap Support	E2E	Verifies installation without external internet access.	Planned

Component	Test Type	Description	Status
Config Parser	Unit	Tests Viper configuration loading and overrides.	Automated
Profile Resolution	Unit	Validates that `lite`/`standard`/`heavy` map correctly.	Automated
Doctor Command	Integration	Verifies system checks (memory, OS, drivers).	Automated
Apply Idempotency	E2E	Ensures running `apply` twice doesn't cause churn.	Automated

Component	Test Type	Description	Status
Model Pulling	E2E	Verifies Ollama successfully downloads models.	Automated
Context Limits	Integration	Verifies Ollama respects `num_ctx` constraints.	Automated
VRAM Allocation	E2E	Ensures model loads correctly into GPU VRAM.	Automated
Concurrent Requests	Performance	Load testing multiple API calls to measure latency.	Manual

Component	Test Type	Description	Status
Prometheus Scraping	Integration	Verifies Prometheus successfully scrapes DCGM.	Automated
Grafana Dashboards	Unit	Validates JSON dashboard schemas (linting).	Automated
Alert Rules	Unit	Tests PromQL alert logic (e.g., High VRAM usage).	Automated

Component	Test Type	Description	Status
Network Policies	E2E	Asserts unauthorized pods cannot reach port 11434.	Automated
Pod Security	Integration	Verifies restricted namespaces reject privileged pods.	Automated
RBAC Integrity	E2E	Ensures service accounts cannot access ungranted secrets.	Automated

[!NOTE] Tests marked as "Automated" are run on every Pull Request using GitHub Actions or local CI scripts via edge-llm-tests.