feat(backend): add §8 data model + Alembic baseline (B0.2, B0.3)
- SQLAlchemy 2 typed mapped classes for every spec §8 aggregate:
engagement, c2_credential, host, user, group, group_permission,
user_group, engagement_member, ttp, ttp_version, scenario,
scenario_step, run, run_step, run_step_cleanup, detection, evidence,
report, soc_session, audit_log.
- Shared mixins: UuidPkMixin (PG_UUID(as_uuid=True)) + TimestampsMixin.
- StrEnum types covering every spec enum (C2Type, PayloadType, UserType,
EngagementStatus, HostStatus, TtpSource, RunStatus, RunStepStatus,
CleanupStatus, DetectionLevel, DetectionSource, EvidenceStatus).
- Alembic baseline migration 202605210001_initial_schema: creates every
table, enum, index, and idempotent grants for the audit_log
write-only Postgres role (mimic_audit_writer).
- Audit log carries prev_hash / row_hash from v1 (D-009).
- ttp_version table coexists with run.snapshot_json (D-008,
overrides H32).
2026-05-21 20:32:45 +02:00
|
|
|
"""Scenario aggregate: ordered list of TTP steps.
|
|
|
|
|
|
|
|
|
|
Spec §F3: `scenario.c2_type` is the source of truth for the run. Verified at
|
|
|
|
|
run start that every referenced host matches.
|
|
|
|
|
"""
|
|
|
|
|
|
|
|
|
|
from __future__ import annotations
|
|
|
|
|
|
chore(backend): mypy strict clean + ruff format pass
Pre-merge sanity per devops checklist (ruff format --check, mypy --strict).
Type fixes:
- ORM models: `Mapped[dict]` → `Mapped[dict[str, Any]]` (audit, scenario, run,
report, ttp, detection.artifact_files_json). Equivalent on Pydantic DTOs
(TtpBase.params_schema_json, ScenarioStepBase.params_override_json).
- Rename `TtpRead.current_version` → `TtpRead.version` to mirror the ORM
column (which itself was renamed in D-009 cleanup).
- Flask blueprints: add `-> ResponseReturnValue` to every view, plus typed
UUID params on `_validate_step_consistency`.
- `templating/filters.py`: rewrite the conditional re2 import so mypy can
narrow the union (`ModuleType | None`); the runtime branch on `_re2 is not
None` removes the unused-ignore that was triggered by warn_unused_ignores.
- `pyproject.toml`: add `flask_login.*` and `pythonjsonlogger.*` to the
`[[tool.mypy.overrides]]` `ignore_missing_imports` list (both ship without
typed marker).
- Misc: drop stale `# type: ignore` comments (`app.py:36`,
`rbac/decorators.py:35`) flagged by `warn_unused_ignores`. Keep
`logging.JsonFormatter` ignore because the symbol exists at runtime but is
not re-exported through the typed surface.
Formatting:
- `ruff format` applied (15 files normalized; line-length unchanged at 100).
Verification on this commit:
- `ruff check` → All checks passed.
- `ruff format --check` → 68 files already formatted.
- `mypy --strict src` → Success: no issues found in 54 source files.
- `pytest tests/unit` → 49 passed.
2026-05-22 05:10:51 +02:00
|
|
|
from typing import TYPE_CHECKING, Any
|
feat(backend): add §8 data model + Alembic baseline (B0.2, B0.3)
- SQLAlchemy 2 typed mapped classes for every spec §8 aggregate:
engagement, c2_credential, host, user, group, group_permission,
user_group, engagement_member, ttp, ttp_version, scenario,
scenario_step, run, run_step, run_step_cleanup, detection, evidence,
report, soc_session, audit_log.
- Shared mixins: UuidPkMixin (PG_UUID(as_uuid=True)) + TimestampsMixin.
- StrEnum types covering every spec enum (C2Type, PayloadType, UserType,
EngagementStatus, HostStatus, TtpSource, RunStatus, RunStepStatus,
CleanupStatus, DetectionLevel, DetectionSource, EvidenceStatus).
- Alembic baseline migration 202605210001_initial_schema: creates every
table, enum, index, and idempotent grants for the audit_log
write-only Postgres role (mimic_audit_writer).
- Audit log carries prev_hash / row_hash from v1 (D-009).
- ttp_version table coexists with run.snapshot_json (D-008,
overrides H32).
2026-05-21 20:32:45 +02:00
|
|
|
from uuid import UUID
|
|
|
|
|
|
|
|
|
|
from sqlalchemy import (
|
|
|
|
|
JSON,
|
|
|
|
|
Enum,
|
|
|
|
|
ForeignKey,
|
|
|
|
|
Integer,
|
|
|
|
|
String,
|
|
|
|
|
Text,
|
|
|
|
|
UniqueConstraint,
|
|
|
|
|
)
|
|
|
|
|
from sqlalchemy.orm import Mapped, mapped_column, relationship
|
|
|
|
|
|
|
|
|
|
from mimic.db.base import Base, TimestampsMixin, UuidPkMixin
|
|
|
|
|
from mimic.db.types import C2Type
|
|
|
|
|
|
|
|
|
|
if TYPE_CHECKING:
|
|
|
|
|
from mimic.db.models.engagement import Engagement
|
|
|
|
|
from mimic.db.models.host import Host
|
|
|
|
|
from mimic.db.models.run import Run
|
|
|
|
|
from mimic.db.models.ttp import Ttp
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
class Scenario(UuidPkMixin, TimestampsMixin, Base):
|
|
|
|
|
__tablename__ = "scenario"
|
|
|
|
|
|
|
|
|
|
engagement_id: Mapped[UUID] = mapped_column(
|
|
|
|
|
ForeignKey("engagement.id", ondelete="CASCADE"),
|
|
|
|
|
nullable=False,
|
|
|
|
|
)
|
|
|
|
|
name: Mapped[str] = mapped_column(String(255), nullable=False)
|
|
|
|
|
description: Mapped[str | None] = mapped_column(Text)
|
|
|
|
|
version: Mapped[int] = mapped_column(Integer, default=1, nullable=False)
|
|
|
|
|
|
|
|
|
|
c2_type: Mapped[C2Type] = mapped_column(
|
|
|
|
|
Enum(C2Type, name="c2_type", create_type=False),
|
|
|
|
|
nullable=False,
|
|
|
|
|
)
|
chore(backend): mypy strict clean + ruff format pass
Pre-merge sanity per devops checklist (ruff format --check, mypy --strict).
Type fixes:
- ORM models: `Mapped[dict]` → `Mapped[dict[str, Any]]` (audit, scenario, run,
report, ttp, detection.artifact_files_json). Equivalent on Pydantic DTOs
(TtpBase.params_schema_json, ScenarioStepBase.params_override_json).
- Rename `TtpRead.current_version` → `TtpRead.version` to mirror the ORM
column (which itself was renamed in D-009 cleanup).
- Flask blueprints: add `-> ResponseReturnValue` to every view, plus typed
UUID params on `_validate_step_consistency`.
- `templating/filters.py`: rewrite the conditional re2 import so mypy can
narrow the union (`ModuleType | None`); the runtime branch on `_re2 is not
None` removes the unused-ignore that was triggered by warn_unused_ignores.
- `pyproject.toml`: add `flask_login.*` and `pythonjsonlogger.*` to the
`[[tool.mypy.overrides]]` `ignore_missing_imports` list (both ship without
typed marker).
- Misc: drop stale `# type: ignore` comments (`app.py:36`,
`rbac/decorators.py:35`) flagged by `warn_unused_ignores`. Keep
`logging.JsonFormatter` ignore because the symbol exists at runtime but is
not re-exported through the typed surface.
Formatting:
- `ruff format` applied (15 files normalized; line-length unchanged at 100).
Verification on this commit:
- `ruff check` → All checks passed.
- `ruff format --check` → 68 files already formatted.
- `mypy --strict src` → Success: no issues found in 54 source files.
- `pytest tests/unit` → 49 passed.
2026-05-22 05:10:51 +02:00
|
|
|
created_by_id: Mapped[UUID | None] = mapped_column(ForeignKey("user.id", ondelete="SET NULL"))
|
feat(backend): add §8 data model + Alembic baseline (B0.2, B0.3)
- SQLAlchemy 2 typed mapped classes for every spec §8 aggregate:
engagement, c2_credential, host, user, group, group_permission,
user_group, engagement_member, ttp, ttp_version, scenario,
scenario_step, run, run_step, run_step_cleanup, detection, evidence,
report, soc_session, audit_log.
- Shared mixins: UuidPkMixin (PG_UUID(as_uuid=True)) + TimestampsMixin.
- StrEnum types covering every spec enum (C2Type, PayloadType, UserType,
EngagementStatus, HostStatus, TtpSource, RunStatus, RunStepStatus,
CleanupStatus, DetectionLevel, DetectionSource, EvidenceStatus).
- Alembic baseline migration 202605210001_initial_schema: creates every
table, enum, index, and idempotent grants for the audit_log
write-only Postgres role (mimic_audit_writer).
- Audit log carries prev_hash / row_hash from v1 (D-009).
- ttp_version table coexists with run.snapshot_json (D-008,
overrides H32).
2026-05-21 20:32:45 +02:00
|
|
|
|
|
|
|
|
engagement: Mapped[Engagement] = relationship(back_populates="scenarios")
|
|
|
|
|
steps: Mapped[list[ScenarioStep]] = relationship(
|
|
|
|
|
back_populates="scenario",
|
|
|
|
|
cascade="all, delete-orphan",
|
|
|
|
|
order_by="ScenarioStep.order_idx",
|
|
|
|
|
)
|
|
|
|
|
runs: Mapped[list[Run]] = relationship(back_populates="scenario")
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
class ScenarioStep(UuidPkMixin, TimestampsMixin, Base):
|
|
|
|
|
__tablename__ = "scenario_step"
|
|
|
|
|
__table_args__ = (
|
|
|
|
|
UniqueConstraint("scenario_id", "order_idx", name="uq_scenario_step_order_idx"),
|
|
|
|
|
)
|
|
|
|
|
|
|
|
|
|
scenario_id: Mapped[UUID] = mapped_column(
|
|
|
|
|
ForeignKey("scenario.id", ondelete="CASCADE"),
|
|
|
|
|
nullable=False,
|
|
|
|
|
)
|
|
|
|
|
order_idx: Mapped[int] = mapped_column(Integer, nullable=False)
|
|
|
|
|
|
|
|
|
|
ttp_id: Mapped[UUID] = mapped_column(
|
|
|
|
|
ForeignKey("ttp.id", ondelete="RESTRICT"),
|
|
|
|
|
nullable=False,
|
|
|
|
|
)
|
|
|
|
|
host_id: Mapped[UUID] = mapped_column(
|
|
|
|
|
ForeignKey("host.id", ondelete="RESTRICT"),
|
|
|
|
|
nullable=False,
|
|
|
|
|
)
|
chore(backend): mypy strict clean + ruff format pass
Pre-merge sanity per devops checklist (ruff format --check, mypy --strict).
Type fixes:
- ORM models: `Mapped[dict]` → `Mapped[dict[str, Any]]` (audit, scenario, run,
report, ttp, detection.artifact_files_json). Equivalent on Pydantic DTOs
(TtpBase.params_schema_json, ScenarioStepBase.params_override_json).
- Rename `TtpRead.current_version` → `TtpRead.version` to mirror the ORM
column (which itself was renamed in D-009 cleanup).
- Flask blueprints: add `-> ResponseReturnValue` to every view, plus typed
UUID params on `_validate_step_consistency`.
- `templating/filters.py`: rewrite the conditional re2 import so mypy can
narrow the union (`ModuleType | None`); the runtime branch on `_re2 is not
None` removes the unused-ignore that was triggered by warn_unused_ignores.
- `pyproject.toml`: add `flask_login.*` and `pythonjsonlogger.*` to the
`[[tool.mypy.overrides]]` `ignore_missing_imports` list (both ship without
typed marker).
- Misc: drop stale `# type: ignore` comments (`app.py:36`,
`rbac/decorators.py:35`) flagged by `warn_unused_ignores`. Keep
`logging.JsonFormatter` ignore because the symbol exists at runtime but is
not re-exported through the typed surface.
Formatting:
- `ruff format` applied (15 files normalized; line-length unchanged at 100).
Verification on this commit:
- `ruff check` → All checks passed.
- `ruff format --check` → 68 files already formatted.
- `mypy --strict src` → Success: no issues found in 54 source files.
- `pytest tests/unit` → 49 passed.
2026-05-22 05:10:51 +02:00
|
|
|
params_override_json: Mapped[dict[str, Any]] = mapped_column(JSON, default=dict, nullable=False)
|
feat(backend): add §8 data model + Alembic baseline (B0.2, B0.3)
- SQLAlchemy 2 typed mapped classes for every spec §8 aggregate:
engagement, c2_credential, host, user, group, group_permission,
user_group, engagement_member, ttp, ttp_version, scenario,
scenario_step, run, run_step, run_step_cleanup, detection, evidence,
report, soc_session, audit_log.
- Shared mixins: UuidPkMixin (PG_UUID(as_uuid=True)) + TimestampsMixin.
- StrEnum types covering every spec enum (C2Type, PayloadType, UserType,
EngagementStatus, HostStatus, TtpSource, RunStatus, RunStepStatus,
CleanupStatus, DetectionLevel, DetectionSource, EvidenceStatus).
- Alembic baseline migration 202605210001_initial_schema: creates every
table, enum, index, and idempotent grants for the audit_log
write-only Postgres role (mimic_audit_writer).
- Audit log carries prev_hash / row_hash from v1 (D-009).
- ttp_version table coexists with run.snapshot_json (D-008,
overrides H32).
2026-05-21 20:32:45 +02:00
|
|
|
delay_after_ms: Mapped[int] = mapped_column(Integer, default=0, nullable=False)
|
|
|
|
|
|
|
|
|
|
scenario: Mapped[Scenario] = relationship(back_populates="steps")
|
|
|
|
|
ttp: Mapped[Ttp] = relationship()
|
|
|
|
|
host: Mapped[Host] = relationship()
|