Skip to content
Alejandro Rojas

Professional case study

Agentic Security & Compliance Platform

An agent-based security and compliance platform: multi-step workflows that analyze software repositories, assess security risk, and surface actionable remediation guidance through a web interface for developers and security workflows.

Problem

Security analysis over real repositories is hard

Repository and security analysis operates on large, inconsistent code and context. Reasoning spans multiple stages, security policy has to be evaluated against that context, and a finding only matters if it comes with actionable remediation. And the core reasoner — an LLM — is probabilistic: its output can’t be blindly trusted, so the system has to make it trustworthy through engineering.

My Role

What I worked on

The platform was a team effort — I wasn’t its sole architect, and this isn’t the whole security program. My engineering contribution spanned:

  • Repository / context ingestion & shaping — pulling code and dependency context from GitHub repositories and structuring it so downstream analysis works from relevant material.
  • Multi-step agent workflows — orchestrating security analysis in controlled stages rather than one-shot prompts.
  • Deterministic policy / guardrail evaluation — working on deterministic checks that bound and validate agent findings.
  • Structured findings & remediation — developing machine-readable finding structures with risk / impact context and actionable remediation guidance.
  • Tool / repository integration — embedding analysis in source-control workflows where the code is written.
  • Observability & failure handling — keeping agent runs observable while respecting the system’s security boundaries.

System / Workflow

The conceptual pipeline

The system is internal security / compliance tooling, built in Python; analysis happens where the code lives, not in a detached console. Conceptually, a run moves through these stages:

  1. 01

    Repository / source context

    Code, dependencies, and related context from a source repository.

  2. 02

    Ingestion & context shaping

    Relevant material is selected and structured to fit a usable context.

  3. 03

    Multi-step agent analysis

    Analysis is decomposed into controlled stages, not one large prompt.

  4. 04

    Structured findings

    Results are emitted as machine-readable structures, not free-form prose.

  5. 05

    Deterministic policy / guardrail evaluation

    Checks bound what a finding may claim.

  6. 06

    Risk / impact analysis

    Findings are prioritized with blast-radius / impact context.

  7. 07

    Remediation guidance

    Each finding carries concrete next steps.

  8. 08

    Developer-facing output

    Delivered through a web interface for developers and security workflows.

Conceptual flow, not the internal architecture — described at the level a public case study can.

Engineering Decisions

Why the design choices matter

  • Context shaping. Repository content routinely exceeds a useful model context. The relevant material — which files, which dependencies, which symbols — has to be selected and structured before any analysis.
  • Multi-step orchestration. Complex security analysis is decomposed into controlled stages instead of one giant prompt; each stage produces structured output that can be validated before the next stage.
  • Structured outputs. Downstream consumers — tooling and people — need predictable, machine-readable results rather than arbitrary prose, so findings are emitted as structures.
  • Deterministic controls. Policy and security decisions can’t rest on probabilistic model output alone; deterministic checks bound what an agent may conclude.
  • Risk / impact analysis. Detection is the easy part; a finding without blast-radius / impact context and prioritization is hard to act on.
  • Remediation. The output is meant to help developers act — concrete next steps — rather than simply report.

Reliability & Failure Handling

Making agent runs dependable

  • Malformed structured output is validated against the expected structure before use; malformed results are flagged, not silently accepted.
  • Incomplete context is a first-class case: workflow steps degrade gracefully instead of compounding errors.
  • Tool, repository, and agent-step failures stay observable — failure modes are logged rather than guessed.
  • Execution is kept bounded: enough autonomy to be useful, enough constraint to be safe.
  • Deterministic guardrail evaluation doubles as a reliability control: it puts a predictable boundary on probabilistic output.

Security Considerations

Why an agentic security system needs boundaries

Two categories: controls I worked on, and design considerations the architecture has to account for.

Controls worked on

  • Deterministic policy enforcement. Policy checks — not model judgment alone — decide what a finding may claim; I worked on these guardrail checks.
  • Validation before findings surface. Findings are emitted as structured output and validated against the expected structure before use.

Design considerations

  • Untrusted repository content / prompt-injection risk. The architecture has to treat repository content as data, not directives, since it can embed instructions.
  • Least-privilege tool access. A design principle: agents should get the tool access a step needs, not more.
  • Separation of analysis and enforcement. The system analyzes and recommends; it does not enforce changes. Remediation guidance is for developers to act on.

What This Demonstrates

Outcomes and takeaways

  • Repeatable, structured analysis of the same class of problem.
  • Actionable remediation output instead of raw reports.
  • Controlled multi-step workflows: autonomy with constraint.
  • Deterministic validation around probabilistic analysis.

No quantitative business impact is reported in this case study; the engineering outcomes are what this covers.

The hard part of agentic systems is the surrounding engineering: context shaping, workflow decomposition, guardrail design, and output structuring. That is the same discipline as distributed-systems work, applied to security tooling.

PythonLLM agentsAgentic workflow orchestrationGitHub repository analysisGuardrail / policy checksStructured outputsRemediation guidance