Skip to content
View sdballpark's full-sized avatar
🎯
Focusing
🎯
Focusing

Block or report sdballpark

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
sdballpark/README.md

Robert L. Bogan Jr.

AI Security Architect | Senior Cybersecurity Engineer | Agentic AI Security

CISSP, CISM and CRISC certified cybersecurity professional working where enterprise security meets AI systems and automation.

My current work is securing AI agents, LLM applications, RAG architectures and autonomous workflows. That covers identity, authorization, prompt injection, adversarial testing, tool security, human approval, telemetry and controls whose effect can be measured.

Current Focus

  • Agentic AI security: MCP tool authorization and human approval for agent actions
  • Prompt-injection and adversarial testing of agents and RAG systems
  • LLM and agent evaluation with labeled datasets and reproducible measurement
  • AI security controls on Microsoft 365, Azure and Google Cloud
  • Detection engineering with Microsoft Sentinel and KQL

Featured Projects

Evaluation harness for NVIDIA Nemotron 3.5 Lightning, qwen2.5 and Gemini 3.8 Flash on SOC alert triage and IT-operations agent tasks. Measures accuracy, prompt-injection effects against clean twins, and whether a trusted MCP authorization gateway holds when a model is steered.

Measured result: across 216 agent episodes, 96 of them carrying injected instructions, the payloads steered three of four models into requesting privileged actions and the gateway allowed none of them. Predictions for the key experiments were committed to git before any run.

A RAG assistant on Vertex AI and Cloud Run, attacked and then secured one control layer at a time across nine modules: IAM, Model Armor, VPC Service Controls, Sensitive Data Protection, Cloud Armor, CMEK, detections and identity-scoped retrieval.

Measured result: with no controls, 17 of 20 attack prompts and 8 of 10 harmless questions leaked synthetic SSNs and card numbers through a poisoned document. Model Armor alone stopped the leaks but blocked all 30 requests. Adding a DLP ingestion pipeline kept leaks at zero and let harmless questions through again. One finding: a Model Armor setting reported "Enabled" while only inspecting traffic, not blocking it.

A declarative Microsoft 365 Copilot agent grounded in SharePoint, calling a controlled Security Actions API with Entra token validation, READ / WRITE / PRIVILEGED / DENIED actions, independent human approval and a tamper-evident audit chain.

Measured result: 6 of 6 deterministic control-plane cases and 7 of 7 live Microsoft 365 security checks passed. Indirect prompt injection, a document posing as an approval, and agent self-approval were all blocked.

Secure MCP gateway for AI agents with four-tier authorization, human approval for privileged actions, prompt-injection defenses, append-only auditing, and ITSM and identity integration patterns.

Measured result: no privileged or denied action executed in 216 agent episodes run against it by the Nemotron lab, including every episode in which the model was steered.

LLM-driven SOC alert triage using ASIM-normalized alerts, a labeled evaluation corpus and a measured test harness.

Measured result: 90% accuracy with a 0% false-close rate on the project evaluation set, reproduced at 90.2% over 500 triages in the Nemotron lab.

Natural-language-to-KQL benchmark for security questions.

Measured result: schema grounding raised execution success from 9.1% to 68.2% on a local 14B model, measured against a real Kusto engine on the project test set.

Local clinical RAG over a medical reference manual, with hybrid retrieval, domain cross-encoder confidence, two-layer abstention, and an evaluation harness using human-validated judges.

Measured result: on 48 golden items, the abstention gate refused all 6 out-of-corpus questions while serving 98% of answerable ones, with 90% citation coverage and no invalid citations. A validation run that seemed to show both judges missing all 10 injected hallucinations turned out to be scoring stale verdicts; judged correctly, MiniCheck caught 10 of 10.

Other Projects

  • AI Security Platform: a Rust prompt-injection detection engine and a Go security gateway sharing one detection core. A CI gate runs a labeled corpus on every commit: 25 of 26 attacks detected and 0 of 15 benign inputs flagged; the miss is character-spaced text.
  • Remediation Recommender: two-stage recommendation engine with collaborative filtering and LightGBM LambdaRank, a SQL feature pipeline, an evaluation gate and FastAPI serving.
  • AI Agent Automation: multi-stage LLM workflow that generates, reviews and revises structured content.

AI Security Architecture Themes

Agent security

Identity → Authorization → Tool permission → Human approval → Execution → Audit

RAG security

User → Retrieval → Untrusted content → LLM → Policy enforcement → Response

Adversarial testing

Prompt injection · Indirect prompt injection · Tool abuse · Privilege escalation · Data exfiltration · Unsafe agent actions

AI governance

NIST AI RMF · MITRE ATLAS · OWASP LLM Top 10 · Secure by design · Zero Trust · AI TRiSM

Cybersecurity Background

Enterprise security architecture and engineering across EDR/XDR, endpoint security, vulnerability management, IAM, SIEM, security automation, cloud security, compliance and incident response.

Platforms and tools: Microsoft Azure · Google Cloud · Microsoft Sentinel · Microsoft Defender · Tanium · CrowdStrike Falcon · SentinelOne · ServiceNow · Splunk · Tenable · Python · PowerShell

Earlier Machine Learning Work

These projects trace the path from applied machine learning into AI security engineering.

Connect

LinkedIn

Pinned Loading

  1. nemotron-agent-eval-lab nemotron-agent-eval-lab Public

    Nemotron, qwen2.5 and Gemini on SOC triage and IT-ops agent tasks, with clean-twin injection tests. 216 agent episodes: models steered into privileged requests, gateway allowed none.

    Python

  2. gcp-ai-security-lab gcp-ai-security-lab Public

    Attacking and securing a Vertex AI RAG app on Google Cloud, one control at a time. No controls: 17 of 20 attacks leaked PII. Model Armor plus DLP: zero leaks, with harmless questions still answered.

    HCL

  3. itops-mcp-gateway itops-mcp-gateway Public

    MCP server exposing IT service management and identity tools to AI agents, with four-tier permissions, human approval for entitlement changes, and an append-only audit trail.

    Python

  4. agentic-soc-triage agentic-soc-triage Public

    LLM agent for SOC alert triage over ASIM-normalized alerts, with a labeled corpus and a measured eval harness. 90% accuracy, 0% false-close rate.

    Python

  5. sentinel-kql-eval sentinel-kql-eval Public

    Natural-language to KQL benchmark for security questions. Schema grounding raises execution from 9.1% to 68.2% on a local 14B model, measured against a real Kusto engine.

    Python

  6. secure-m365-copilot-agent-lab secure-m365-copilot-agent-lab Public

    Microsoft 365 Copilot agent calling an Entra-validated Security Actions API, with human approval and a tamper-evident audit chain. 6/6 control-plane and 7/7 live checks passed.

    Python