Muhammad Ali Qasmi

ASSEMBLED

Muhammad Ali Qasmi: AGENTIC SYSTEMS

I design and build production AI systems: multi-agent platforms, the harness around frontier models, the evaluation that makes them safe to ship, and autonomous systems that act within set limits.

See the workBook a call

Telemetry: key figures

Muhammad Ali Qasmi is a Senior AI Engineer, Senior Engineering Manager and Senior Product Engineer who designs and builds production agentic AI: multi-agent platforms, harnesses for frontier models, evaluation harnesses and autonomous systems. Four figures from thirteen years of systems that had to stay up, and four years as Engineering Manager of the team that built one of them.

Production SLA held across seven microservices I maintained
99.99%
Cellular sites served by ML platforms I architected
70,000+
Operational labour cost avoided by an extraction platform I built and scaled
~$6M
AWS compute run-rate cut by a spot fleet I designed
~60%

Figures as stated on the public CV.

What I build

Six capabilities, each with a production record. Together they cover the full path from a frontier model to a system an organisation can trust.

Flagship · my reference design

An AI agent platform for autonomous infrastructure operations

Challenge

Infrastructure operations run on procedures written for people, telemetry that arrives faster than people can read it, and decisions that must be explainable after the fact. The design goal I set: an agent platform that turns documentation into machine-readable procedures, keeps live situational awareness, and proposes governed actions, without ever publishing an unreviewed procedure or acting outside its authority.

Approach

Treat the model as one component of a harness. Specialised agents with single responsibilities; typed tools through MCP; retrieval that cites its sources or abstains; an evaluation harness that gates every change; human review tiers in front of anything safety-critical; and audit trails end to end.

What I built

  1. 01Multi-agent workflows of specialised, single-responsibility agents on a cloud-native agent runtime, served by a three-mode trigger framework (schedule, KPI event, manual).
  2. 02MCP servers exposing platform capabilities as callable tools.
  3. 03A RAG platform converting technical documentation into machine-readable operating procedures.
  4. 04Near real-time telemetry pipelines into the agent decision layer, plus optimisation and reporting agents with full auditability.
  5. 05Production rigour: CI/CD pipelines, Terraform infrastructure as code, OpenTelemetry observability, audit trails.
  1. Triggersschedule · KPI event · manual
  2. Orchestratorroutes work
  3. Specialist agentssingle responsibility
  4. MCP tool serverstyped tools
  5. Evaluation harnessgates every proposed procedure
  6. Human reviewtiered review before publish
  7. Publish & audittrail end to end
The harness pattern I build around a model. Every hand-off is a typed contract; nothing reaches production without an evaluation score and a human tier.

Outcome

What the design enforces: generated operating procedures pass the evaluation harness and tiered human review before they reach operators, and every proposed action carries its evidence, its authority and its audit trail. The production record of this work is in Selected work, at CV level.

What I automate

Twenty categories of engagement and 67 build blueprints I have designed: the problem, what I build, the stack, the gate, and what done looks like.

Agents and conversation

Business operations

Revenue and growth

Data and oversight

Sector workflows

AI agents and assistants

Agents and conversation · 3 blueprints

  • Operations copilot with typed toolsTeams want an assistant that acts inside their systems, not one that only talks about them.
    Build
    1. An MCP server over the internal APIs: every tool has a typed input and output schema and a permission tier (read, propose, execute).
    2. A Claude Agent SDK loop with the tool set, a system prompt that states the authority model, and a session store.
    3. A proposal queue: execute-tier actions wait for the named approver; read and propose run immediately.
    4. An audit log per tool call (who asked, what ran, what changed) and a Slack front end.
    Stack
    Claude Agent SDK, MCP, Postgres, Slack Bolt, OpenTelemetry
    Gate
    Fifty gold tasks scored by an LLM-as-judge for correctness and for refusing out-of-scope asks; the execute tier switches on only after the pass.
    Done
    The assistant completes the team's top ten requests end to end, and every action is attributable.
  • Scheduled agent that watches and actsSomeone checks the same dashboards, queues or inventories every morning and raises the same tickets by hand.
    Build
    1. A three-mode trigger framework: schedule, KPI threshold, manual.
    2. Single-responsibility agents, each with one question to answer and the tools it needs.
    3. Proposals land in a review queue; a small class of low-risk actions is auto-approved under limits.
    4. Durable execution so a long wait for approval survives restarts.
    Stack
    Temporal (or cron plus Postgres), Claude, MCP tools, Grafana
    Gate
    Thirty historical days through the pipeline: the agent must raise every real incident and no more than one false alarm per week.
    Done
    The morning check runs itself, and the owner reviews a short list instead of a dashboard.
  • Multi-agent research and drafting teamReports take days because research, writing and checking are done by one person in sequence.
    Build
    1. Planner, researcher, writer and critic agents with a shared memory and a token budget each.
    2. Sources are fetched through tools and stored with URLs; the writer may only cite stored sources.
    3. The critic scores against a written bar and returns the draft until it passes.
    4. Output is a document with inline citations and an appendix of what was searched.
    Stack
    Claude Agent SDK, web and document tools, pgvector, Markdown to Docx
    Gate
    Ten past reports regenerated and judged against the originals for coverage, accuracy and citation validity.
    Done
    A first draft with sources in under an hour, reviewed by the analyst before it leaves the team.

Conversational AI and chatbots

Agents and conversation · 3 blueprints

  • Support bot with a clean hand-offCustomers ask the same twenty questions, and the hard cases still need a person with full context.
    Build
    1. Grounded answers from the help centre and the order API, with a citation on every answer.
    2. A refusal policy for out-of-scope topics and a confidence threshold for escalation.
    3. Hand-off creates a ticket with a transcript summary, the customer's intent and what was already tried.
    4. A review loop that turns corrected answers into new help-centre entries.
    Stack
    Claude, pgvector, Intercom or Zendesk APIs, Postgres
    Gate
    A gold set of three hundred real conversations: resolution accuracy, false-resolution rate and escalation precision, scored before launch and weekly after.
    Done
    The routine questions resolve themselves, and agents open escalations that already contain the context.
  • Website assistant that qualifies and booksVisitors leave with questions a sales person could have answered, and forms collect too little to act on.
    Build
    1. Answers from the site's own content, with a strict no-invention rule and a short tone guide.
    2. A qualification flow (need, timeline, size) that stays conversational.
    3. A booking tool on the calendar and a CRM write with the full transcript.
    4. An opt-in for follow-up, logged with consent.
    Stack
    Claude, Next.js widget, Calendly API, HubSpot API
    Gate
    Fifty scripted visitor journeys judged for accuracy and for never promising what the site does not say.
    Done
    Qualified conversations become meetings on the calendar with notes already in the CRM.
  • WhatsApp and SMS service botCustomers message on their phones, and replies depend on whoever is on shift.
    Build
    1. Twilio messaging in, with language detection and templated replies for regulated message types.
    2. Order and appointment lookups through typed tools; no free-form access to customer data.
    3. Quiet-hours and opt-out handling built in.
    4. A hand-off to a human inbox with the thread attached.
    Stack
    Twilio, Claude, MCP tools, Postgres
    Gate
    Every supported intent has test conversations in each language; the bot must pass them all before a number goes live.
    Done
    Status questions answer themselves at any hour, in the customer's language.

Voice AI

Agents and conversation · 3 blueprints

  • Inbound phone agent for appointmentsThe phone rings more than the front desk can answer, and most calls are bookings and reschedules.
    Build
    1. A real-time pipeline: telephony in, streaming speech-to-text, the model, streaming text-to-speech, with barge-in.
    2. A calendar tool with availability rules, and a transfer-to-human path with a spoken summary.
    3. A latency budget per stage, measured on every call.
    4. Call recording and transcripts stored with consent.
    Stack
    Twilio or Telnyx, LiveKit Agents or Pipecat, Deepgram, ElevenLabs or Cartesia, Claude
    Gate
    A scripted call set covering accents, interruptions and edge cases; booking accuracy and a response-time ceiling are both gates.
    Done
    Routine calls are booked without a person, and the rest reach one with the context already spoken.
  • After-call summariser that writes the CRMCalls end and the notes never make it into the system.
    Build
    1. Recordings to transcripts, then to a structured note: outcome, commitments, next step, risks.
    2. A CRM write that updates fields and creates the follow-up task.
    3. A quality score per call against a coaching rubric, visible to the rep first.
    Stack
    Deepgram or Whisper, Claude with structured outputs, HubSpot or Salesforce API
    Gate
    One hundred calls with human-written notes as the reference; field accuracy and commitment recall are scored.
    Done
    Every call leaves a complete record and a task, with no typing.
  • Outbound reminders and confirmationsNo-shows and missed renewals cost more than a reminder call would.
    Build
    1. Consented call lists with time windows and retry rules.
    2. Scripted flows with both spoken and keypad responses, and a reschedule tool.
    3. Opt-out and do-not-call handling, logged.
    4. Results written back to the source system.
    Stack
    Twilio Voice, Pipecat, Cartesia, Claude, Postgres
    Gate
    A dry run against a test cohort; confirmation accuracy and complaint rate are reviewed before scaling.
    Done
    Confirmations arrive on time and the schedule holds.

Internal knowledge systems

Agents and conversation · 3 blueprints

  • Ask-the-docs with citations and permissionsThe answer exists in Confluence, Notion or Drive, and nobody can find it.
    Build
    1. Connectors that respect source permissions, so a user only gets answers from what they can read.
    2. Hybrid retrieval (keyword plus embeddings) with reranking, and a citation on every claim.
    3. An 'I do not know' path when retrieval is weak, instead of a confident guess.
    4. A feedback loop that turns bad answers into retrieval fixes.
    Stack
    Claude, pgvector, BM25, source APIs, Slack or web front end
    Gate
    A question set with known answers: retrieval recall, answer precision and citation validity, wired into CI.
    Done
    People ask once, get a sourced answer, and stop pinging the one person who knows.
  • Slack answer agent that learns from resolved threadsThe same questions are answered in Slack every week and the answers scroll away.
    Build
    1. A miner that finds resolved threads and drafts FAQ entries, approved by the channel owner.
    2. An in-channel agent that answers from the approved set with links to the original thread.
    3. A weekly digest of what was asked and what has no answer yet.
    Stack
    Slack Bolt, Claude, Postgres, pgvector
    Gate
    Answer precision on a held-out month of threads; nothing unapproved can be cited.
    Done
    Institutional answers accumulate, and new joiners find them.
  • Procedure generator from technical documentationManuals describe systems; operators need step-by-step procedures that match them.
    Build
    1. Ingestion of manuals and specs into a versioned store.
    2. Generation of procedures against a checklist schema: preconditions, steps, checks, rollback.
    3. A validation gate that checks every step against the source, and the operations lead signs off before publish.
    4. Versioning so a changed manual re-opens the procedures that depend on it.
    Stack
    Claude, pgvector, structured outputs, Git-backed store
    Gate
    A set of procedures reviewed by a domain expert; the gate must catch every seeded error.
    Done
    Operators follow procedures that are traceable to the documentation and reviewed by a person. Same pattern: Flagship

Workflow automation

Business operations · 3 blueprints

  • Approval workflows with an agent in the loopRequests arrive by email and chat, get lost, and approvals take weeks.
    Build
    1. An intake form with an agent that completes missing fields and checks policy before routing.
    2. Durable approval steps with reminders, timeouts and a named escalation owner.
    3. A full audit trail: who asked, what the agent checked, who approved.
    4. Reporting on cycle time by step.
    Stack
    Temporal, Claude, Postgres, Slack and email
    Gate
    Last quarter's requests rerun through the intake: routing accuracy and policy-check precision scored against the actual outcomes.
    Done
    Requests move on their own, and nothing waits in silence.
  • Shared-inbox triage and draftingA shared inbox is read by three people and answered by none.
    Build
    1. Classification into intents with confidence, and extraction of the facts each intent needs.
    2. Routing to the right queue, with a drafted reply for the common cases.
    3. Low-confidence items go to the queue owner with the draft attached.
    4. Metrics on time to first response by intent.
    Stack
    Gmail or Microsoft Graph API, Claude with structured outputs, Postgres
    Gate
    A labelled month of mail: classification accuracy, extraction accuracy and draft acceptance rate.
    Done
    Every message is routed within minutes and the easy ones are answered.
  • Meeting-to-action pipelineDecisions are made in meetings and lost by the next one.
    Build
    1. Transcripts into decisions, actions, owners and dates, with the quote that supports each.
    2. Owner confirmation in chat before anything is created.
    3. Tickets created in the tracker with a link back to the moment in the recording.
    Stack
    Fathom or Granola or Zoom transcripts, Claude, Jira or Linear API, Slack
    Gate
    Twenty meetings with human minutes as reference: action recall and owner accuracy.
    Done
    Every meeting ends with tracked actions and no minute-taker.

Finance and operations automation

Business operations · 4 blueprints

  • Invoice capture with confidence routingInvoices arrive in every layout and someone keys them in.
    Build
    1. Extraction to a fixed schema (vendor, lines, tax, totals) with a confidence per field.
    2. Three-way matching against purchase orders and receipts.
    3. Exceptions (new vendor, mismatch, duplicate risk, low confidence) go to a review queue; the rest post automatically.
    4. Posting to the ledger with an audit trail.
    Stack
    Claude with structured outputs, QuickBooks or NetSuite API, Postgres
    Gate
    Five hundred historical invoices: field accuracy and the share routed to review are both tracked and gated.
    Done
    Most invoices post without a person, and the exceptions arrive with the reason attached.
  • Bank reconciliation assistantUnmatched transactions pile up until month end.
    Build
    1. Deterministic matching first; the model handles partial amounts, timing differences and renamed payees.
    2. Proposed journal entries with an explanation and the evidence.
    3. The controller approves in one screen; approved patterns become rules.
    Stack
    Bank feeds, Claude, Postgres, ledger API
    Gate
    Against the accountant's final books for six months: match rate and false-match rate, both gated.
    Done
    The reconciliation is a short review rather than a day of work.
  • Month-end close checklist agentClose runs on a spreadsheet, and the variance explanations are written at midnight.
    Build
    1. A task list per entity with owners, dependencies and evidence slots.
    2. Agents that pull balances, compute variances and draft explanations from the underlying transactions.
    3. Evidence attached to each task; sign-off recorded.
    Stack
    Claude, warehouse or ledger queries, Postgres, Slack
    Gate
    Variance drafts compared with the controller's final notes; precision gates the roll-out.
    Done
    Close status is visible at any hour, and the explanations arrive with the numbers.
  • Expense policy checkerExpense reports are approved without anyone checking them.
    Build
    1. Receipt extraction and matching to claims.
    2. Policy as rules plus a model for the judgement calls, each flag with a reason.
    3. Anomaly flags across employees and vendors.
    4. A reviewer queue for flags only.
    Stack
    Claude, expense platform API, Postgres
    Gate
    A labelled set of past reports: flag precision and recall against known violations.
    Done
    Reviewers see the few reports that matter.

Recruitment and HR automation

Business operations · 3 blueprints

  • Structured screening against a rubricHundreds of applications, inconsistent first reads, and bias risk in both directions.
    Build
    1. A job-specific rubric written with the hiring manager; every score cites evidence from the application.
    2. Identity fields removed before scoring; consistency checks across reviewers and reruns.
    3. Scores and evidence go to the recruiter, who decides; the system never rejects.
    4. ATS integration for intake and notes.
    Stack
    Greenhouse or Ashby API, Claude with structured outputs, Postgres
    Gate
    A past requisition with known outcomes: rubric agreement with the hiring panel, plus a parity check across groups.
    Done
    Recruiters start from an evidence table instead of a pile.
  • Interview scheduling and prep packsScheduling takes more emails than the interview takes minutes.
    Build
    1. Calendar coordination across panels with constraints.
    2. A prep pack per interviewer: role, rubric, the questions they own, and the candidate summary.
    3. Scorecard reminders and a consolidated debrief draft.
    Stack
    Google or Microsoft calendar APIs, ATS API, Claude
    Gate
    A month of real scheduling requests rerun: every constraint honoured, and prep packs rated usable by at least nine of ten interviewers.
    Done
    Interviews get scheduled and prepared without a coordinator in the loop.
  • Onboarding conciergeNew joiners wait for access and ask the same questions in their first week.
    Build
    1. A day-by-day plan generated from role and team.
    2. Access requests raised through tools, tracked to completion.
    3. Questions answered from HR and team documentation with citations.
    Stack
    Claude, HRIS and IT ticketing APIs, pgvector, Slack
    Gate
    A dry run with the last five joiners' questions; answer accuracy and request completion time.
    Done
    Every new joiner has access and a plan before their first morning.

Custom integrations and internal tools

Business operations · 3 blueprints

  • MCP server generated from an OpenAPI contractAn internal API exists, and no agent can use it safely.
    Build
    1. Tools generated from the contract with typed inputs and outputs and the auth model.
    2. Rate limits, read and write scopes, and redaction of sensitive fields.
    3. A test per tool, run in CI against a sandbox.
    Stack
    MCP, OpenAPI, TypeScript or Python, CI
    Gate
    Every tool passes its contract tests; a judge checks that tool descriptions make agents pick the right one.
    Done
    Any agent in the company can use the API within its permissions.
  • Internal admin tool with agent assistSupport and ops staff run bulk changes through scripts and hope.
    Build
    1. A small admin app over the domain model.
    2. An agent that turns a request into a bulk operation, shown as a preview and a diff.
    3. Approval and execution with a rollback plan and an audit record.
    Stack
    Next.js, Postgres, Claude, MCP tools
    Gate
    A suite of operations with expected diffs; nothing executes without matching its preview.
    Done
    Bulk changes are safe, reviewable and reversible.
  • Legacy system bridgePartners still send CSV, SFTP drops or EDI, and someone re-keys them.
    Build
    1. Ingestion from the legacy channel with schema mapping proposed by the model and approved once.
    2. Validation, idempotent writes and replay for failures.
    3. A dashboard of what arrived, what failed and why.
    Stack
    Python, Temporal, Postgres, target API, Claude for the first mapping
    Gate
    Historical files replayed against the known-good records; mapping accuracy and replay safety.
    Done
    The partner keeps their format and the data lands correctly anyway.

Sales and outreach automation

Revenue and growth · 3 blueprints

  • Inbound lead qualification and routingInbound leads wait, and the best ones get the same template as the rest.
    Build
    1. Enrichment from company and contact sources with provenance stored.
    2. Scoring against the ideal customer profile with reasons.
    3. Routing and assignment in the CRM, and a drafted first reply for the rep to send.
    4. Suppression for existing customers and opted-out contacts.
    Stack
    HubSpot or Salesforce API, Clay or Apollo, Claude, Postgres
    Gate
    Last quarter's leads rerun: score agreement with closed outcomes, routing accuracy, reply acceptance by the reps.
    Done
    Every lead is enriched, scored and in the right hands within minutes.
  • Research-backed outbound draftsOutbound is either generic or takes an hour per account.
    Build
    1. An account research agent with sources (site, filings, hiring, news) stored per claim.
    2. Drafts in the team's voice, grounded only in stored facts, with the reason to reach out.
    3. Human approval per sequence; nothing sends itself.
    4. Compliance: consent basis, unsubscribe, regional rules.
    Stack
    Claude, web tools, sequencing platform API, CRM
    Gate
    Fifty accounts judged for factual accuracy and relevance; a draft with an unsupported claim fails.
    Done
    Reps send researched messages at template speed.
  • Call notes to CRM hygieneThe CRM is out of date because updating it is a chore.
    Build
    1. Transcripts to deal fields: stage, next step, risks, stakeholders.
    2. Proposed updates shown to the rep for one-click acceptance.
    3. Pipeline review digest built from the accepted updates.
    Stack
    Gong or Fathom API, Claude, CRM API
    Gate
    Field accuracy against rep-corrected records over a month.
    Done
    Forecast calls use data that is actually current.

E-commerce automation

Revenue and growth · 4 blueprints

  • Catalogue enrichment from supplier dataSupplier datasheets arrive in every format, and listings go live incomplete.
    Build
    1. Extraction of attributes to the category schema, with confidence.
    2. Titles, descriptions and alt text in the brand's voice; taxonomy mapping with review for new categories.
    3. A review queue for low confidence and new attributes; approved items publish.
    Stack
    Shopify Admin API, Claude with structured outputs, Postgres
    Gate
    Five hundred products with human-completed listings as reference; attribute accuracy and publish-without-edit rate.
    Done
    New products reach the store complete, and the team edits only exceptions.
  • Order exception deskLate shipments, bad addresses and failed payments create tickets that need the same five actions.
    Build
    1. Exceptions detected from order and carrier events.
    2. Classification and the allowed action per class (re-ship, address fix, refund, hold).
    3. Customer notification drafted and sent after action; higher-value cases go to the operations lead.
    Stack
    Shopify or order system webhooks, carrier APIs, Claude, Temporal
    Gate
    A month of exceptions rerun: action correctness checked by the operations lead, customer-contact tone judged.
    Done
    Most exceptions resolve before the customer writes in.
  • Returns and refunds agent under policyReturn requests are judged inconsistently and slowly.
    Build
    1. Policy as code: windows, conditions, limits per customer and order value.
    2. An agent that gathers the facts, applies the policy and explains the decision.
    3. A refund tool with hard limits; beyond them, the support lead approves.
    Stack
    Shopify or returns platform API, Claude, Postgres
    Gate
    Historical returns replayed; decision agreement with the policy owner and zero over-limit refunds.
    Done
    Returns are decided in minutes, consistently, within policy.
  • Review and question responderProduct questions and reviews go unanswered, and defects are noticed late.
    Build
    1. Drafted answers from product data and policy, approved by the merchandiser at first, then by exception.
    2. Defect and sizing signals extracted from reviews and sent to the product team weekly.
    Stack
    Marketplace and store APIs, Claude, Postgres
    Gate
    Answer accuracy on a labelled set; defect signals checked against known issues.
    Done
    Shoppers get answers, and the product team hears problems early.

Content and marketing pipelines

Revenue and growth · 3 blueprints

  • Brand-voice content pipeline with review gatesContent volume rises, and quality and voice drift with it.
    Build
    1. Brief to research to draft, with sources stored and cited.
    2. Critics for voice, facts and search readiness (SEO and answer-engine structure), each with a written bar.
    3. A CMS draft with metadata and schema markup, waiting for the editor.
    Stack
    Claude, web tools, CMS API, Postgres
    Gate
    Twenty drafts judged against the house style guide; a draft with an unsupported fact fails.
    Done
    Editors edit instead of write, and the voice stays the brand's.
  • Repurposing engineOne long piece should become ten, and it becomes none.
    Build
    1. Long-form in; social posts, newsletter sections, scripts and summaries out, each in its format rules.
    2. A review step per channel owner.
    3. Scheduling through the existing tools.
    Stack
    Claude, CMS and social APIs
    Gate
    Twenty source pieces, each channel's derivatives rated by its owner: a channel is automated only once four in five are accepted without edits.
    Done
    Every long piece ships with its derivatives.
  • Search content refresh agentPages decay quietly and nobody owns the refresh.
    Build
    1. Decay detection from search analytics.
    2. Proposed updates as diffs, with the evidence (queries lost, competitors, stale facts).
    3. Editor approval and publish, with before and after tracking.
    Stack
    Search Console API, Claude, CMS API
    Gate
    Proposed updates reviewed by an editor; precision of the decay signal measured over a quarter.
    Done
    The content library maintains itself under editorial control.

Data enrichment and research automation

Revenue and growth · 4 blueprints

  • Company and contact enrichment with provenanceEnriched data is bought, merged and trusted without knowing where it came from.
    Build
    1. Multi-source enrichment with a stored source and timestamp per field.
    2. Deduplication and conflict resolution with confidence.
    3. A refresh schedule and change alerts.
    Stack
    Claude, enrichment APIs, Postgres
    Gate
    A sample verified by hand; field accuracy by source, so weak sources are dropped.
    Done
    Every record can answer 'how do we know this'.
  • Competitive monitoring digestCompetitor changes are noticed when a customer mentions them.
    Build
    1. Watchers on pages, pricing, releases, job posts and filings.
    2. Diffs summarised with citations; noise filtered by a relevance bar.
    3. A weekly digest and an alert channel for big moves.
    Stack
    Web fetch and diff, Claude, Postgres, Slack
    Gate
    Three months backfilled; a product manager rates relevance to set the bar.
    Done
    The team sees changes the week they happen.
  • Tender, grant and RFP scannerOpportunities are found late or not at all.
    Build
    1. Sources crawled on a schedule; eligibility rules applied; a summary with deadlines and requirements.
    2. A tracker with owners and a go/no-go record.
    3. Drafted question lists and outline for the ones pursued.
    Stack
    Web tools, Claude, Postgres
    Gate
    Past opportunities replayed: recall of the ones the team actually pursued.
    Done
    Nothing eligible is missed, and the decision is recorded.
  • Literature and market scansA review of fifty papers or reports takes a month.
    Build
    1. Structured extraction per document against a schema agreed with the reader.
    2. A comparison table and a synthesis with citations to page or section.
    3. A gap list of what the sources do not say.
    Stack
    Claude, PDF tools, Postgres
    Gate
    Twenty documents extracted and compared with the subject expert's own table: field agreement per column before the full run.
    Done
    The reader starts from a table, not a stack.

Document and data processing

Data and oversight · 3 blueprints

  • Schema-guided extraction serviceEach new document type becomes a new manual process.
    Build
    1. A service that takes a JSON schema and a document and returns the fields with confidence and locations.
    2. A review interface that shows the source span for each field.
    3. Corrections stored as examples that improve the next run.
    Stack
    Claude with structured outputs, PDF and OCR tools, Postgres, small review UI
    Gate
    Per document type, a labelled set; field accuracy and the share needing review are gated.
    Done
    A new document type is a schema and a day, not a project.
  • Form and contract intake to systems of recordSigned forms are scanned, emailed and re-typed.
    Build
    1. Classification of incoming documents, extraction, validation against business rules.
    2. Writes to the system of record with the document attached and the extracted values stored.
    3. Exceptions routed with the reason.
    Stack
    Email and scan intake, Claude, target system API, Postgres
    Gate
    A month of intake rerun: rule-violation detection and write accuracy against the records the team entered by hand.
    Done
    Documents become records on arrival.
  • Long-document summaries with page citationsNobody reads the two-hundred-page report, and decisions rest on the summary someone wrote once.
    Build
    1. Chunking with structure awareness, section summaries, then a synthesis.
    2. Every claim cites a page; a question tool for follow-ups.
    3. Output in the reader's template.
    Stack
    Claude, PDF tools
    Gate
    Summaries checked by the reader against the source on a sample; an uncited claim fails.
    Done
    Long documents answer questions in minutes, with the page to check.

Data pipeline and ETL automation

Data and oversight · 3 blueprints

  • Agent-assisted ingestion for new sourcesEvery new data source is weeks of mapping, modelling and tests.
    Build
    1. The agent profiles the source, proposes a schema mapping, the dbt models and the tests.
    2. The data engineer reviews the pull request; the agent fixes test failures.
    3. Lineage and documentation generated from the result.
    Stack
    dbt, Dagster or Airflow, Claude, Git
    Gate
    Three past sources rebuilt from scratch and compared with production models.
    Done
    A new source is a reviewed pull request within days.
  • Schema-drift sentinelA renamed column breaks a dashboard three days later.
    Build
    1. Detection of source changes on every run.
    2. An impact map across models and dashboards, and a proposed fix as a pull request.
    3. Owners notified with the blast radius.
    Stack
    Warehouse metadata, dbt, Git, Slack, Claude for the proposed fix
    Gate
    Seeded drift in a staging copy; every case must be caught and correctly mapped.
    Done
    Drift is a notification and a fix, not an outage.
  • Data quality triageQuality checks fail and the alert goes to a channel nobody reads.
    Build
    1. Failed expectations trigger a root-cause agent that queries the data and the recent changes.
    2. A diagnosis with evidence sent to the owner, with a suggested fix.
    3. A weekly report on failure classes.
    Stack
    Great Expectations or dbt tests, Claude, warehouse, Slack
    Gate
    Past incidents replayed; diagnosis accuracy rated by the data team.
    Done
    Alerts arrive with a cause and an owner.

AI analytics and reporting

Data and oversight · 3 blueprints

  • Governed natural-language analyticsText-to-SQL over raw tables gives confident wrong answers.
    Build
    1. A semantic layer with certified metrics, joins and access rules.
    2. An agent that answers only within the modelled scope and says so when a question is outside it.
    3. Query, result and explanation shown together; charts on request.
    Stack
    dbt Semantic Layer or Cube, Claude, warehouse, Slack or web
    Gate
    A question set with known answers per metric; execution accuracy and refusal accuracy both gated.
    Done
    Business users ask in words and get the number finance would sign.
  • Automated weekly reporting agentThe weekly report takes a day to assemble and is read for a minute.
    Build
    1. Metrics pulled by certified queries; narrative drafted only from those numbers.
    2. Charts generated and the report sent where people read.
    3. A changelog of what moved and why, with links to the queries.
    Stack
    Warehouse, certified queries, a charting library, Claude for the narrative, email or Slack
    Gate
    Four weeks compared with the analyst's own reports for numeric agreement and tone.
    Done
    The report arrives Monday morning without the analyst's Friday.
  • Anomaly to explanationA metric moves and the investigation takes the afternoon.
    Build
    1. Anomaly detection on certified metrics.
    2. A drill-down agent that tests the usual dimensions and recent changes, and reports hypotheses with evidence.
    3. Findings posted to the owner with the queries attached.
    Stack
    Warehouse, Claude, Slack
    Gate
    Past incidents replayed; the real cause must appear in the top three hypotheses.
    Done
    The first hour of every investigation is already done.

Compliance and monitoring automation

Data and oversight · 4 blueprints

  • AI agent audit trail and evidence packAn auditor asks what the agents were allowed to do and what they did, and the answer is in logs nobody can query.
    Build
    1. A structured decision record per agent action: inputs, tools, gates (hard or soft), approver, outcome.
    2. Queryable storage and streaming to the monitoring platform.
    3. An export that maps records to SOC 2 and EU AI Act record-keeping expectations.
    Stack
    OpenTelemetry, Postgres or a SIEM, Claude for summaries
    Gate
    An auditor's question list answered from the records alone.
    Done
    Every agent action can be reconstructed and attributed.
  • Policy checks on communications and contentRegulated statements slip into emails, posts and decks.
    Build
    1. Rules for the hard constraints, a model classifier for the judgement calls, each flag with the policy clause.
    2. A review queue with override reasons recorded.
    3. A monthly report of flags by team and policy.
    Stack
    Claude, email and content platform APIs, Postgres
    Gate
    A labelled corpus of past content; flag precision and recall by policy.
    Done
    Flagged content is held for review before it is sent, with the policy clause attached.
  • Control evidence collectionAudit season means weeks of screenshots and spreadsheets.
    Build
    1. Scheduled collectors across cloud, source control, identity and HR systems.
    2. Evidence mapped to controls, with freshness and gaps shown.
    3. An agent that drafts the control narrative from the evidence.
    Stack
    Cloud and SaaS APIs, Postgres, Claude for the narrative drafts
    Gate
    Each control's collected evidence compared with last audit's accepted evidence: a control is automated only when its collector matches on every item.
    Done
    Audit requests are answered from a live evidence store.
  • AI system register with risk tiersNobody can list the AI systems in use or where the EU AI Act places them.
    Build
    1. An inventory with purpose, data, model, vendor and owner per system.
    2. Risk tiering against the Act's categories, with the reasoning recorded.
    3. Obligations per tier tracked to evidence.
    Stack
    Postgres, Claude, a small web app
    Gate
    Counsel's tiering of the first twenty systems is the reference; the model's tier must match on every one before it tiers unassisted.
    Done
    Every AI system in use is listed, tiered and owned.

Legal tech automation

Sector workflows · 3 blueprints

  • Contract review against a playbookRoutine agreements take the same senior hours as the hard ones.
    Build
    1. Clause extraction and comparison with the firm's playbook positions and fallbacks.
    2. Deviations ranked and redlines drafted in Word, with the playbook reason on each.
    3. A lawyer accepts, edits or rejects; the system never finalises.
    Stack
    Claude, Word add-in or document API, Postgres
    Gate
    Fifty reviewed agreements: deviation recall and redline acceptance by the lawyers.
    Done
    Lawyers start from a marked-up draft and spend time on the contested terms.
  • Obligation trackerRenewal dates and notice periods are found in the contract after they pass.
    Build
    1. Extraction of obligations, dates and conditions from executed agreements.
    2. A calendar and alert system with owners.
    3. A report of upcoming obligations by counterparty.
    Stack
    Claude with structured outputs, document store, calendar API
    Gate
    Extraction checked against a lawyer's abstract on a sample; a missed date fails the gate.
    Done
    Every obligation reaches its owner before its date.
  • Client intake and conflict check assistantIntake is a form, a search and an engagement letter, done by hand each time.
    Build
    1. Structured intake through chat or form, with completeness checks.
    2. A conflict search across the matter database with results for a person to clear.
    3. An engagement letter drafted from the template and the intake.
    Stack
    Claude, matter management API, document templates
    Gate
    Past intakes replayed; conflict recall must be complete.
    Done
    New matters open in minutes with the checks done.

Real estate automation

Sector workflows · 4 blueprints

  • Lead qualification that books viewingsEnquiries arrive at all hours and the fast ones win.
    Build
    1. Chat and text replies within seconds, collecting budget, timeline and pre-approval status.
    2. Viewings booked on the agent's calendar; the CRM updated with the conversation.
    3. Hot leads escalated to the agent's phone.
    Stack
    Twilio, Claude, CRM API, calendar API
    Gate
    Scripted enquiries judged for accuracy and tone; booking accuracy gated.
    Done
    Every enquiry gets an answer and the good ones get a viewing.
  • Listing content with compliance checksListings are written late and reviewed for fair-housing wording by memory.
    Build
    1. Descriptions from property data and photos, in the brokerage's voice.
    2. A compliance check against fair-housing and advertising rules, with the flagged phrase and the reason.
    3. Formatting for the listing service.
    Stack
    Claude, property data feed, listing platform API
    Gate
    A labelled set of past listings; compliance recall must be complete.
    Done
    Listings go out faster and cleaner.
  • Maintenance request triage for property managersTenant requests arrive by text and photo and need a person to read every one.
    Build
    1. Category and urgency from text and images; emergency rules are deterministic.
    2. Vendor dispatch by category with the tenant's availability.
    3. Status updates to the tenant and a record for the owner.
    Stack
    Twilio or portal intake, Claude, vendor and property-management APIs
    Gate
    A year of requests rerun: urgency accuracy gated, and no emergency missed.
    Done
    Requests are dispatched in minutes and tenants hear back.
  • Lease abstractionKey lease terms are re-read every time a question comes up.
    Build
    1. Extraction of parties, term, rent schedule, options, obligations and critical dates.
    2. A portfolio table and alerts for upcoming dates.
    3. Page-cited answers to questions about any lease.
    Stack
    Claude, document store, Postgres
    Gate
    Fifty abstracted leases with a specialist's abstracts as the reference: field accuracy per term, and no critical date missed.
    Done
    The portfolio is a table with the leases behind it.

Education and training automation

Sector workflows · 4 blueprints

  • Course builder from source materialTurning expert material into a course takes months.
    Build
    1. Outline, lessons, examples and quizzes generated from the source, each tied to a learning objective.
    2. Item review by the subject expert; rejected items regenerated.
    3. Export to the learning platform.
    Stack
    Claude, LMS API or SCORM and xAPI export
    Gate
    Objective coverage and item quality rated by the expert before publish.
    Done
    A course draft in days, reviewed by the expert.
  • Rubric-based grading assistantGrading is slow and inconsistent across sections.
    Build
    1. Scores per rubric criterion with evidence quoted from the submission.
    2. Instructor edits any score; consistency checks across the cohort.
    3. Feedback drafted for the learner in the instructor's voice.
    Stack
    LMS API, Claude with structured outputs, Postgres
    Gate
    Agreement with instructor grades on a prior cohort; parity across groups checked.
    Done
    Instructors review scores instead of producing them.
  • Tutor grounded in the courseLearners get stuck at night and the forum answers come late.
    Build
    1. Answers only from the course material, with references to the lesson.
    2. A Socratic mode that asks before it tells.
    3. Misconceptions reported to the instructor weekly.
    Stack
    Claude, pgvector, LMS integration
    Gate
    A question set from past forums; answer accuracy and no-invention rate.
    Done
    Learners get help at any hour, within the course.
  • Training compliance trackerMandatory training is tracked in a spreadsheet and chased by email.
    Build
    1. Assignments by role, reminders, and completion evidence collected from the platform.
    2. A manager view and an audit export.
    Stack
    LMS and HRIS APIs, Postgres, email
    Gate
    A quarter of completion records reconciled against the learning platform: any assignment or completion missing from the export fails.
    Done
    Compliance status is live and provable.

Healthcare workflow automation

Sector workflows · 4 blueprints

  • Patient intake and triage summariesIntake forms are long, and the clinician reads them in the room.
    Build
    1. Structured intake through a form or chat, summarised for the clinician with flagged items.
    2. No diagnosis or advice; the summary is organised, not interpreted.
    3. Protected health information minimised and handled only through services under a business associate agreement.
    Stack
    Claude via a BAA-covered platform, FHIR-capable EHR API, encrypted storage
    Gate
    Summaries reviewed by clinicians on a sample; any omitted flagged item fails.
    Done
    The clinician walks in with the summary already read.
  • Prior authorisation packet assemblyPrior authorisations are assembled by hand against each payer's rules.
    Build
    1. Payer requirements as checklists; the chart read through FHIR for the evidence.
    2. A missing-items list for the authorisation team and a drafted packet.
    3. Status tracking and follow-up tasks.
    Stack
    FHIR APIs, Claude via a BAA-covered platform, Postgres, task queue
    Gate
    Past authorisations replayed; packet completeness checked by the authorisation team.
    Done
    Packets go out complete the first time.
  • Referral and fax processingReferrals still arrive by fax and sit in a queue.
    Build
    1. Fax to text to structured referral: patient, reason, urgency, sender.
    2. A task created in the EHR with the document attached; urgent ones flagged.
    3. A daily report of what arrived and what is pending.
    Stack
    Fax gateway, OCR, Claude via a BAA-covered platform, EHR API
    Gate
    A month of referrals replayed; extraction accuracy and urgency recall.
    Done
    Referrals are tasks within minutes of arriving.
  • Clinic phone agent for schedulingThe phone line is the bottleneck, and most calls are scheduling.
    Build
    1. A voice agent for scheduling, rescheduling and directions, with warm transfer for anything clinical.
    2. Identity verification steps before any appointment detail is read.
    3. Audit of every call and recording retention per policy.
    Stack
    Telephony, LiveKit or Pipecat, speech vendors under BAA, Claude, scheduling API
    Gate
    Scripted calls including attempts to extract another patient's information; verification must hold.
    Done
    Scheduling calls are handled and clinical calls reach a person.

These are my designs, not client records; the production record is in Selected work, at CV level. Every engagement starts with the process as it runs today, an agreed definition of done, and a measured result before anything is rolled out. Each ships with an evaluation gate and a human tier.

Selected work

Five chapters: an agent platform for autonomous infrastructure operations, cross-border commerce, network ML at national scale, four years managing an engineering team, and the distributed data platform I helped found.

Autonomous infrastructure operations

Senior AI Engineer · Qcells North America · Apr 2026–present

Context
Architecting and delivering an AI agent platform on Azure AI Foundry for autonomous infrastructure operations, and driving adoption of AI-native engineering practices through an agentic engineering framework adopted organisation-wide.
Built
  • Multi-agent workflows of single-responsibility agents with a three-mode trigger framework (schedule, KPI event, manual), and four production MCP servers exposing platform capabilities to the agent runtime.
  • A RAG platform that converts technical documentation into machine-readable operating procedures, with an LLM evaluation and safety harness and human-in-the-loop governance.
  • An agentic engineering practice: a Claude Code plugin framework of role-specialised subagents, workflow skills and AI review gates, and a nine-skill automation library.
Outcome
Adopted organisation-wide across polyglot teams, shipped with production rigour: cloud-native agent runtime, CI/CD, Terraform, OpenTelemetry and audit trails.

Career

  1. 2026–Senior AI Engineer · Qcells North America · agent platform, harness and evaluation engineering
  2. 2024–2026AI Forward Deployed Engineer · Walmart Global Tech
  3. 2022–2024Senior ML Engineer · AT&T
  4. 2019–2022Engineering Manager (Principal Software Engineer) · GfK
  5. 2016–2019Technical Team Lead; Engineering Manager from Jul 2018 (Staff Software Engineer) · GfK
  6. 2015–2016Technical Team Lead (Senior Software Engineer) · GfK
  7. 2012–2013Software Engineer · GfK
  8. 2011–2012Software Engineer · Interactive Group
  9. 2011Software Engineer · Folio3

Education

  1. 2013–2015M.Sc. Computer Science · University of Bonn, Germany
  2. 2007–2011B.Sc. Computer Science · FAST-NUCES, Pakistan

Full detail on the resume.

How I work

Six rules I hold on every AI system I ship.

Independent R&D

Systems I build to test ideas end to end, on my own stack, my own clock and my own code.

Method on every one: a written bar, critic agents that score against it, and passes until the bar is met.

Work with me

Engagements start with a 30-minute call. Four years as an Engineering Manager, then four years hands-on in AI: every build gets both.

Engagements

  • Agent platform architecture and build: from goal to governed production system.
  • Harness engineering for engineering organisations: coding-agent frameworks, skills, review gates and the adoption playbook.
  • Evaluation harness build-out: gold sets, judges, CI gates, safety tiers.
  • Business and systems automation with agents: triggers, workflows, reporting, human review.
  • AI readiness and architecture review, including EU AI Act engineering controls.

How

  • I do the work myself, inside your repositories and accounts.
  • You keep what I build for you: the code, the evaluation set and the runbook.
  • Scope and the definition of done are agreed before work starts.

Where

  • United States: based in the San Francisco Bay Area; on site or remote; U.S. Permanent Resident.
  • Europe: remote from California on European hours; studied and worked in Germany.
  • Gulf: remote or on site for engagements. National-scale infrastructure programmes are the work I know: 70,000+ cellular sites of network ML, and an agent platform for infrastructure operations.
Book a 30-minute callEmail

Frequently asked

What does Muhammad Ali Qasmi do?

I design and build production AI systems: multi-agent platforms, the harness around frontier models, LLM evaluation and safety harnesses, and autonomous software. I have 13+ years in distributed systems and four years as an Engineering Manager. I work as a Senior AI Engineer and operate at the level of a Senior Engineering Manager and Senior Product Engineer. I take on engagements for clients in the USA, Europe and the Gulf.

What is harness engineering?

Harness engineering is the discipline of building everything around a model that makes it dependable: context, tools, permissions, memory, evaluation and review gates. Agent = model + harness. I build the harness; the pattern is the Flagship case on this page: specialised agents, typed MCP tools, an evaluation harness and tiered human review before generated procedures reach operators.

What engagements do you take on?

Agent platform architecture and build; harness engineering for engineering organisations; evaluation harness build-out; business and systems automation with agents; and AI readiness and architecture reviews, including EU AI Act engineering controls. For clients in the USA, Europe and the Gulf, remote or on site.

What kinds of automation do you take on?

Five kinds of work, listed under What I automate: agents and conversation, business operations, revenue and growth, data and oversight, and sector workflows in legal, real estate, education and healthcare. Each starts with the process as it runs today and an agreed definition of done.

What is your technical stack?

Python, Java, TypeScript; Claude Code, Azure AI Foundry, MCP; Kafka, Kubernetes, Terraform, OpenTelemetry; Azure, AWS, GCP; MLflow, scikit-learn, Elasticsearch, Redis, MongoDB, Postgres.

How do I get in touch?

Book a call at calendly.com/muhammadaliqasmi or email muhammadaliqasmi+work@gmail.com.

Publications

Contact

Thirty minutes is enough to tell whether I can help. Book it, or write.

Email
muhammadaliqasmi+work@gmail.com
LinkedIn
linkedin.com/in/qasmi
Calendly
calendly.com/muhammadaliqasmi
GitHub
github.com/muhammadaliqasmi