Oriel — AI & technology worth noticing, every day.

How Octave built a secure multi-tenant AI foundation on Amazon Bedrock

Web page · https://aws.amazon.com/blogs/machine-learning/how-octave-built-a-secure-multi-tenant-ai-foundation-on-amazon-bedrock

Octave built a secure, multi-tenant AI foundation on Amazon Bedrock, using Cohere Embed v4 for embeddings and Amazon Bedrock AgentCore for isolated agent execution, to power a Complaint Triage Assistant that searches 2 billion regulated documents without crossing tenant boundaries.

First seen by Oriel on .

AI summary

Octave built a three-layer, multi-tenant AI foundation on Amazon Bedrock that isolates customer data, screens untrusted content, and supports production quality-management workflows.

  • The foundation combines Cohere Embed v4, per-tenant Amazon OpenSearch Service indexes, isolated AgentCore microVM sessions, and Amazon Bedrock Guardrails applied at multiple workflow stages.
  • Embed v4 handles text and images in one vector space and supports multilingual retrieval; testing found 512 dimensions maintained target accuracy while reducing storage by roughly 66 percent versus 1,536 dimensions.
  • An event-driven pipeline uses SNS, SQS, Step Functions, and concurrent Lambda executions to parse, chunk, and embed documents; internal testing reached 28 million tokens per minute and 1.4 million documents per 24 hours per tenant workload.
  • The Complaint Triage Assistant retrieves similar complaints and CAPAs, filters matches by root-cause confidence, and produces a brief with key facts and a recommended priority; the foundation cut deployment time per use case by 50 percent.

#amazon bedrock #multi-tenant ai #vector search #document processing

Generated by gpt-5.6-sol. Check the original for details.

Aliases

SourceExternal IDURL
AWS Machine Learning Blog71eb785a1fd13603c3885408903f8aca0b20d311https://aws.amazon.com/blogs/machine-learning/how-octave-built-a-secure-multi-tenant-ai-foundation-on-amazon-bedrock/ Read discussion