Senior Data Engineer — Retrieval & RAG Platform
- Level
- Senior
- Work type
- Remote · US only
Not stated in the posting: salary, visa.
Open. First seen 13 November 2026.
About the role
Solvd's standard text
Solvd Inc. is a rapidly growing AI-native consulting and technology services firm delivering enterprise transformation across cloud, data, software engineering, and artificial intelligence. We work with industry-leading organizations to design, build, and operationalize technology solutions that drive measurable business outcomes.
Following the acquisition of Tooploox, a premier AI and product development company, Solvd now offers true end-to-end delivery—from strategic advisory and solution design to custom AI development and enterprise-scale implementation. Our capability centers combine deep technical expertise, proven delivery methodologies, and sector-specific knowledge to address complex business challenges quickly and effectively.
We are looking for a Senior / Staff Data Engineer to build what the Agent Assist provider calls: the Bedrock Knowledge Base configuration, the OpenSearch Serverless collection, the versioned retrieval API, and the quality dashboard. You’ll own the retrieval workstream end to end, paired with the ingestion engineer, with technical direction from the Solution Architect.
This role carries the most technical risk in the engagement — entitlement filtering is a severity-one commitment. The mission: ship a retrieval API that returns the right passages, with citations, only to callers entitled to see them, at a latency and cost the client accepts, and that the client can version and operate after week 10.
What you’ll do
- Stand up the Bedrock Knowledge Base and OpenSearch Serverless vector collection in the client’s account from infrastructure code, with the embedding model, chunking strategy, and metadata fields the architect specified.
- Implement hybrid retrieval — vector plus keyword — with metadata filtering by taxonomy, source, status, and review date; tune top-k, score thresholds, and reranking against the golden question suite.
- Build the retrieval API on API Gateway and Lambda per the Integration Blueprint — versioned paths, authentication for the Agent Assist provider, per-client rate limits and usage metrics, structured error responses, and a citation payload with source URL, title, section, and last modified date.
- Enforce entitlement at query time by filtering on permission metadata the ingestion pipeline captures — no restricted passage is ever returned to an unentitled caller.
- Provide the Bedrock retrieve-and-generate reference endpoint used for pilot validation in weeks 7–9.
- Build the quality dashboard — relevance, grounding, and citation scores trended per run; permission test results; freshness lag per source; API latency and error rate; OpenSearch capacity.
- Support the contact center pilot in weeks 7–9 — capture retrieval misses, tune, and re-run the suite before each change ships.
- Write the retrieval and API runbooks including model change, re-embedding, and index rebuild procedures with cost implications.
- Pair with client platform owners in weeks 9–10 and hand over on the transition readiness checklist.
Required skills & experience
- 4+ years as a software or ML engineer, with at least one RAG or enterprise search system delivered to production and measured with an evaluation suite — not just demos.
- Hands-on with Amazon Bedrock — Knowledge Bases, Retrieve and RetrieveAndGenerate APIs, embedding models — and Amazon OpenSearch Serverless vector search including hybrid queries and metadata filters.
- Python, with experience shipping Lambda-based APIs behind API Gateway including auth, versioning, and throttling.
- Infrastructure-as-code with Terraform or AWS CDK and CI for deployment into a client-owned account.
- Practical understanding of chunking, embedding model selection, reranking, and the trade-offs between relevance, latency, and cost.
- Experience building operational dashboards in CloudWatch or an equivalent tool.
Preferred qualifications
- AWS Certified Generative AI Developer Professional or AWS Certified Machine Learning Engineer Associate.
- Experience with RAG evaluation frameworks and metrics — faithfulness, context precision and recall, citation accuracy.
- Experience integrating with a contact center Agent Assist product as an API provider.
- Familiarity with Bedrock Guardrails and permission-aware retrieval patterns over Microsoft 365 content.
Solvd's standard text
When you join Solvd, you'll…
- Shape real-world AI-driven projects across key industries, working with clients from startup innovation to enterprise transformation.
- Be part of a global team with equal opportunities for collaboration across continents and cultures.
- Thrive in an inclusive environment that prioritizes continuous learning, innovation, and ethical AI standards.
Ready to make an impact?
If you're excited to build things that matter, champion responsible AI, and grow with some of the industry’s sharpest minds. Apply today and let’s innovate together.
Solvd is an equal opportunity employer.
What this role asks for
Particular to this role
Amazon Bedrock · Microsoft 365 · OpenSearch · Serverless · Vector Databases
Rare in Solvd's other 24 open postings.
Standard for data engineering roles
AWS · Python
Common in data engineering postings at any company.
74% of this description is written for the role. The rest is Solvd's standard text, folded away below.
Compared with Solvd's other open jobs.
The team: Cloud & Infrastructure
This role is one of 5 open in Cloud & Infrastructure. 4 were posted in the last 30 days.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
AWS (5 of 5), OpenSearch (4 of 5), Amazon Bedrock (3 of 5), Generative AI (3 of 5), Python (3 of 5), RAG (3 of 5), Terraform (3 of 5)
OTHER ROLES ON THIS TEAM
- Senior Data Engineer — Knowledge Ingestion posted Nov 13
- Senior AI Quality & Evaluation Engineer posted Nov 13
- Solution Architect, AWS Generative AI posted Nov 13
- Principal Solutions Architect (Cloud, Infrastructure & Data) posted Oct 8
From the team and dates on Solvd's own job board.
See Data Engineer salaries in the United States →
Similar jobs
- Lead Data Engineer - AWS at Tiger Analytics Inc.
Shares 10 skills: Amazon Bedrock, OpenSearch, Serverless… · same remote region - Data & AI Forward Deployed Engineer at RevStar
Shares 9 skills: Amazon Bedrock, OpenSearch, Serverless… · Senior level · same remote region - Senior Data Engineer at Credence
Shares 9 skills: Amazon Bedrock, OpenSearch, Vector Databases… · Senior level · same country - Generative AI Applications Engineer (Agents & RAG) at Accenture Federal Services
Shares 9 skills: Amazon Bedrock, OpenSearch, Vector Databases… · same country - Sr. Data Engineer at Florence Healthcare - US
Shares 8 skills: Amazon Bedrock, Serverless, Vector Databases… · Senior level · same country - Senior Software Engineer (React + Python) at Solvd
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.