Software Engineer, Applied AI
- Salary
- $200,000 - $300,000 per year
- Level
- Mid
Not stated in the posting: work type, visa.
Open. First seen 23 October 2026.
About the role
About the company
Our client is a financial services technology company.
The role
Raydar is recruiting for this role on behalf of our client. Own the design and delivery of AI-driven features end to end, from backend services and orchestration logic to user-facing interfaces. Work closely with a small, in-person engineering team to ship dependable, well-tested systems and build the measurement tooling that shows whether they are getting better.
What you'll do
- Build autonomous software agents that handle complex, multi-step tasks using planning, code execution, search and retrieval.
- Develop background agents that triage communications, process meetings and draft messages on behalf of users.
- Create the orchestration layer that connects language models, context, tools, retrieval and business logic reliably.
- Design interactive interfaces where users and agents collaborate in real time.
- Build evaluation infrastructure that measures both factual accuracy and subjective, judgment-based quality.
- Design memory and context systems that capture and evolve an understanding of individual users over time.
- Account for auditability, compliance and fast-changing datasets in system design.
Requirements
What we're looking for
- Have shipped AI agents to production that coordinate language models, call external tools and pull in relevant information.
- Hands-on knowledge of LLM agent frameworks, retrieval-augmented generation, tool calling and prompt engineering.
- Strong software engineering fundamentals, including APIs, data modeling and system design.
- Background at a high-growth startup.
- Comfort working with probabilistic systems and a rigorous, experiment-driven approach to quality.
- A careful, high-standards mindset where accuracy matters and speed and reliability go together.
- Kind, direct and low-ego collaboration style, and enthusiasm for working in the office five days a week.
Bonus points
- Prior work creating quality-measurement tooling for AI systems whose outputs vary from run to run.
- Background designing interactive front ends that keep a person involved in automated workflows.
- Bachelor's degree in Computer Science.
Benefits
Compensation and benefits
- Base salary: USD 200,000 to 300,000 per year
- Equity
Location and work model
- New York City, NY, United States
- On-site, 5 days per week in the office
- Full-time
What this role asks for
Particular to this role
Prompt Engineering · RAG
Rare in Raydar's other 299 open postings.
Compared with Raydar's other open jobs.
Salary context
9 other open postings titled Software Engineer, Applied AI state a salary: median USD 170,000 to USD 260,000 a year.
See Software Engineer salaries in New York →
Similar jobs
- Applied AI Engineer at Fanatics Inc.
Shares 3 skills: Prompt Engineering, RAG, LLM · same seniority · same city - Software Engineer - AI Systems (Go) at Stanbridge University
Shares 3 skills: Prompt Engineering, RAG, LLM · same seniority · same country - Applied AI Engineer at Bandwidth
Shares 3 skills: Prompt Engineering, RAG, LLM · same seniority · same country - Software Engineer - Regulatory AI & Connected Data at Apple
Shares 3 skills: Prompt Engineering, RAG, LLM · same seniority · same country - Senior AI/ML Architect, Applied Field Engineering at Snowflake
Shares 3 skills: Prompt Engineering, RAG, LLM · same country - VP of Platform Engineering at Raydar
Also at this company
Is this your posting? Email info@careerholo.com to have it removed.