Engineering Manager - Software Security & AI Benchmark Delivery
- Level
- Lead
- Work type
- Remote · Brazil only
Not stated in the posting: salary, visa.
Open. First seen 18 November 2026.
About the role
Gramian Consulting Group's standard text
About Gramian
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
About the Role
We are seeking an experienced Engineering Manager – Software Security to lead the development and delivery of security-focused training and evaluation tasks for frontier AI coding models. You will oversee multiple engineering pods, taking ownership of delivery performance, technical quality, team capacity, and client alignment.
The project focuses on transforming real-world software vulnerabilities into rigorous, reproducible tasks that evaluate whether AI models can identify, understand, reproduce, and securely remediate vulnerabilities across different programming languages and software ecosystems.
As the final quality gate, you will ensure that all delivered tasks meet the client's expectations for technical accuracy, difficulty, reproducibility, and evaluation robustness. This position combines software security expertise, multi-team leadership, operational management, and data-driven decision-making, with direct responsibility for delivering against Google's project expectations.
Engagement Type: Contractor assignment
Duration: 3 months
Start Date: Expected to start next week
Commitment: 40 hours per week
Work Arrangement: Fully remote
Time Zone Requirement: Minimum 4 hours of overlap with PST
Project Focus: Software security, AI coding model evaluation, engineering team management, and benchmark delivery.
Key Responsibilities
- Multi-Pod Leadership: Own delivery, quality, and capacity across multiple engineering pods, coordinating Pod Leads and ensuring consistent execution.
- Delivery Planning: Plan task batches, assign work to Pod Leads, and monitor daily throughput against phase-specific targets.
- Performance Management: Ensure batches meet Google's expectations for task volume, technical difficulty, quality standards, and delivery timelines.
- Client Communication: Lead weekly client reporting, communicate progress, provide delivery forecasts, and raise risks or dependencies proactively.
- Risk Management: Identify and escalate tooling issues, rate limits, safety blocks, staffing constraints, and other delivery risks.
- Scope Alignment: Work directly with Google to clarify requirements and align on task scope, timelines, task volume, and difficulty changes.
- Final Quality Assurance: Conduct final reviews of security tasks before delivery, ensuring technical accuracy, reproducibility, and resistance to gaming or superficial solutions.
- Technical Calibration: Train and calibrate Pod Leads on CWE classification, verifier robustness, task difficulty, technical quality, and acceptance criteria.
- Recruitment & Hiring: Conduct interviews and make hiring decisions based on approved role requirements and project capacity needs.
- Talent Development: Identify high-performing Trainers and support their development and promotion into Pod Lead positions.
- Capacity Forecasting: Use throughput, workload, and quality data to forecast headcount requirements across project phases.
- Workforce Planning: Initiate hiring waves approximately three weeks ahead of projected capacity requirements.
- Operational Reporting: Use dashboards, performance indicators, and operational metrics to guide delivery decisions and staffing plans.
Requirements
- 10+ years of overall professional software engineering experience, with a strong background in software security.
- Proven experience leading technical teams against measurable delivery, quality, and schedule targets.
- Strong understanding of CWE, CVE, and OWASP Top 10 across multiple programming languages and software ecosystems.
- Demonstrated experience reproducing software vulnerabilities, reviewing security patches, and evaluating proof-of-vulnerability tests.
- Experience designing or reviewing automated tests, verifiers, CI workflows, or reproducible technical evaluation environments.
- Strong proficiency in at least one major programming language, such as:
- Python
- JavaScript / TypeScript
- Java
- C / C++
- C#
- Go
- Rust
- Ruby
- PHP
- Kotlin
- Swift
- Experience with Git, Linux, Bash, Docker, and common software security tooling.
- Ability to use dashboards, throughput metrics, quality data, and operational reports to make delivery and staffing decisions.
- Experience managing or mentoring technical teams, including assigning work, reviewing output, providing feedback, and developing team leads.
- Excellent written and verbal communication skills, including the ability to explain technical risks and project status to clients and internal stakeholders.
- Strong organizational and prioritization skills, with the ability to manage multiple pods, competing priorities, and delivery phases simultaneously.
What this role asks for
93% of this description is written for the role. The rest is Gramian Consulting Group's standard text, folded away below.
Compared with Gramian Consulting Group's other open jobs.
The team: Talent Solutions HIRES STEADILY
This role is one of 139 open in Talent Solutions. 86 were posted in the last 30 days and the oldest in August: a team that hires all year rather than one being built.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
Python (50 of 139), C++ (19 of 139), JavaScript (17 of 139), TypeScript (16 of 139), C# (14 of 139), Linux (13 of 139), C (12 of 139)
OTHER ROLES ON THIS TEAM
- Engineering Manager - Software Security & AI Benchmark Delivery posted Nov 18
- Lead Software Security Engineer - AI Benchmark Delivery & Team Leadershi posted Nov 18
- Lead Software Security Engineer - AI Benchmark Delivery & Team Leadership posted Nov 18
- Senior Software Security Engineer - AI Benchmark Development posted Nov 18
- Senior Software Security Engineer - AI Benchmark Development posted Nov 18
- Analog IC Design Lead - Benchmark Engineering & Team Leadership posted Nov 17
- Analog IC Design Lead - Benchmark Engineering & Team Leadership posted Nov 17
- Computational Life Sciences & Scientific Python Specialist posted Nov 17
- Computational Life Sciences & Scientific Python Specialist posted Nov 17
- Computational Life Sciences & Scientific Python Specialist posted Nov 17
- Computational Life Sciences & Scientific Python Specialist posted Nov 17
- Mechanical Engineering & Computational Simulation Specialist posted Nov 17
- Mechanical Engineering & Computational Simulation Specialist posted Nov 17
- Mechanical Engineering & Computational Simulation Specialist posted Nov 17
- Mechanical Engineering & Computational Simulation Specialist posted Nov 17
- Senior AI Engineer (Agentic AI / AWS) posted Nov 16
- Senior Business Analyst (Insurance AI Transformation) posted Nov 16
- DFT Engineer / ASIC Design-for-Test Specialist posted Nov 16
- Senior Hardware Engineering & AI Systems Specialist (MSc/PhD) posted Nov 10
- Aerodynamics & CFD Software Engineering Specialist (MSc/PhD) posted Nov 10
- Aerodynamics & CFD Software Engineering Specialist (MSc/PhD) posted Nov 10
- Life Sciences Research & Python Specialist (MSc/PhD) posted Nov 10
- Senior Hardware Engineering & AI Systems Specialist (MSc/PhD) posted Nov 10
- Senior Hardware Engineering & AI Systems Specialist (MSc/PhD) posted Nov 10
- Aerodynamics & CFD Software Engineering Specialist (MSc/PhD) posted Nov 10
- Security Architect (Azure / AI / GDPR) posted Nov 10
- Life Sciences Research & Python Specialist (MSc/PhD) posted Nov 10
- Senior PCB Design & Hardware Simulation Engineer posted Nov 10
- Senior PCB Design & Hardware Simulation Engineer posted Nov 10
- Competitive Data Science & Machine Learning Specialist (Kaggle Expert+) posted Nov 10
- Life Sciences Research & Python Specialist (MSc/PhD) posted Nov 10
- Senior Application Security Engineer - GenAI Security Evaluation posted Nov 8
- Senior Application Security Engineer - GenAI Security Evaluation posted Nov 8
- Set and Production Design Expert posted Nov 6
- Systems Architect / Engineering Architecture Lead posted Nov 6
- Systems Architect / Engineering Architecture Lead posted Nov 6
- Systems Architect / Engineering Architecture Lead posted Nov 6
- Systems Architect / Engineering Architecture Lead posted Nov 6
- Chief Engineer / Mechanical Engineering Project Lead posted Nov 6
- Chief Engineer / Mechanical Engineering Project Lead posted Nov 6
- Chief Engineer / Mechanical Engineering Project Lead posted Nov 6
- Chief Engineer / Mechanical Engineering Project Lead posted Nov 6
- Set and Production Design Expert posted Nov 6
- Set and Production Design Expert posted Nov 6
- Set and Production Design Expert posted Nov 6
- SAP S/4HANA Deployment Project Manager (Manufacturing) posted Nov 3
- Medical Coder / CDI Specialist (AI Clinical Evaluation) posted Oct 31
- Registered Dietitian / Clinical Nutrition Expert (AI Evaluation) posted Oct 31
- Senior Pathologist (AI Clinical Evaluation) posted Oct 31
- Senior Hardware Design Engineer (KiCad / PCB / Electronics) posted Oct 31
- Senior Psychiatrist (AI Clinical Evaluation) posted Oct 31
- Clinical Pharmacist (AI Clinical Evaluation) posted Oct 31
- Acute-Care Therapist (PT / OT / SLP - AI Clinical Evaluation) posted Oct 31
- Forward Deployed AI Engineer (Python, LLMs, RAG) Geo Turkey, Croatia, Czech Rep posted Oct 31
- Senior Backend Engineer (.NET / Python / Azure) posted Oct 30
- Intelligence Operations & Collection Specialist - AI Training Projects posted Oct 30
- Litigation Attorney (AI Legal Evaluation) posted Oct 30
- Data Integration Engineer (Databricks / Python / SQL) posted Oct 30
- Commercial Aviation & Flight Operations Specialist - AI Projects posted Oct 30
- Federal Reporting & Staff Writing Specialist - AI Projects posted Oct 30
- IT Solution Architect (Azure / Databricks / AI Platforms) posted Oct 30
- Commercial Aviation & Flight Operations Specialist - AI Projects posted Oct 30
- Commercial Aviation & Flight Operations Specialist - AI Projects posted Oct 30
- Gaming & Gambling Regulatory Law Specialist - AI Projects posted Oct 29
- Business Analyst (AI Training) posted Oct 27
- Machine Learning Research & Engineering Specialist posted Oct 27
- Executive Presentation Design & Consulting Specialist posted Oct 27
- Rust Backend Architect - AI Training Projects posted Oct 26
- Machine Learning Research & Engineering Specialist posted Oct 26
- Machine Learning Research & Engineering Specialist posted Oct 26
- Machine Learning Research & Engineering Specialist posted Oct 26
- Rust Backend Architect - AI Training Projects posted Oct 26
- Rust Backend Architect - AI Training Projects posted Oct 26
- Rust Backend Architect - AI Training Projects posted Oct 26
- Biology & Bioinformatics Research Specialist (PhD) - AI Projects posted Oct 21
- Inpatient Medical Coding & AI Data Quality Specialist (CCS/CIC) posted Oct 21
- AI Conversation Research & Evaluation Specialist posted Oct 21
- Chemistry & Computational Research Specialist (PhD) - AI Projects posted Oct 21
- AI Conversation Evaluation & Context Research Specialist posted Oct 21
- AI Annotation Team Lead posted Oct 21
- AI Annotation Quality Reviewer posted Oct 21
- AI Workforce Planning & Resource Coordination Specialist posted Oct 21
- AI Workforce Planning & Resource Coordination Specialist posted Oct 21
- AI Conversation Evaluation & Context Research Specialist posted Oct 21
- AI Conversation Research & Evaluation Specialist posted Oct 21
- Business Analyst - AI Response Evaluation Specialist posted Oct 19
- Senior Software Engineer (Node.js, Kafka) posted Oct 19
- Employment Law & AI Evaluation Specialist posted Oct 17
- Personal Injury Law & AI Evaluation Specialist posted Oct 17
- Tax Law & AI Evaluation Specialist posted Oct 17
- Mechanical & Aerospace Engineering Task Lead (AI Projects) posted Oct 15
- Mechanical & Aerospace Engineering Task Lead (AI Project) posted Oct 15
- Multilingual Software Engineering & AI Evaluation Specialist posted Oct 15
- Electrical Engineering & Computer Science Task Lead (AI Projects) posted Oct 15
- Chemical Engineer with PhD (AI Evaluation) posted Oct 15
- Chemical Engineer with PhD (AI Evaluation) posted Oct 15
- Multilingual Software Engineering & AI Evaluation Specialist posted Oct 15
- Multilingual Software Engineering & AI Evaluation Specialist posted Oct 15
- Multilingual Software Engineering & AI Evaluation Specialist posted Oct 15
- Electrical Engineering & Computer Science Task Lead (AI Projects) posted Oct 15
- Senior Full-Stack Java / Angular Developer (Financial Applications) posted Oct 14
- Data Science & Quantitative AI Evaluation Specialist posted Oct 13
- Data Science & Quantitative AI Evaluation Specialist posted Oct 13
- Pediatric Hospital Medicine Specialist - AI Clinical Evaluation posted Oct 13
- Pediatric Hospital Medicine Specialist - AI Clinical Evaluation posted Oct 13
- Pediatric Hospital Medicine Specialist - AI Clinical Evaluation posted Oct 13
- Software Engineer - AI Code Evaluation posted Oct 13
- Video Data Annotation Specialist - AI Training posted Oct 13
- Video Data Annotation Specialist - AI Training posted Oct 13
- Video Data Annotation Specialist - AI Training posted Oct 13
- Mobile Software Engineering Expert - AI Training Projects posted Oct 12
- Game Development Expert - AI Training Projects posted Oct 12
- Family Medicine Clinical Expert - AI Evaluation posted Oct 12
- Oracle Data & Knowledge Transfer Specialist (OBIEE / ODI) posted Oct 12
- Mobile Software Engineering Expert - AI Training Projects posted Oct 12
- Game Development Expert - AI Training Projects posted Oct 12
- Game Development Expert - AI Training Projects posted Oct 12
- Mobile Software Engineering Expert - AI Training Projects posted Oct 12
- Hebrew Language & AI Training Expert posted Oct 8
- Polish Language & AI Training Expert posted Oct 7
- Italian Language & AI Training Expert posted Oct 7
- Thai Language & AI Training Expert posted Oct 7
- Turkish Language & AI Training Expert posted Oct 7
- Vietnamese Psychiatry & AI Evaluation Specialist posted Oct 7
- Immigration Attorney (AI Evaluation) posted Sep 30
- Aircraft Maintenance Engineer (EASA B1) posted Sep 29
- Senior Infrastructure & Cloud Architect (Datacenter Transformation) posted Sep 27
- Family Law Attorney (AI Evaluation) posted Sep 20
- Dermatologist (AI Evaluation) posted Sep 19
- Senior Manufacturing Engineer (Precision Machining) posted Sep 15
- Engineering Manager - Infrastructure / SRE posted Sep 13
- CMDB Application Developer & Reporting Specialist posted Sep 12
- Google Workspace Architect / Senior Administrator posted Sep 12
- Senior Delivery Lead / Product Owner (Enterprise AI) posted Aug 26
- Senior Data & Document Ingestion Engineer (OCR / RAG) - REMOTE posted Aug 26
- Senior AI Engineer (Agentic AI / AWS) - REMOTE posted Aug 26
- Senior DevSecOps Engineer (Cloud Security / AI Platforms) posted Aug 26
- Senior Backend / Platform Engineer (AI Infrastructure) posted Aug 26
From the team and dates on Gramian Consulting Group's own job board.
Similar jobs
- GCC | Product Security Engineer at Cordance
Shares 13 skills: OWASP, Swift, PHP… - Security Software Engineer at Canonical
Shares 11 skills: PHP, Ruby, Rust… - Senior DevOps Engineer at Lemon.io
Shares 13 skills: Swift, PHP, Ruby… · ✓ Visa sponsorship - Principal AI Software Engineer, TechEx (US) at West Monroe
Shares 10 skills: Swift, Ruby, Kotlin… - Software Engineer - A27001 at Activate Interactive Pte Ltd
Shares 11 skills: OWASP, Swift, Ruby… - Software Engineers & Code Owners - AI Code Licensing Program at Gramian Consulting Group
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.