Lead Software Security Engineer - AI Benchmark Delivery & Team Leadership
- Level
- Lead
- Work type
- Remote · Brazil only
Not stated in the posting: salary, visa.
Open. First seen 18 November 2026.
About the role
Gramian Consulting Group's standard text
About Gramian
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
About the Role
We are seeking an experienced Lead Software Security Engineer to lead a team of trainers developing high-quality training and evaluation tasks for frontier AI coding models. You will oversee project delivery, coordinate team capacity, maintain technical quality standards, and step in to perform hands-on vulnerability research and task development when workloads increase.
The project focuses on transforming real-world open-source vulnerabilities—including CVEs, security advisories, and bug reports—into Harbor-format audit-and-patch tasks across multiple programming languages. These tasks evaluate whether AI systems can identify, understand, reproduce, and securely remediate software vulnerabilities rather than relying on superficial pattern matching or copying known patches.
This position combines software security expertise, technical leadership, benchmark development, quality assurance, and delivery management. The ideal candidate is an experienced security-focused software engineer who can lead contributors, make sound technical decisions, manage delivery expectations, and maintain hands-on involvement in the work.
Engagement Type: Contractor assignment
Duration: 3 months
Start Date: Expected to start next week
Commitment: 40 hours per week
Work Arrangement: Fully remote
Time Zone Requirement: Minimum 4 hours of overlap with PST
Project Focus: Software security research, AI coding model training and evaluation, benchmark development, and technical team leadership.
Key Responsibilities
- Team & Delivery Management: Plan task deliveries by batch, assign work across pod members, and track daily throughput against phase-specific targets.
- Progress Monitoring: Monitor pod performance, identify bottlenecks, resolve delivery issues, and ensure tasks move through production stages on schedule.
- Client Communication: Lead weekly client reporting, communicate delivery status, and proactively escalate risks involving tooling issues, rate limits, safety blocks, and resource constraints.
- Scope & Requirements Alignment: Collaborate with the client to clarify requirements and align on task scope, volume, complexity, and difficulty changes.
- Technical Quality Assurance: Conduct final reviews of completed tasks to ensure they meet required quality, security, reproducibility, and evaluation standards.
- Team Calibration: Train and calibrate Pod Leads and trainers on CWE classification, verifier robustness, task difficulty, technical requirements, and acceptance criteria.
- Capacity Planning: Use throughput and quality data to forecast staffing needs across project phases.
- Recruitment & Onboarding: Initiate hiring and onboarding waves approximately three weeks ahead of projected capacity requirements.
- Hands-on Technical Contribution: Step in to research vulnerabilities, reproduce security issues, develop proof-of-vulnerability tests, and create or review benchmark tasks during periods of high workload.
- Documentation & Reporting: Maintain clear documentation of delivery plans, risks, quality findings, throughput metrics, staffing forecasts, and project decisions.
Requirements
- 6+ years of professional software engineering experience.
- Expert-level proficiency in at least one of the following programming languages:
- Python
- JavaScript / TypeScript
- Java
- C / C++
- C#
- Go
- Rust
- Ruby
- PHP
- Kotlin
- Swift
- Strong understanding of software security concepts, including CWE, CVE, and OWASP Top 10.
- Ability to reproduce software vulnerabilities and develop proof-of-vulnerability tests.
- Hands-on experience with security tooling, including sanitizers, fuzzers, and static-analysis tools such as CodeQL or Semgrep.
- Strong proficiency with Git, Linux, Bash, and Docker.
- Strong technical judgment when evaluating verifier robustness, security patches, and AI-generated code.
- Experience reviewing technical work and maintaining consistent quality standards across multiple contributors.
- Some experience mentoring engineers, trainers, or technical contributors.
- Excellent technical writing, documentation, and communication skills.
- Ability to work independently in a fully remote, research-oriented environment.
- Proven track record working on this project or equivalent software security dataset, benchmark development, or security evaluation work.
What this role asks for
Standard for security roles
Python
Common in security postings at any company.
93% of this description is written for the role. The rest is Gramian Consulting Group's standard text, folded away below.
Compared with Gramian Consulting Group's other open jobs.
The team: Talent Solutions HIRES STEADILY
This role is one of 139 open in Talent Solutions. 86 were posted in the last 30 days and the oldest in August: a team that hires all year rather than one being built.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
Python (50 of 139), C++ (19 of 139), JavaScript (17 of 139), TypeScript (16 of 139), C# (14 of 139), Linux (13 of 139), C (12 of 139)
OTHER ROLES ON THIS TEAM
- Engineering Manager - Software Security & AI Benchmark Delivery posted Nov 18
- Engineering Manager - Software Security & AI Benchmark Delivery posted Nov 18
- Lead Software Security Engineer - AI Benchmark Delivery & Team Leadershi posted Nov 18
- Senior Software Security Engineer - AI Benchmark Development posted Nov 18
- Senior Software Security Engineer - AI Benchmark Development posted Nov 18
- Analog IC Design Lead - Benchmark Engineering & Team Leadership posted Nov 17
- Analog IC Design Lead - Benchmark Engineering & Team Leadership posted Nov 17
- Computational Life Sciences & Scientific Python Specialist posted Nov 17
- Computational Life Sciences & Scientific Python Specialist posted Nov 17
- Computational Life Sciences & Scientific Python Specialist posted Nov 17
- Computational Life Sciences & Scientific Python Specialist posted Nov 17
- Mechanical Engineering & Computational Simulation Specialist posted Nov 17
- Mechanical Engineering & Computational Simulation Specialist posted Nov 17
- Mechanical Engineering & Computational Simulation Specialist posted Nov 17
- Mechanical Engineering & Computational Simulation Specialist posted Nov 17
- Senior AI Engineer (Agentic AI / AWS) posted Nov 16
- Senior Business Analyst (Insurance AI Transformation) posted Nov 16
- DFT Engineer / ASIC Design-for-Test Specialist posted Nov 16
- Senior Hardware Engineering & AI Systems Specialist (MSc/PhD) posted Nov 10
- Aerodynamics & CFD Software Engineering Specialist (MSc/PhD) posted Nov 10
- Aerodynamics & CFD Software Engineering Specialist (MSc/PhD) posted Nov 10
- Life Sciences Research & Python Specialist (MSc/PhD) posted Nov 10
- Senior Hardware Engineering & AI Systems Specialist (MSc/PhD) posted Nov 10
- Senior Hardware Engineering & AI Systems Specialist (MSc/PhD) posted Nov 10
- Aerodynamics & CFD Software Engineering Specialist (MSc/PhD) posted Nov 10
- Security Architect (Azure / AI / GDPR) posted Nov 10
- Life Sciences Research & Python Specialist (MSc/PhD) posted Nov 10
- Senior PCB Design & Hardware Simulation Engineer posted Nov 10
- Senior PCB Design & Hardware Simulation Engineer posted Nov 10
- Competitive Data Science & Machine Learning Specialist (Kaggle Expert+) posted Nov 10
- Life Sciences Research & Python Specialist (MSc/PhD) posted Nov 10
- Senior Application Security Engineer - GenAI Security Evaluation posted Nov 8
- Senior Application Security Engineer - GenAI Security Evaluation posted Nov 8
- Set and Production Design Expert posted Nov 6
- Systems Architect / Engineering Architecture Lead posted Nov 6
- Systems Architect / Engineering Architecture Lead posted Nov 6
- Systems Architect / Engineering Architecture Lead posted Nov 6
- Systems Architect / Engineering Architecture Lead posted Nov 6
- Chief Engineer / Mechanical Engineering Project Lead posted Nov 6
- Chief Engineer / Mechanical Engineering Project Lead posted Nov 6
- Chief Engineer / Mechanical Engineering Project Lead posted Nov 6
- Chief Engineer / Mechanical Engineering Project Lead posted Nov 6
- Set and Production Design Expert posted Nov 6
- Set and Production Design Expert posted Nov 6
- Set and Production Design Expert posted Nov 6
- SAP S/4HANA Deployment Project Manager (Manufacturing) posted Nov 3
- Medical Coder / CDI Specialist (AI Clinical Evaluation) posted Oct 31
- Registered Dietitian / Clinical Nutrition Expert (AI Evaluation) posted Oct 31
- Senior Pathologist (AI Clinical Evaluation) posted Oct 31
- Senior Hardware Design Engineer (KiCad / PCB / Electronics) posted Oct 31
- Senior Psychiatrist (AI Clinical Evaluation) posted Oct 31
- Clinical Pharmacist (AI Clinical Evaluation) posted Oct 31
- Acute-Care Therapist (PT / OT / SLP - AI Clinical Evaluation) posted Oct 31
- Forward Deployed AI Engineer (Python, LLMs, RAG) Geo Turkey, Croatia, Czech Rep posted Oct 31
- Senior Backend Engineer (.NET / Python / Azure) posted Oct 30
- Intelligence Operations & Collection Specialist - AI Training Projects posted Oct 30
- Litigation Attorney (AI Legal Evaluation) posted Oct 30
- Data Integration Engineer (Databricks / Python / SQL) posted Oct 30
- Commercial Aviation & Flight Operations Specialist - AI Projects posted Oct 30
- Federal Reporting & Staff Writing Specialist - AI Projects posted Oct 30
- IT Solution Architect (Azure / Databricks / AI Platforms) posted Oct 30
- Commercial Aviation & Flight Operations Specialist - AI Projects posted Oct 30
- Commercial Aviation & Flight Operations Specialist - AI Projects posted Oct 30
- Gaming & Gambling Regulatory Law Specialist - AI Projects posted Oct 29
- Business Analyst (AI Training) posted Oct 27
- Machine Learning Research & Engineering Specialist posted Oct 27
- Executive Presentation Design & Consulting Specialist posted Oct 27
- Rust Backend Architect - AI Training Projects posted Oct 26
- Machine Learning Research & Engineering Specialist posted Oct 26
- Machine Learning Research & Engineering Specialist posted Oct 26
- Machine Learning Research & Engineering Specialist posted Oct 26
- Rust Backend Architect - AI Training Projects posted Oct 26
- Rust Backend Architect - AI Training Projects posted Oct 26
- Rust Backend Architect - AI Training Projects posted Oct 26
- Biology & Bioinformatics Research Specialist (PhD) - AI Projects posted Oct 21
- Inpatient Medical Coding & AI Data Quality Specialist (CCS/CIC) posted Oct 21
- AI Conversation Research & Evaluation Specialist posted Oct 21
- Chemistry & Computational Research Specialist (PhD) - AI Projects posted Oct 21
- AI Conversation Evaluation & Context Research Specialist posted Oct 21
- AI Annotation Team Lead posted Oct 21
- AI Annotation Quality Reviewer posted Oct 21
- AI Workforce Planning & Resource Coordination Specialist posted Oct 21
- AI Workforce Planning & Resource Coordination Specialist posted Oct 21
- AI Conversation Evaluation & Context Research Specialist posted Oct 21
- AI Conversation Research & Evaluation Specialist posted Oct 21
- Business Analyst - AI Response Evaluation Specialist posted Oct 19
- Senior Software Engineer (Node.js, Kafka) posted Oct 19
- Employment Law & AI Evaluation Specialist posted Oct 17
- Personal Injury Law & AI Evaluation Specialist posted Oct 17
- Tax Law & AI Evaluation Specialist posted Oct 17
- Mechanical & Aerospace Engineering Task Lead (AI Projects) posted Oct 15
- Mechanical & Aerospace Engineering Task Lead (AI Project) posted Oct 15
- Multilingual Software Engineering & AI Evaluation Specialist posted Oct 15
- Electrical Engineering & Computer Science Task Lead (AI Projects) posted Oct 15
- Chemical Engineer with PhD (AI Evaluation) posted Oct 15
- Chemical Engineer with PhD (AI Evaluation) posted Oct 15
- Multilingual Software Engineering & AI Evaluation Specialist posted Oct 15
- Multilingual Software Engineering & AI Evaluation Specialist posted Oct 15
- Multilingual Software Engineering & AI Evaluation Specialist posted Oct 15
- Electrical Engineering & Computer Science Task Lead (AI Projects) posted Oct 15
- Senior Full-Stack Java / Angular Developer (Financial Applications) posted Oct 14
- Data Science & Quantitative AI Evaluation Specialist posted Oct 13
- Data Science & Quantitative AI Evaluation Specialist posted Oct 13
- Pediatric Hospital Medicine Specialist - AI Clinical Evaluation posted Oct 13
- Pediatric Hospital Medicine Specialist - AI Clinical Evaluation posted Oct 13
- Pediatric Hospital Medicine Specialist - AI Clinical Evaluation posted Oct 13
- Software Engineer - AI Code Evaluation posted Oct 13
- Video Data Annotation Specialist - AI Training posted Oct 13
- Video Data Annotation Specialist - AI Training posted Oct 13
- Video Data Annotation Specialist - AI Training posted Oct 13
- Mobile Software Engineering Expert - AI Training Projects posted Oct 12
- Game Development Expert - AI Training Projects posted Oct 12
- Family Medicine Clinical Expert - AI Evaluation posted Oct 12
- Oracle Data & Knowledge Transfer Specialist (OBIEE / ODI) posted Oct 12
- Mobile Software Engineering Expert - AI Training Projects posted Oct 12
- Game Development Expert - AI Training Projects posted Oct 12
- Game Development Expert - AI Training Projects posted Oct 12
- Mobile Software Engineering Expert - AI Training Projects posted Oct 12
- Hebrew Language & AI Training Expert posted Oct 8
- Polish Language & AI Training Expert posted Oct 7
- Italian Language & AI Training Expert posted Oct 7
- Thai Language & AI Training Expert posted Oct 7
- Turkish Language & AI Training Expert posted Oct 7
- Vietnamese Psychiatry & AI Evaluation Specialist posted Oct 7
- Immigration Attorney (AI Evaluation) posted Sep 30
- Aircraft Maintenance Engineer (EASA B1) posted Sep 29
- Senior Infrastructure & Cloud Architect (Datacenter Transformation) posted Sep 27
- Family Law Attorney (AI Evaluation) posted Sep 20
- Dermatologist (AI Evaluation) posted Sep 19
- Senior Manufacturing Engineer (Precision Machining) posted Sep 15
- Engineering Manager - Infrastructure / SRE posted Sep 13
- CMDB Application Developer & Reporting Specialist posted Sep 12
- Google Workspace Architect / Senior Administrator posted Sep 12
- Senior Delivery Lead / Product Owner (Enterprise AI) posted Aug 26
- Senior Data & Document Ingestion Engineer (OCR / RAG) - REMOTE posted Aug 26
- Senior AI Engineer (Agentic AI / AWS) - REMOTE posted Aug 26
- Senior DevSecOps Engineer (Cloud Security / AI Platforms) posted Aug 26
- Senior Backend / Platform Engineer (AI Infrastructure) posted Aug 26
From the team and dates on Gramian Consulting Group's own job board.
Similar jobs
- GCC | Product Security Engineer at Cordance
Shares 13 skills: OWASP, Swift, PHP… - Security Software Engineer at Canonical
Shares 11 skills: PHP, Ruby, Rust… - Senior DevOps Engineer at Lemon.io
Shares 13 skills: Swift, PHP, Ruby… · ✓ Visa sponsorship - Principal AI Software Engineer, TechEx (US) at West Monroe
Shares 10 skills: Swift, Ruby, Kotlin… - Software Engineer - A27001 at Activate Interactive Pte Ltd
Shares 11 skills: OWASP, Swift, Ruby… - Software Engineers & Code Owners - AI Code Licensing Program at Gramian Consulting Group
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.