JobsCyber SecurityUnited StatesAI Safety, Responsible AI & Cybersecurity Specialist (AI Evaluation)
Weekday AI
Posted today · Jobs at Weekday AI
AI Safety, Responsible AI & Cybersecurity Specialist (AI Evaluation)
Weekday AI · United States
SAVE THIS JOB
In short
Collaborate with research and engineering teams to identify vulnerabilities and improve AI model performance through red teaming and adversarial testing. Develop evaluation frameworks and scoring rubrics to assess the safety, reliability, and technical accuracy of AI-generated outputs.
What they're looking for
MUST-HAVE SKILLS
ALSO MENTIONED
Requires 4+ years of professional experience in cybersecurity, offensive security, or trust and safety roles. Candidates must possess strong analytical skills and practical expertise in identifying security vulnerabilities within complex technical environments.
About the employer
Weekday AI (YC W21)
Curated top jobs for you · hiring as Weekday AI
Finding a great startup job should not feel like a second job.
Read moreShow less
Weekday AI brings the most exciting roles from premium YC and VC-backed startups into one place. Our team hand-picks every listing, so you skip the agency spam and the dead links and go straight to companies building things that matter. Why people use Weekday AI? Curated roles from premium YC and VC-backed startups Fresh jobs every week, picked by humans AI that helps you apply in minutes Free to join Your next role should come from a company you are proud to work at. We help you find it. Browse live roles at jobs.weekday.works
- INDUSTRY
- Technology, Information and Internet
- COMPANY
- Privately Held
- FOUNDED
- 2022
- SIZE
- 11-50
- OPEN HERE
- 3 roles
Is your LinkedIn profile ready for roles like this?
A free review of your profile, scored against what Security roles ask for, and what to fix first.
Questions about this role
- Is this Weekday AI role remote?
- Tagged remote.
- Does it sponsor visas?
- Listed as no visa sponsorship.
- What experience does it ask for?
- Listed as 2-5 years.
The posting, in full
This role is for one of our clients Compensation: $90 - $140 per hour 1. Role Overview Join a leading AI lab’s cutting-edge Generative AI team and contribute to the development of next-generation foundational AI models. We are seeking experienced AI Safety, Responsible AI, and Cybersecurity Specialists with practical expertise in application security, offensive security, threat analysis, red teaming, or trust and safety.
▶ READ THE FULL POSTING▼ CLOSE THE FULL POSTING
This role is for one of our clients
Compensation: $90 - $140 per hour
1. Role Overview
Join a leading AI lab’s cutting-edge Generative AI team and contribute to the development of next-generation foundational AI models. We are seeking experienced AI Safety, Responsible AI, and Cybersecurity Specialists with practical expertise in application security, offensive security, threat analysis, red teaming, or trust and safety.
In this role, you will bring an adversarial, security-focused, and safety-first perspective to AI model development and evaluation. You will help identify vulnerabilities, assess potentially harmful model behaviour, design realistic adversarial scenarios, and establish evaluation standards to improve the security, reliability, and responsible use of AI systems.
The ideal candidate combines strong cybersecurity or trust and safety expertise with analytical thinking and the ability to assess complex technical and ethical risks in AI-generated outputs.
This is a W-2 employment opportunity, with the opportunity to work as part of a leading AI lab’s extended workforce.
2. Key Responsibilities
- Collaborate with research and engineering teams to identify knowledge gaps and improve AI model performance across cybersecurity, Responsible AI, application and infrastructure security, red teaming, and abuse prevention.
- Design challenging, domain-specific tasks based on real-world security and AI safety scenarios, developing accurate and well-structured solutions.
- Evaluate AI-generated security and Responsible AI outputs for technical accuracy, safety, policy compliance, and potential misuse.
- Create adversarial prompts, security challenges, and red teaming scenarios to test AI systems for vulnerabilities, unsafe responses, harmful behaviour, and policy violations.
- Assess AI systems against potential threats, including prompt injection, data leakage, insecure code generation, harmful instructions, and other relevant attack patterns.
- Develop evaluation frameworks, scoring rubrics, and quality standards to assess the safety, reliability, accuracy, and potential harm of AI-generated responses, particularly on security-sensitive topics.
- Identify weaknesses in AI model responses and provide clear, structured, and actionable technical feedback to support improvements.
- Apply relevant cybersecurity and trust and safety methodologies to evaluate model behaviour across different threat scenarios and sensitive use cases.
- Work closely with other subject matter experts to maintain consistency, accuracy, and quality across AI training datasets.
3. Core Qualifications & Experience
- 4+ years of professional experience in Cybersecurity, Application Security, Red Teaming, Penetration Testing, Threat Intelligence, Incident Response, or Trust and Safety, preferably within a recognised technology company, cybersecurity organisation, or established enterprise.
- Hands-on expertise in at least one of the following areas:
- Application Security: Secure code reviews, vulnerability assessments, application security testing, security architecture, and secure software development practices.
- Offensive Security & Penetration Testing: Vulnerability discovery, exploitation techniques, penetration testing methodologies, adversarial testing, and security assessments.
- Threat Intelligence & Incident Response: Threat analysis, attack investigation, security monitoring, incident handling, threat modelling, and risk assessment.
- Trust & Safety: Content moderation, platform abuse prevention, policy enforcement, harmful content identification, safety evaluations, and risk mitigation.
- Strong understanding of cybersecurity principles, common attack vectors, vulnerability management, and security best practices.
- Practical experience identifying and evaluating security vulnerabilities across applications, systems, infrastructure, or AI-powered environments.
- Familiarity with AI safety and Responsible AI concepts, including model security, adversarial robustness, harmful-output prevention, privacy risks, bias, and policy compliance, is highly desirable.
- Ability to design adversarial scenarios and evaluate AI-generated responses for security weaknesses, unsafe behaviour, and potential misuse.
- Relevant industry certifications such as OSCP, OSWE, GPEN, or CISSP will be an advantage.
- Published Common Vulnerabilities and Exposures (CVEs), recognised bug bounty findings, security research, technical publications, or meaningful contributions to cybersecurity projects are strong advantages.
- Demonstrable career progression, with increasing responsibility in security engineering, offensive security, threat analysis, or trust and safety functions.
- Strong analytical and problem-solving abilities, with the capacity to investigate complex security issues and communicate findings effectively.
- Ability to commit reliably to at least 20 hours per week during weekdays.
- Excellent written communication skills, with the ability to explain complex technical concepts, security findings, risk assessments, and evaluation decisions clearly.
SAVE THIS JOB
Similar roles open now
Cyber Security Specialist (RMF)
IP Secure, LLC
Albuquerque, New MexicoOn site
EMPLOYER'S OWN SITE
POSTED TODAY
Cybersecurity Specialist - 505723
Delaware Nation Industries
Bath Township, OhioOn site
EMPLOYER'S OWN SITE
POSTED TODAY
Cybersecurity Analyst
Kiniksa Pharmaceuticals
Lexington, Massachusetts$87k–$100kOn site
EMPLOYER'S OWN SITE
POSTED TODAY
Information Security Analyst
Banner Engineering
New Hope, Minnesota$82k–$116kHybrid
EMPLOYER'S OWN SITE
POSTED TODAY
Associate Cybersecurity Analyst
GM Financial
Arlington, TexasHybrid · 4 days in office
EMPLOYER'S OWN SITE
POSTED TODAY