添加至收藏夹
深技术专家 – AI 风险评估
Future of Life Organizations(远程)
职位概述
我们正在为 综合风险评估团队 招募一位资深技术专家(Senior Technical Specialist)。该职位融合了 AI 安全研究 与 技术治理,重点在于深度理论分析与高质量的研究把控。
理想候选人需具备严谨的方法论能力,能深化我们对 AI 风险路径的分析,并推动行业标准与政策框架的制定。你将作为团队的领域专家,将技术 AI 安全与治理方法连接起来,提升团队研究质量,并推动关键的风险评估方法论研究,支撑我们面向更强大 AI 系统的战略研究计划。
该职位为 全远程,但需要偶尔出差。
关于 CARMA
AI 风险管理与对齐中心(Center for AI Risk Management & Alignment,CARMA) 致力于帮助社会应对由日益强大的 AI 系统带来的复杂且潜在灾难性的风险,其使命是降低“变革性 AI”对人类与生态系统的重大威胁。
核心工作包括:
用严谨分析推进 AI 风险管理
制定直接应对 AGI 的政策框架
推动技术安全与对齐方法
推动全球视角下的长期安全实践
CARMA 是 Social & Environmental Entrepreneurs, Inc.(美国 501(c)(3) 非营利组织)的财政赞助项目。
主要职责
开发识别威胁模型的技术,并生成涵盖社会与社会技术维度的风险路径分析
建模风险在多节点间的转化、放大、阈值效应,以及其在社会系统中的传播
参与设计针对灾难性风险(包括失控场景)的技术治理框架与评估方法
对团队研究进行战略与技术质量把控,确保概念严密与技术准确
主导或独立推进与“高级 AI 系统全面风险管理”相关的原创研究
与 CARMA 内部其他团队协作,将风险评估范式整合到不同工作流
参与制定 AI 系统的评估、风险量化、风险阈值等方面的行业标准与最佳实践
为关键利益相关方撰写 AI 风险管理的面向未来的专业沟通材料
职位要求(必备)
5 年以上 AI 安全、对齐或 AI 治理相关经验(不同资历层级均可,只要满足深度要求)
熟悉多种风险建模方法(因果模型、贝叶斯网络、系统动力学等)
有系统性与社会技术系统风险传播建模经验
具备优秀的分析思维,能识别复杂论证中的细微漏洞
出色的口头与书面沟通能力(能面向技术与非技术受众)
有论文发表记录或等同水平的专业能力证明
具备系统思维和独立的学术严谨性
能在高节奏、高智力密度的环境中合作
能适应不确定性与快速变化的知识体系
优先条件(加分项)
有复杂系统理论、控制理论、控制论、多尺度建模或动力系统背景
曾在 AI 安全机构、技术 AI 实验室、政策机构或相关风险领域工作
有技术研究质量保证(QA)经验
能建模阈值效应、非线性动力学、社会技术系统中的涌现现象
理解 AI 发展中的国际动态与权力结构
能平衡急性风险与长期累积性风险
熟悉因果、贝叶斯或半定量超图(hypergraph)风险分析
方法严谨但具备框架创新能力
平等机会声明
CARMA / SEE 提倡多元与平等机会,不会基于种族、性别、年龄、宗教、性取向等进行任何歧视。
美国境内的候选人需具备工作授权;美国境外候选人将以 独立承包商(contractor) 合作。
机构目前 无法提供签证支持。
薪酬
年薪:14 万 – 22 万美元
美国员工可享受良好福利
申请链接:
https://www.workingnomads.com/jobs/senior-technical-specialist-ai-risk-assessment-future-of-life-organizations-1302260
Senior Technical Specialist - AI Risk Assessment
Position Overview
We are seeking a Senior Technical Specialist to join our Comprehensive Risk Assessment team. This role combines original research in AI safety and technical governance with strong emphasis on conceptual depth and quality assurance leadership. The ideal candidate will bring methodological rigor to our assessment methods and analyses of AI risk pathways, contributing to the development of frameworks that shape industry standards and policy. You will serve as a subject matter expert bridging technical AI safety with governance approaches, enhancing team research quality while driving forward key aspects of our groundbreaking work in risk assessment methodologies for increasingly capable AI systems, all within our established strategic research program. This position is entirely remote but occasional travel is required.
About CARMA
The Center for AI Risk Management & Alignment (CARMA) works to help society navigate the complex and potentially catastrophic risks arising from increasingly powerful AI systems. Our mission is specifically to lower the risks to humanity and the biosphere from transformative AI.
We focus on grounding AI risk management in rigorous analysis, developing policy frameworks that squarely address AGI, advancing technical safety approaches, and fostering global perspectives on durable safety. Through these complementary approaches, CARMA aims to provide critical support to society for managing the outsized risks from advanced AI before they materialize.
CARMA is a fiscally-sponsored project of Social & Environmental Entrepreneurs, Inc., a 501(c)(3) nonprofit public benefit corporation.
Key Responsibilities
• Develop techniques for discovering threat models and generating risk pathway analyses that capture societal and sociotechnical dimensions
• Model multi-node risk transformation, amplification, and threshold effects propagating through social systems
• Contribute to the design of robust technical governance frameworks and assessment methodologies for catastrophic risks, including loss-of-control scenarios
• Provide strategic and tactical quality control for the team’s research, ensuring conceptual soundness and technical accuracy
• Drive or take ownership of original research projects on comprehensive risk management for advanced AI systems, aligned with the team's objectives
• Collaborate across CARMA teams to integrate risk assessment paradigms with other workstreams
• Contribute to technical standards and best practices for the evaluation, risk measurement, and risk thresholding of AI systems
• Craft persuasive communications for key stakeholders on prospective AI risk management
Required Qualifications
• 5+ years of experience in AI safety, alignment, and/or governance. We are open to candidates at different levels of seniority who can demonstrate the required depth of expertise.
• Strong understanding of multiple risk modeling approaches (causal modeling, Bayesian networks, systems dynamics, etc.)
• Experience with systemic and sociotechnical modeling of risk propagation
• Excellent analytical thinking with ability to identify subtle flaws in complex arguments
• Strong written and verbal communication skills for technical and non-technical audiences
• Publication record or equivalent demonstrated expertise in relevant areas
• Systems thinking approach with independent intellectual rigor
• Track record of constructive collaboration in fast-paced, intellectually demanding environments
• Comfort with uncertainty and rapidly evolving knowledge landscapes
Preferred Qualifications
• Background in complex systems theory, control theory, cybernetics, multi-scale modeling, or dynamical systems
• Work history at AI safety research organizations, technical AI labs, policy institutions, or adjacent risk domains
• Experience with quality assurance processes for technical research
• Ability to model threshold effects, nonlinear dynamics, and emergent properties in sociotechnical systems
• Understanding of international dynamics and power differentials in AI development
• Ability to balance consideration of both acute and aggregate AI risks
• Experience with causal, Bayesian, or semi-quantitative hypergraphs for risk analysis
• Demonstrated methodical yet creative approach to framework development
CARMA/SEE is proud to be an Equal Opportunity Employer. We will not discriminate on the basis of race, ethnicity, sex, age, religion, gender reassignment, partnership status, maternity, or sexual orientation. We are, by policy and action, an inclusive organization and actively promote equal opportunities for all humans with the right mix of talent, knowledge, skills, attitude, and potential, so hiring is only based on individual merit for the job. Our organization operates through a fiscal sponsor whose infrastructure only supports persons authorized to work in the U.S. as employees. Candidates outside the U.S. would be engaged as independent contractors with project-focused responsibilities. Note that we are unable to sponsor visas at this time.
$140,000 - $220,000 a year
plus good benefits if a U.S. employee