Loading organizations…
Loading organizations…
FAR.AI (originally the Fund for Alignment Research, now Frontier Alignment Research) is a 501(c)(3) nonprofit research organization founded in July 2022 and incorporated in October 2022. The organization was co-founded by Adam Gleave (CEO), who holds a PhD in artificial intelligence from UC Berkeley under Stuart Russell and previously worked at Google DeepMind, and Karl Berzins (President/COO).
FAR.AI's core mission is ensuring advanced AI systems are safe and beneficial for everyone. The organization focuses on research agendas that are too large to be pursued by individual academic or independent researchers but are too early-stage to be of interest to most for-profit organizations. They take bets on a range of promising early-stage agendas and scale up those that prove most successful…
FAR.AI believes that AI safety is a global public good that receives substantially less investment than capability development. Their theory of change operates on multiple levels: (1) Conducting in-house technical research on robustness, alignment, and evaluation to identify vulnerabilities and develop safety techniques that could prove as transformative as RLHF was for the field, (2) Incubating early-stage research agendas that are too large for individual researchers but too early for industry, then scaling the most promising ones, (3) Building the AI safety field through workshops, fellowships, and a coworking space to grow the pipeline of safety researchers, (4) Bridging technical insights to policy through a technical governance division working with AI Safety Institutes and policymakers, and (5) Grantmaking to accelerate safety research at academic institutions. By combining direct research impact with field-building and policy influence, they aim to achieve major technical breakthroughs and influence safety standard adoption at frontier labs by 2028.
This organization has published no funding asks on grantmaking.ai.
Fundraising data from grantmaking.ai, updated .
View on grantmaking.aiThe FAR.AI YouTube channel (handle: @FARAIResearch) serves as the public video distribution arm for FAR.AI, a technical AI safety research and education nonprofit founded in July 2022 and headquartered in Berkeley, California. The channel provides free access to recordings of expert talks and panel discussions on AI safety topics.
The channel primarily hosts two categories of content. First, recordings from the FAR Seminar series, a weekly event held in person at FAR.Labs (FAR.AI's Berkeley co-working space) and streamed remotely. Seminar speakers have included prominent researchers such as Yoshua Bengio, Nicholas Carlini, Ethan Perez, and Evan Hubinger. Second, full recordings from FAR.AI's Alignment Workshop series, which has been held in cities including San Diego, Singapore, Vienna, New Orleans, San Francisco, and London, bringing together hundreds of AI safety researchers at each event…
By making high-quality AI safety research talks and workshop recordings freely available online, the FAR.AI YouTube channel accelerates the spread of technical knowledge within the AI safety research community. Researchers who cannot attend in-person events in Berkeley or at international workshops can still access cutting-edge work. This lowers barriers to entry for new researchers and helps coordinate understanding across the field, ultimately supporting the broader FAR.AI mission of ensuring advanced AI is safe and beneficial. Wide dissemination of safety research also builds the credibility and visibility of the field with policymakers, industry leaders, and potential funders.
The Language Model Safety Fund was a fiscally sponsored project under Players Philanthropy Fund (PPF), a 501(c)(3) public charity that provides back-office administration and tax-exempt status to charitable initiatives. The fund was led by Ethan Perez, an AI safety researcher who completed his PhD in natural language processing at New York University under the supervision of Kyunghyun Cho and Douwe Kiela.
The fund's primary purpose was to hire and supervise research engineers to work on projects related to misalignment in language models. Specifically, Perez planned to hire four engineers to conduct technical research aimed at identifying and addressing safety issues in large language models.
The Language Model Safety Fund received notable grant funding from two major sources. Open Philanthropy (via Good Ventures) recommended a grant of $425,800 to support salaries and equipment for language model misalignment projects. The Survival and Flourishing Fund, through a recommendation by Jaan Tallinn in its 2022-H1 round, provided $582,000 in general support, disbursed through Players Philanthropy Fund as the receiving charity…
The Language Model Safety Fund operated on the theory that language models pose misalignment risks that require dedicated technical research to identify and mitigate. By funding a small team of research engineers supervised by an expert researcher, the fund aimed to produce concrete safety research outputs addressing how language models can behave in unintended or harmful ways. This work contributed to the broader effort to ensure advanced AI systems are aligned with human values before they become widely deployed.