Hacking algorithms around factuality, bias, and misdirection

All Tech Is Human is a non-profit committed to building the world’s largest multistakeholder, multidisciplinary network in Responsible Tech. This allows us to tackle wicked tech & society issues while moving at the speed of tech, leverage the collective intelligence of the community, and diversify the traditional tech pipeline. Together, we work to solve tech & society’s thorniest issues.

For our upcoming gathering, we are collaborating with Humane Intelligence to present Hacking algorithms around factuality, bias, and misdirection.

Humane Intelligence recently launched the first of 10 "algorithmic bias bounty" programs, which will be unfolding over the coming year. With the support of Google.org, they are building themed programs that aim to build community and professionalize the practice of algorithmic assessment.

The first challenge involves creating a probability estimation model that determines whether the prompt provided to a language model will elicit an outcome that demonstrates factuality, bias, or misdirection, inspired by the data from the DEF CON Generative AI Red Teaming Challenge: Transparency Report. We invite participants of all skill levels to enter and we have $10,000 of prizes for beginner, intermediate, and advanced.

Why this challenge? We’re proposing an interesting approach to finding issues in generative AI models before they happen - if we can more accurately predict whether a given prompt is either intentionally or unintentionally designed to lead to a bad outcome, we are better able to stop problems before they happen. We are pleased to meet recent demands for greater AI oversight (including this week's bipartisan Senate report, “Driving U.S. Innovation in Artificial Intelligence”), which specifically advocates for funding bug bounties and grand challenges.

Humane Intelligence is partnering with All Tech is Human to organize a hackathon around this bias bounty challenge. Participants in the hackathon will be supported as they delve into this first bias bounty challenge.

We will also have a panel on AI governance, crowdsourcing, and community-based responses.

We invite you to join us on Tuesday, July 9 from 6 - 8:30 PM at Betaworks in Manhattan.

===

Our activities focus on three areas: community, education, and careers:

• Join our working groups on Responsible AI.
• Read our reports, such as our Responsible Tech Guide and our recent Responsible Tech Org List 2024
• Join our Slack community of over 8k members across 90 countries, with numerous individuals focused on creating healthy digital spaces
• Read our Responsible Tech Job Board and join our talent pool
• Check out our growing University Network
• Participate in our mentorship program
• Attend our weekly livestream series

Our gatherings draw a broad mix of individuals across civil society, government, industry, and academia. Previous speakers at our gatherings have included Sherry Turkle, Frances Haugen, Tim Wu, Nabiha Syed, Julie Inman Grant, Yael Eisenstat, Kashmir Hill, Meredith Broussard, Douglas Rushkoff, Yoel Roth, Maya Wiley, and many more.

===

This event will be photographed and recorded. ATIH may list guests’ organization or company affiliation on our public materials, such as marketing or blog posts, without attribution to the individual. If you do not wish for your organizational affiliation to be publicly listed, please indicate so in the comments. If you require wheelchair access, please indicate in the "Comments" section when registering. Question? Reach out to Hello / AllTechIsHuman.org

Host or Publisher All Tech Is Human