{"id":17759,"date":"2023-12-19T01:11:57","date_gmt":"2023-12-19T06:11:57","guid":{"rendered":"https:\/\/usa.businessupturn.com\/?p=17759"},"modified":"2023-12-19T01:15:21","modified_gmt":"2023-12-19T06:15:21","slug":"openai-to-fend-off-ai-user-harm-gives-board-veto-power-on-risky-ai","status":"publish","type":"post","link":"https:\/\/www.businessupturn.com\/usa\/openai-to-fend-off-ai-user-harm-gives-board-veto-power-on-risky-ai\/17759\/","title":{"rendered":"OpenAI to fend off AI user harm, gives board veto power on risky AI"},"content":{"rendered":"<p>Sam Altman-run OpenAI has expanded its internal safety processes to tackle the threat of harmful AI amid increased government scrutiny. The company said it will establish a dedicated team to oversee technical work and an operational structure for safety decision-making. \u201cWe are creating a cross-functional Safety Advisory Group to review all reports and send them concurrently to Leadership and the Board of Directors.<\/p>\n<p>While Leadership is the decision-maker, the Board of Directors holds the right to reverse decisions,\u201d it said late on Monday. OpenAI discussed its updated \u201cPreparedness Framework\u201d, saying it will invest in the design and execution of rigorous capability evaluations and forecasting to better detect emerging risks. \u201cWe will run evaluations and continually update \u2018scorecards\u2019 for our models. We will evaluate all our frontier models, including at every 2x effective compute increase during training runs. We will push models to their limits,\u201d said the ChatGPT maker.<\/p>\n<p>The goal is to probe the specific edges of what\u2019s unsafe to effectively mitigate the revealed risks. To track the safety levels of our models, OpenAI will produce risk \u201cscorecards\u201d and detailed reports. \u201cWe will also implement additional security measures tailored to models with high or critical (pre-mitigation) levels of risk,\u201d said the company. OpenAI said it will develop protocols for added safety and outside accountability. \u201cThe Preparedness Team will conduct regular safety drills to stress-test against the pressures of our business and our own culture,\u201d it added.<\/p>\n<p>The company will also collaborate closely with external parties as well as internal teams like Safety Systems to track real-world misuse.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Sam Altman-run OpenAI has expanded its internal safety processes to tackle the threat of harmful AI amid increased government scrutiny\u2026.<\/p>\n","protected":false},"author":28,"featured_media":17761,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[9],"tags":[5508,2658,5506,5507,5505,4570,3415,5504,3416],"class_list":["post-17759","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech","tag-accountability","tag-ai","tag-government-scrutiny","tag-internal-safety","tag-misuse","tag-mitigation","tag-openai","tag-risks","tag-sam-altman"],"reading_time":"2 min read","_links":{"self":[{"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/posts\/17759","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/users\/28"}],"replies":[{"embeddable":true,"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/comments?post=17759"}],"version-history":[{"count":0,"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/posts\/17759\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/media\/17761"}],"wp:attachment":[{"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/media?parent=17759"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/categories?post=17759"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.businessupturn.com\/usa\/wp-json\/wp\/v2\/tags?post=17759"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}