Facebook to bring in AI technology to review sensitive posts

Ryan Barnes, product manager at Facebook community revealed that they are improving its content moderation tool with enhanced artificial intelligence and machine learning capabilities, which it says will help combat hate posts and misinformation more effectively. He further added that the new system would enable constructively prioritising content based on three parameters: viral-ity, severity and impact.

Until now, posts that are thought to violate the company’s rules are typically flagged to human moderators, both proactively and reactively. Now, Facebook intends to ensure that the most important posts are reviewed by human moderators first with the help of an improved AI algorithm system for content that requires moderation to queue the posts.

According to reports to get desired results Facebook will use a combination of machine learning algorithms to sort a queue of flagged posts, based on the sensitivity of the content. These potentially harmful posts can either be reported by users, or in the proactive mode, detected automatically by Facebook’s AI. Once such posts are passed from the AI level to human moderators and eventually resolved, the same system will then tackle spam and other less inciting posts. Posts that receive the highest level of priority include terrorism, child exploitation, self harm and other related aspects.

Facebook software engineer Chris Palow notes that the system might still witness flaws. The new technology can help make contextual decisions in the super important post moderations something that Facebook will look forward in order to cut down on problematic content. “The system is about marrying AI and human reviewers to make less total mistakes,” said Palow.

Facebook has been criticized severely for mishandling hate posts and misinformation across its platforms in the last few years. The company faced the challenge of dealing with pandemic-related misinformation across platforms they also took several steps to limit misinformation during the US Presidential elections.