AI Systems Risk Assessment: Risk Management

1. Introduction

This sample survey is designed to examine the Bank’s risk management practices for artificial intelligence systems and AI models.

Drawing from the National Institute of Standards and Technology's (NIST) Artificial Intelligence Risk Management Framework (Framework), it emphasizes AI risk management as essential for the use of AI technologies.¹

The survey is based on recommendations, referred to as "Suggested Actions", in NIST's AI RMF Playbook.² Questions include references to the function, category and sub-category, and Suggested Action numbering in the Playbook. For example, "Govern 1.2 SA1" refers to the first Suggested Action in category 1, sub-category 2 of the Govern function.

The survey covers:

AI systems risk management policies, standards, and procedures
Board or board-appointed committee oversight
Roles and Responsibilities of AI Actors
Building and maintaining an AI systems inventory
AI systems risk factors and risk tolerance for the Bank's AI systems
Decommissioning and exit strategies for AI systems.

This survey is one of a series that DS&A has designed for each of the “AI actor” roles (a term defined in the Framework), including the Chief Information Security Officer, the Chief Data Scientist, the AI systems development manager, and the manager of AI model vendor management.

Thank you.
John
John Seddon
john@firiskassessment.com
310 344 2408

¹Artificial Intelligence Risk Management Framework, NIST AI 100-1, NIST, January 2023.
²AI RMF Playbook, NIST, January 2023.