Carex is partnering with a Financial Services industry partner to identify an AI Governance & Monitoring leader responsible for designing and implementing the monitoring and control framework that ensures AI systems are deployed and operated in accordance with governance standards, regulatory expectations, and organizational risk policies. This role oversees the monitoring, testing, and reporting of AI model performance, fairness, reliability, and compliance across the AI lifecycle. Working closely with cross-functional teams, this position ensures AI systems remain controlled, transparent, and auditable while enabling responsible and scalable innovation. This is a contract role and will be onsite in Madison, WI one day per week.
What You’ll Do
-
Collaborate with cross-functional teams including data scientists, engineers, legal, risk, compliance, data governance, and ethics partners to embed AI governance best practices into AI/ML model development and third-party AI solution deployment.
-
Establish and operationalize processes for AI risk assessment, bias detection, transparency, accountability, and explainability.
-
Ensure required governance documentation, risk assessments, and approvals are completed prior to production deployment of AI systems.
-
Maintain the enterprise inventory of AI models and AI-enabled systems.
-
Partner with technical and product teams to support responsible development and delivery of AI capabilities.
-
Execute AI risk assessments and ensure appropriate governance controls are applied before models enter production.
-
Implement and operate governance controls across the full AI model lifecycle, including development, deployment, monitoring, and retirement.
-
Monitor deployed AI systems to ensure model performance, reliability, fairness, and transparency standards are consistently maintained.
-
Identify, investigate, and help mitigate model drift, bias, performance degradation, and unintended outcomes.
-
Coordinate remediation efforts with technical teams when governance thresholds or risk tolerances are exceeded.
-
Conduct regular audits and control testing to verify adherence to AI governance policies and standards.
-
Support internal audit activities, regulatory reviews, and compliance assessments related to AI systems.
-
Maintain detailed documentation supporting governance controls, monitoring activities, and remediation actions.
-
Develop and maintain dashboards and reporting mechanisms that provide visibility into AI governance compliance and risk exposure.
-
Track AI systems throughout their lifecycle to ensure governance requirements continue to be met after deployment.
What You’ll Bring
-
Bachelor’s degree in computer science, analytics, economics, law, or a related field, or equivalent combination of education and relevant professional experience.
-
7+ years of experience in the data, analytics, or technology space, including work in AI governance, model risk management, regulatory compliance, technology risk, or a related discipline.
-
3+ years of experience working with AI/ML systems, model development teams, or AI-enabled products, with understanding of model design, deployment, and monitoring concepts.
-
Ability to engage with data scientists and engineers on AI/ML model architecture, training data considerations, deployment patterns, and monitoring techniques.
-
Experience implementing or operating governance controls related to the AI/ML lifecycle, such as model inventory management, validation, monitoring, or lifecycle governance.
-
Knowledge of AI governance and risk frameworks such as NIST AI Risk Management Framework (AI RMF), ISO/IEC 42001, Model Risk Management (SR 11-7), NAIC AI Principles, or similar regulatory or governance standards.
-
Strong analytical and problem-solving capabilities with the ability to evaluate complex issues and translate them into actionable governance and control processes.
-
Excellent written and verbal communication skills with strong stakeholder engagement capabilities.
-
Experience working within cross-functional environments that include legal, compliance, data governance, engineering, and business teams.
-
Experience with AI/ML model monitoring, governance tooling, or observability platforms is preferred.
-
Familiarity with AI/ML auditing tools and bias detection methodologies is preferred.
Carex Consulting Group is an equal opportunity employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender identity, or Veteran status.
#LI-LL1