Risk Model Validation Associate - GenAI & Machine Learning Job at Santander Holdings USA Inc Careers, New York, NY

WDdjQytkMGp3Z2xGVVozekVhOUE3czJ5WXc9PQ==
  • Santander Holdings USA Inc Careers
  • New York, NY

Job Description

Risk Model Validation Associate - GenAI & Machine Learning

Boston, United States of America

The Associate, Risk Modeling conducts robust validations of a wide variety of risk models against established standards, develops benchmarks, and challenges and replicates models where applicable. Manages models of advanced complexity and leads special projects and/or programs.

  • Reviews and assesses overall model health within a given framework, identifies potential problems and works with stakeholders to resolve.

  • Conducts robust validations of a wide variety of models against established standards, develops benchmarks, challenges, and replicates models where applicable.

  • Assesses model performance and evaluates model assumptions and weaknesses.

  • Collaborates with model owners and develops to understand the business context for models.

  • Ensures adherence to the policies and procedures established by the company.

 

Qualifications: To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

  • Education: Bachelor's Degree or equivalent work experience. Master’s or equivalent degree in Statistics, Mathematics, Engineering, Computer Science, Economics, or related fields is a preferred.

  • Work Experience: 5+ years developing or validating quantitative machine learning (ML) models or Large Language Models (LLMs) frameworks. Experience in the financial services industry, including expertise in risk modeling and regulatory compliance (SR 11-7) is preferred.

  • AI/ML Expertise: Demonstrated experience with Artificial Intelligence and Machine Learning (AI/ML) frameworks such as TensorFlow, PyTorch and Scikit-learn. Hands-on experience with gradient boosting models, NN and other ML algorithms for classification and regression.

  • LLM Knowledge: Experience with LLMs framework including model’s architecture, methodology, implementation, APIs, and evaluation, with working knowledge of prompt-tuning and RAG/fine-tuning LLMs applications. Leaderboards review. Experience with Hugging Face models and datasets, and testing design and execution for GenAI risks such as hallucination, accuracy, toxicity, prompt injection, bias etc.

  • Programming skills: Proficiency in Python and R. Experience in cloud-based solutions (AWS, Azure) is a plus.

  • Excellent organizational skills, strong communication, with the ability to work cross-functionally with model developers, data engineers, technology, and governance teams.

EEO Statement: At Santander, we value and respect differences in our workforce. We actively encourage everyone to apply.

Santander is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, genetics, disability, age, veteran status or any other characteristic protected by law.

This job description does not list all of the job duties of the job. You may be asked by your supervisors or managers to perform other duties. You may be evaluated in part based upon your performance of the tasks listed in this job description. The employer has the right to revise this job description at any time. This job description is not a contract for employment and either you or the employer may terminate at any time for any reason.

Primary Location:  Boston, MA, Boston

Other Locations:  Massachusetts-Boston,Texas-Dallas,New York-New York

Organization:  Santander Holdings USA, Inc.

Salary: $90,000 - $165,000/year

Job Tags

Contract work, Work experience placement,

Similar Jobs

Professional Case Management

Registered Nurse - RN Case Manager Job at Professional Case Management

 ...previous work environment. Our RN-Case Managers conduct in-home nursing visits for our clients. All our clients are former Nuclear...  ...Graduate of a state approved school of professional registered nursing BSN preferred Current, unrestricted RN license in... 

SQRL

Clinical Research Coordinator Job at SQRL

 ...Comprehensive benefits including health insurance, PTO, and 401k match Join a thriving research network with long-term growth potential Hands-on work supporting impactful clinical trials across multiple phases Collaborative, inclusive, and mission-driven culture... 

Lumicity

Test Pilot Job at Lumicity

 ...CA On-Site | Full-Time Why Join Us My client is an innovative, cutting-edge aerospace startup who is seeking a skilled Test Pilot to join their dynamic team. This is a unique opportunity to work with a passionate and forward-thinking team in a flexible working... 

Kindred Healthcare

Security Guard, PRN, Nights Job at Kindred Healthcare

 ...Kindred Healthcare - SageWest Health Care Lander [Security Officer] As a Security Guard at Kindred Healthcare, you'll: Provide security services to ensure a safe environment for patients, visitors, and staff; Ensure only authorized staff are admitted into hospital premises... 

National Testing Network

Police Officer-Parma Heights City Of Job at National Testing Network

 ...resignation in lieu of discipline from a public safety occupation. Military History: Dishonorable discharge or equivalent to a felony conviction under the Uniform Code of Military Justice. Traffic Offenses: Lack of a valid driver's license, vehicular homicide convictions...