Senior Applied Scientist, Responsible AI – X DeliveryLocations: Singapore | PerthOverviewJoin the BCG X Responsible AI team to develop and apply innovative tools for testing and evaluating GenAI products.
You will design and implement testing and evaluation frameworks to help improve product quality and ensure AI systems are safe, secure, and equitable.
The Responsible AI Applied Scientist plays a critical role in safety testing and red teaming efforts, working with AI and GenAI product teams to ensure alignment with our Responsible AI policy, principles, and standards, and to support the design, continuous improvement, and execution of the overall Responsible AI program at BCG.ResponsibilitiesDevelop tools and techniques to scale and accelerate AI risk assessment and measurement across BCG and our clientsCollaborate with product teams to influence quality and risk measurement and mitigations in AI/GenAI products through manual efforts and scalable, quantitative approachesResearch new and emerging threats and measurement/evaluation approaches to ensure our approaches stay on the cutting-edgeWork with small technical teams executing risk assessment and measurement on AI/GenAI productsTrain and mentor technical practitioners on measurements and evaluation approaches for GenAI productsRemain up to date on emerging frameworks, standards, and technical approaches, and related issues by participating in workshops, reading professional publications, maintaining personal networks, and participating in professional organizationsQualificationsIdeal candidates will have at least 3 years of professional data science or quantitative research experience; prior professional services experience and experience in Responsible AI are a plusAbility to proactively identify ethical, social, and business risks posed by AI systemsPassion for building things and comfort working with modern data science development toolsExperience designing and analyzing experiments using advanced statistical methodsExperience and enthusiasm for working with Generative AI technologiesBroad conceptual understanding of ML and AI paradigms (e.g., tree-based and gradient-boosted models, deep learning)Strong time management and organizational skills with the ability to prioritize and execute projects independentlyTeam player mindset with an ability to work on diverse, cross-functional teamsExcellent written, verbal, and visual communication skillsAbility to explain sophisticated data science concepts to non-technical audiences and translate analytical results into business implicationsTechnical Skills Must Have ExperienceDesign and analysis of experimentsStatistical modeling, including hierarchical linear modelsGenAI, including prompt engineering and programmatically interacting with foundation models through APIs, e.g., OpenAI, Anthropic, HuggingFacePython and the open-source data science ecosystem (e.g., Jupyter, pandas, scikit-learn, statsmodels, plotly, etc.)Version control with gitNice To Have ExperienceFamiliarity with software engineering practices (e.g., unit testing, CI/CD)Exposure to cloud platforms (AWS, Azure, GCP) or SQL databasesKnowledge of AI risk management frameworks e.g., NIST AI RMF, ISO *****Developer tools including IDEs (e.g., VSCode, Pycharm), environment management (e.g., pyenv, conda, poetry, docker)Boston Consulting Group is an Equal Opportunity Employer.
All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws.
BCG is an E - Verify Employer.
Click here for more information on E-Verify.Seniority levelMid-Senior levelEmployment typeFull-timeJob functionResearch, Analyst, and Information TechnologyIndustriesBusiness Consulting and Services
#J-*****-Ljbffr