



Decision Optimization Using ML Models
Learn how to optimize decision rules and measure the impact of your machine learning work, live with Dan Becker, an industry leader with experience at Google and Data Robot.
Access to: session recordings, curated resources and exclusive events
Designed to help make organizations
Data Driven
Product Leaders
Program managers and product managers that are focused on metrics like growth and revenue, and prioritization decisions
Data Scientists
Data Scientists and Data Science managers who help map strategic decisions to actionable experimental designs and then interpret the results in a trustworthy manner



Engineering Leaders
Engineering managers, directors, VPs, and CTOs who want to make their organizations data-driven with metrics and A/B tests



Designed for Data Scientists and ML Engineers
who want to better prioritization of ML efforts by estimating business impacts of models before building them
- Optimize business rules for programmatically translating ML predictions into actions
- Measure the impact of deployed ML models on business metrics like costs, revenue, customer retention, etc.
- Identify and fix the common problems that prevent ML systems from leading to better business outcomes
- Be proficient at building machine learning models with tabular data and comparing standard validation measures (eg confusion matrix, AUC and RMSE scores)
- Have experience building deep learning models with Keras / TensorFlow
- Be comfortable with statistical ideas like density functions
Live Cohort
Machine learning models make predictions, but predictions don't tell you what action to take. For example, a model might predict that a transaction is 18% likely to be fraud, but a payment processor will apply a decision rule to determine whether they process or reject the transaction. Many models never go into production because a business fails to find a decision rule they are comfortable with. Even worse, many deployed models produce no practical value because they are followed by inefficient decision rules. In this live course, you will learn how to optimize decision rules and measure the impact of your work on business metrics rather than just model accuracy metrics.

In traditional software development, CI/CD automates many tasks, including testing, building and deploying software. But CI/CD for ML is a different beast. Testing and deployment of ML can be triggered by many event types, and observability and logging requirements are materially different for ML.Today, no single tool can facilitate end-to-end CI/CD for ML. The process of testing, building and deploying ML requires a symphony of tools and glue code to create an integrated CI/CD system. To offer an entry point that many data scientists and engineers are familiar with, we’ll teach you how to integrate GitHub with other ML tools to build custom CI/CD automations for ML that will increase your engineering efficiency and prevent errors from being released to production.
- Apply profit curves for optimizing decision thresholds with binary classification models
- Predict the business value of alternative ML projects before you start them, and estimate the dollar value of potential improvements in model quality
- Identify limitations of profit curves through a case study of insurance carrier prioritizing which medical claims to inspect
- Case Study: optimizing retail inventory using a demand forecasting model
- Build a deep learning model to predict statistical distributions rather than just point predictions
- Evaluate how alternative loss metrics apply to different real-world decision-making processes
- Case Study in financial services
- Design joint strategy for model validation and decision rule validation
- Integrate multiple ML models for more realistic simulations
- Explain the sim2real problem and alternatives to make decision optimization more robust
- Use domain knowledge to proactively correct for how training data may misrepresent future relationships
- Define strategy for testing a decision rule in real world with minimal risk
- Develop a strategy for bringing decision optimization to your business
- Evaluate and improve proposals for applying decision optimization
Team?
Sphere offers a range of subscription packages that provide discounts on all courses in our library. We help upskill employees at some of the world’s best companies. Learn more about pricing options here or book a time to talk to one of our staff below.
Book a free consultation
Learn live from a world-class
Instructor

Learn live from a world-class
Instructor
Dan Becker is the VP of ML Development Tools for DataRobot. He finished in 2nd place (out of 1350+ teams) in a machine learning competition with a $500,000 grand prize. He's led AI consulting projects for 6 companies in the Fortunate 100, and over 500,000 people have taken his applied AI courses on Kaggle. Dan is a contributor to TensorFlow and Keras. He worked as a data scientist at Google before founding Decision.AI to help data scientists optimize the decision rules they use for translating ML predictions into business decisions. Dan has a PhD in economics.
Learn live from world-class
Instructors

Dan Becker is the VP of ML Development Tools for DataRobot. He finished in 2nd place (out of 1350+ teams) in a machine learning competition with a $500,000 grand prize. He's led AI consulting projects for 6 companies in the Fortunate 100, and over 500,000 people have taken his applied AI courses on Kaggle. Dan is a contributor to TensorFlow and Keras. He worked as a data scientist at Google before founding Decision.AI to help data scientists optimize the decision rules they use for translating ML predictions into business decisions. Dan has a PhD in economics.
Guest Lectures by
Industry Experts

Join a diverse and experienced
Community
This cohort gives you access to a rich community of like-minded professionals from some of the best businesses in the world. Even after the course ends, you will continue to learn and build with each other.

Exclusive Content
to advance your business
Get access to exclusive content through live sessions, meetups and our Student Portal (even after you finish the cohort). Ask questions and get personal feedback directly from your instructors and others taking the course.

Still have questions?
We’re here to help!
Do I have to attend all of the sessions live in real-time?
You don’t! We record every live session in the cohort and make each recording and the session slides available on our portal for you to access anytime.
Will I receive a certificate upon completion?
Each learner receives a certificate of completion, which is sent to you upon completion of the cohort (along with access to our Alumni portal!). Additionally, Sphere is listed as a school on LinkedIn so you can display your certificate in the Education section of your profile.
Is there homework?
Throughout the cohort, there may be take-home questions that pertain to subsequent sessions. These are optional, but allow you to engage more with the instructor and other cohort members!
Can I get the course fee reimbursed by my company?
While we cannot guarantee that your company will cover the cost of the cohort, we are accredited by the Continuing Professional Development (CPD) Standards Office, meaning many of our learners are able to expense the course via their company or team’s L&D budget. We even provide an email template you can use to request approval.
I have more questions, how can I get in touch?
Please reach out to us via our Contact Form with any questions. We’re here to help!