🚨 Black Friday Sale 🚨 Purchase a course through an individual or team subscription and get $400 | Redeem by registering for a course | Expires Monday 5pm PT

Designed to help make organizations

Data Driven

Product Leaders

Program managers and product managers that are focused on metrics like growth and revenue, and prioritization decisions

Data Scientists

Data Scientists and Data Science managers who help map strategic decisions to actionable experimental designs and then interpret the results in a trustworthy manner

The motivation and basics of A/B testing (e.g., causality, surprising examples, metrics, interpreting results, trust and pitfalls, Twyman’s law, A/A tests)
Cultural challenges, humbling results (e.g., failing often, pivoting, iterating), experimentation platform, institutional memory and meta-analysis, ethics
Hierarchy of evidence, Expected Value of Information (EVI), complementary techniques, risks in observational causal studies

Engineering Leaders

Engineering managers, directors, VPs, and CTOs who want to make their organizations data-driven with metrics and A/B tests

Safe deployments
Triggering, especially in evaluating machine learning models
The benefits of agile product development

Designed for Data Scientists and ML Engineers

who want to better prioritization of ML efforts by estimating business impacts of models before building them

You will:
  • Optimize business rules for programmatically translating ML predictions into actions
  • Measure the impact of deployed ML models on business metrics like costs, revenue, customer retention, etc.
  • Identify and fix the common problems that prevent ML systems from leading to better business outcomes
You should:
  • Be proficient at building machine learning models with tabular data and comparing standard validation measures (eg confusion matrix, AUC and RMSE scores)
  • Have experience building deep learning models with Keras / TensorFlow
  • Be comfortable with statistical ideas like density functions

Learn live from a world-class

Instructor

Learn live from a world-class

Instructor

Dan Becker is the VP of ML Development Tools for DataRobot. He finished in 2nd place (out of 1350+ teams) in a machine learning competition with a $500,000 grand prize. He's led AI consulting projects for 6 companies in the Fortunate 100, and over 500,000 people have taken his applied AI courses on Kaggle. Dan is a contributor to TensorFlow and Keras. He worked as a data scientist at Google before founding Decision.AI to help data scientists optimize the decision rules they use for translating ML predictions into business decisions. Dan has a PhD in economics.

Learn live from world-class

Instructors

Dan Becker is the VP of ML Development Tools for DataRobot. He finished in 2nd place (out of 1350+ teams) in a machine learning competition with a $500,000 grand prize. He's led AI consulting projects for 6 companies in the Fortunate 100, and over 500,000 people have taken his applied AI courses on Kaggle. Dan is a contributor to TensorFlow and Keras. He worked as a data scientist at Google before founding Decision.AI to help data scientists optimize the decision rules they use for translating ML predictions into business decisions. Dan has a PhD in economics.

Recommended by

Industry Experts

No items found.

Expense
the cost

90% of our learners expense the full cost of our courses to their employer. This includes leading startups and enterprises alike.

Check Expense Approval At Your Company

Exclusive Content

to advance your business

Get access to exclusive content through live sessions, meetups and our Student Portal (even after you finish the cohort). Ask questions and get personal feedback directly from your instructors and others taking the course.

Join a diverse and experienced

Community

This cohort gives you access to a rich community of like-minded professionals from some of the best businesses in the world. Even after the course ends, you will continue to learn and build with each other.

About Dan's

Live Cohort

Machine learning models make predictions, but predictions don't tell you what action to take. For example, a model might predict that a transaction is 18% likely to be fraud, but a payment processor will apply a decision rule to determine whether they process or reject the transaction. Many models never go into production because a business fails to find a decision rule they are comfortable with. Even worse, many deployed models produce no practical value because they are followed by inefficient decision rules. In this live course, you will learn how to optimize decision rules and measure the impact of your work on business metrics rather than just model accuracy metrics.

Session 1: Profit Curves and Key Ideas in Decision Optimization

Wednesday, January 18, 2023
4-6 pm PST
  • Apply profit curves for optimizing decision thresholds with binary classification models
  • Predict the business value of alternative ML projects before you start them, and estimate the dollar value of potential improvements in model quality
  • Identify limitations of profit curves through a case study of insurance carrier prioritizing which medical claims to inspect

Session 2: Continuous Outcomes

Monday, January 23, 2023
4-6 pm PST
  • Case Study: optimizing retail inventory using a demand forecasting model
  • Build a deep learning model to predict statistical distributions rather than just point predictions
  • Evaluate how alternative loss metrics apply to different real-world decision-making processes

Session 3: Simulation for Dynamic Decision Optimization

Wednesday, January 25, 2023
4-6 pm PST
  • Case Study in financial services
  • Design joint strategy for model validation and decision rule validation
  • Integrate multiple ML models for more realistic simulations

Session 4: Concept Drift and How Things Go Wrong

Monday, January 30, 2023
4-6 pm PST
  • Explain the sim2real problem and alternatives to make decision optimization more robust
  • Use domain knowledge to proactively correct for how training data may misrepresent future relationships
  • Define strategy for testing a decision rule in real world with minimal risk

Session 5: Workshop to Apply Everything You’ve Learned

Wednesday, February 1, 2023
4-6 pm PST
  • Develop a strategy for bringing decision optimization to your business
  • Evaluate and improve proposals for applying decision optimization

Still have questions?

We’re here to help!

Do I have to attend all of the sessions live in real-time?

You don’t! We record every live session in the cohort and make each recording and the session slides available on our portal for you to access anytime.

Will I receive a certificate upon completion?

Each learner receives a certificate of completion, which is sent to you upon completion of the cohort (along with access to our Alumni portal!). Additionally, Sphere is listed as a school on LinkedIn so you can display your certificate in the Education section of your profile.

Is there homework?

Throughout the cohort, there may be take-home questions that pertain to subsequent sessions. These are optional, but allow you to engage more with the instructor and other cohort members!

Can I get the course fee reimbursed by my company?

While we cannot guarantee that your company will cover the cost of the cohort, we are accredited by the Continuing Professional Development (CPD) Standards Office, meaning many of our learners are able to expense the course via their company or team’s L&D budget. We even provide an email template you can use to request approval.

I have more questions, how can I get in touch?

Please reach out to us via our Contact Form with any questions. We’re here to help!

Book a time to talk with the Sphere team

Join us for a next generation

Learning Experience