Cloud Service Integration
Machine Learning
Streaming Data
Operationalization
Natural Language Processing
Bioinformatics and Genomics
MLflow
MLflow is an open source library by the Databricks team designed for managing the machine learning lifecycle. It allows for the creation of projects, tracking of metrics, and model versioning.
Install mlflow using pip
1
pip install mlflow
Copied!
MLflow can be used in any Spark environmnet, but the automated tracking and UI of MLflow is Databricks-Specific Functionality.
Track metrics and parameters
1
import mlflow
2
3
## Log Parameters and Metrics from your normal MLlib run
4
with mlflow.start_run():
5
# Log a parameter (key-value pair)
6
mlflow.log_param("alpha", 0.1)
7
8
# Log a metric; metrics can be updated throughout the run
9
mlflow.log_metric("AUC", 0.871827)
10
mlflow.log_metric("F1", 0.726153)
11
mlflow.log_metric("Precision", 0.213873)
Copied!
Last modified 1yr ago
Export as PDF
Copy link