MLOps on Hoangph3's Blog https://hoangph3.github.io/tags/mlops/ Recent content in MLOps on Hoangph3's Blog Hugo en Sun, 13 Aug 2023 22:17:28 +0700 Serving TensorFlow Models with a Custom Environment https://hoangph3.github.io/posts/ml_serving_custom_env/ Sun, 13 Aug 2023 22:17:28 +0700 https://hoangph3.github.io/posts/ml_serving_custom_env/ Build a custom serving environment to run TensorFlow models with extra dependencies. TensorFlow Serving: Handling Content Types https://hoangph3.github.io/posts/ml_serving_content_type/ Sat, 29 Jul 2023 13:33:38 +0700 https://hoangph3.github.io/posts/ml_serving_content_type/ Explore how TensorFlow Serving handles different request content types for inference. Building a Feature Store for Machine Learning https://hoangph3.github.io/posts/feature_store/ Sat, 29 Jul 2023 13:32:54 +0700 https://hoangph3.github.io/posts/feature_store/ Design and proposal for a feature store to serve consistent features for training and serving. Data Mining - Deep Dive into Big Data Pipelines https://hoangph3.github.io/posts/data_pipeline/ Sat, 29 Jul 2023 13:32:54 +0700 https://hoangph3.github.io/posts/data_pipeline/ Build a big-data pipeline stack combining Airflow, Spark and Kafka clusters with Docker. Serving TensorFlow Models with JSON Requests https://hoangph3.github.io/posts/ml_serving_json_model/ Thu, 27 Jul 2023 22:18:49 +0700 https://hoangph3.github.io/posts/ml_serving_json_model/ Send and parse JSON prediction requests against a TensorFlow Serving model. Serving Custom TensorFlow Models https://hoangph3.github.io/posts/ml_serving_custom_model/ Wed, 26 Jul 2023 00:43:34 +0700 https://hoangph3.github.io/posts/ml_serving_custom_model/ Package and serve a custom TensorFlow model signature with TensorFlow Serving. Serving Multiple TensorFlow Models with Monitoring https://hoangph3.github.io/posts/ml_serving_multi_model/ Wed, 26 Jul 2023 00:02:51 +0700 https://hoangph3.github.io/posts/ml_serving_multi_model/ Serve multiple TensorFlow models simultaneously and monitor them with Prometheus and Swagger. Integrating Seldon Core with Kafka https://hoangph3.github.io/posts/seldon_core_kafka_integration/ Fri, 02 Dec 2022 01:06:21 +0700 https://hoangph3.github.io/posts/seldon_core_kafka_integration/ Stream predictions in and out of Seldon Core model deployments using Kafka. Building Inference Graphs with Seldon Core https://hoangph3.github.io/posts/seldon_core_inference_graph/ Thu, 01 Dec 2022 21:13:24 +0700 https://hoangph3.github.io/posts/seldon_core_inference_graph/ Compose multi-step inference graphs (transformers, combiners, routers) with Seldon Core. Orchestrating ML Workflows with Seldon Core https://hoangph3.github.io/posts/seldon_core_workflows/ Thu, 01 Dec 2022 21:01:58 +0700 https://hoangph3.github.io/posts/seldon_core_workflows/ Automate model deployment workflows on top of Seldon Core. Deploying Your First Model with Seldon Core https://hoangph3.github.io/posts/seldon_core_first_model/ Thu, 01 Dec 2022 21:01:41 +0700 https://hoangph3.github.io/posts/seldon_core_first_model/ Deploy a first machine learning model on Kubernetes using Seldon Core, including authentication basics. Building Kubeflow Pipeline Components https://hoangph3.github.io/posts/kubeflow_pipeline_components/ Tue, 01 Nov 2022 23:03:34 +0700 https://hoangph3.github.io/posts/kubeflow_pipeline_components/ Create custom and reusable components for Kubeflow Pipelines. Distributed Training with TensorFlow https://hoangph3.github.io/posts/distributed_training_tensorflow/ Tue, 01 Nov 2022 23:03:34 +0700 https://hoangph3.github.io/posts/distributed_training_tensorflow/ Train TensorFlow models across multiple workers using distributed training strategies. Autoscaling TensorFlow Serving on Kubernetes https://hoangph3.github.io/posts/autoscale_tensorflow_serving/ Fri, 30 Sep 2022 22:13:01 +0700 https://hoangph3.github.io/posts/autoscale_tensorflow_serving/ Set up horizontal pod autoscaling for a TensorFlow Serving deployment on Kubernetes.