Serving TensorFlow Models with a Custom Environment

Build a custom serving environment to run TensorFlow models with extra dependencies.

August 13, 2023 · 4 min · 688 words · hoangph3

TensorFlow Serving: Handling Content Types

Explore how TensorFlow Serving handles different request content types for inference.

July 29, 2023 · 8 min · 1565 words · hoangph3

Building a Feature Store for Machine Learning

Design and proposal for a feature store to serve consistent features for training and serving.

July 29, 2023 · 2 min · 260 words · hoangph3

Data Mining - Deep Dive into Big Data Pipelines

Build a big-data pipeline stack combining Airflow, Spark and Kafka clusters with Docker.

July 29, 2023 · 4 min · 760 words · hoangph3

Serving TensorFlow Models with JSON Requests

Send and parse JSON prediction requests against a TensorFlow Serving model.

July 27, 2023 · 4 min · 742 words · hoangph3

Serving Custom TensorFlow Models

Package and serve a custom TensorFlow model signature with TensorFlow Serving.

July 26, 2023 · 2 min · 421 words · hoangph3

Serving Multiple TensorFlow Models with Monitoring

Serve multiple TensorFlow models simultaneously and monitor them with Prometheus and Swagger.

July 26, 2023 · 5 min · 953 words · hoangph3

Integrating Seldon Core with Kafka

Stream predictions in and out of Seldon Core model deployments using Kafka.

December 2, 2022 · 2 min · 362 words · hoangph3

Building Inference Graphs with Seldon Core

Compose multi-step inference graphs (transformers, combiners, routers) with Seldon Core.

December 1, 2022 · 7 min · 1374 words · hoangph3

Orchestrating ML Workflows with Seldon Core

Automate model deployment workflows on top of Seldon Core.

December 1, 2022 · 5 min · 1002 words · hoangph3