ออฟไลน์ด้วยแอป Player FM !
185: Workflow Orchestrators
Fetch error
Hmmm there seems to be a problem fetching this series right now. Last successful fetch was on November 04, 2025 16:06 ()
What now? This series will be checked again in the next day. If you believe it should be working, please verify the publisher's feed link below is valid and includes actual episode links. You can contact support to request the feed be immediately fetched.
Manage episode 517701083 series 8393
Intro topic: Asymmetric Returns
News/Links:
- NanoChat by Andrej Karpathy
- Pydantic AI
- 1000th Starlink this year
- ChatGPT Apps SDK
Book of the Show
- Patrick
- The Will of the Many by James Islington
- Jason
- Interview with DHH (Founder of Ruby on Rails)
Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h
Tool of the Show
- Patrick
- Factorio
- Jason
Topic: Workflow Orchestrators
- Why
- Batch jobs (embarrassingly parallel)
- Long-running tasks (e.g. transcoding video)
- Checkpointing/resuming
- How
- Message Queues
- Containerization
- Worker Pools & Autoscaling
- History & Backfill
- Steps to run workflows:
- Containerize the workflow definition and send to the cloud
- Containerize all the individual tasks
- Submit job(s)
- Examples
- Airflow
- Legacy but dominant
- Dagster
- Great UX for python developers
- Temporal: https://temporal.io/
- The new hotness
- Ray
- Low-level but very powerful
- Kubeflow
- Designed for ML workflows, integrated dashboard
- Airflow
186 ตอน
Fetch error
Hmmm there seems to be a problem fetching this series right now. Last successful fetch was on November 04, 2025 16:06 ()
What now? This series will be checked again in the next day. If you believe it should be working, please verify the publisher's feed link below is valid and includes actual episode links. You can contact support to request the feed be immediately fetched.
Manage episode 517701083 series 8393
Intro topic: Asymmetric Returns
News/Links:
- NanoChat by Andrej Karpathy
- Pydantic AI
- 1000th Starlink this year
- ChatGPT Apps SDK
Book of the Show
- Patrick
- The Will of the Many by James Islington
- Jason
- Interview with DHH (Founder of Ruby on Rails)
Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h
Tool of the Show
- Patrick
- Factorio
- Jason
Topic: Workflow Orchestrators
- Why
- Batch jobs (embarrassingly parallel)
- Long-running tasks (e.g. transcoding video)
- Checkpointing/resuming
- How
- Message Queues
- Containerization
- Worker Pools & Autoscaling
- History & Backfill
- Steps to run workflows:
- Containerize the workflow definition and send to the cloud
- Containerize all the individual tasks
- Submit job(s)
- Examples
- Airflow
- Legacy but dominant
- Dagster
- Great UX for python developers
- Temporal: https://temporal.io/
- The new hotness
- Ray
- Low-level but very powerful
- Kubeflow
- Designed for ML workflows, integrated dashboard
- Airflow
186 ตอน
ทุกตอน
×ขอต้อนรับสู่ Player FM!
Player FM กำลังหาเว็บ