DagsterAWSTerraform
Deploying Dagster on AWS: A Production-Ready Guide
A comprehensive walkthrough of running Dagster on ECS Fargate with RDS, ALB, and Terraform. Lessons learned from real production deployments.
Read article →⭐TOP RATED PLUS
Top Rated Plus on Upwork
Top Rated Plus is awarded to the top 3% of talent on Upwork — a recognition based on consistent client satisfaction, on-time delivery, and quality of work.
View Upwork Profile →Job Success Score100%
Top Rated PlusTop 3%
Projects Delivered10+
Selected Projects
Anonymized summaries of real client engagements
FINANCIAL SERVICES
Challenge
Manual ETL processes taking 8+ hours daily with frequent failures.
Solution
Built an automated Dagster pipeline with AWS Glue and S3, reducing processing time to 45 minutes.
DagsterAWS GlueS3Python
Outcome
95% reduction in processing time, zero manual interventions.
E-COMMERCE
Challenge
Fragmented data across 5 platforms with no unified analytics view.
Solution
Designed a star-schema data warehouse on Redshift with dbt transformations and a Metabase dashboard.
AWS RedshiftdbtPythonMetabase
Outcome
Single source of truth for C-suite reporting, deployed in 6 weeks.
HEALTHCARE TECH
Challenge
High-volume document processing done entirely by hand — 200+ PDFs/day.
Solution
AI-powered document extraction using Claude API with structured output validation and auto-routing.
Claude APIPythonAWS LambdaPostgreSQL
Outcome
Processed 200+ documents/day automatically with 98% accuracy.
Technical Writing & Thought Leadership
In-depth articles on data engineering, cloud architecture, and practical AI.
🐙
Open Source
Active contributor to Dagster, the open-source data orchestration platform. Contributions include documentation improvements, bug fixes, and feature discussions.
View GitHub Profile →🏆
Certifications
☁️
AWS Certified
Solutions Architect — Associate
Amazon Web Services