Hi there 👋

• 🔭 I am Jie Zhang (张 杰).

• In 05/2024, I joined Disney Streaming as a Staff Software Engineer, where I drive team's data strategy, engineering innovations, and product refinement while fostering stakeholder partnerships, cross team collaboration, and talent growth to deliver scalable, high impact, and cost efficient solutions.

• I was a Senior Software Engineer at Roku Big Data Platform team for 4.5 years, where I provided data infrastructure solutions both in large scale real time streaming processing and data lake batch processing.

• Tech Stack: Flink, Spark, Kafka, Presto, Hive, Iceberg, Airflow, Kubernetes, Docker, AWS Stack, Databricks, Superset, Looker.

Real Time Streaming Processing ✅

Designed a Flink & Kubernetes powered real time streaming platform for Roku where users can build Flink applications and run them on Kubernetes clusters seamlessly. Built the biggest Flink app within Roku to ingest device events (25B - 40B hourly) and publish them to Kafka and S3 for streaming and batch use cases respectively. Onboarded external teams and guided them through e-2-e development & testing & tuning & deployment process.

Data Lake Batch Processing ✅

Built and maintained Roku's Hive & Iceberg & Spark & S3 & Airflow based data warehouse. Implemented distributed data processing pipelines to power our petabyte scale data warehouse. Optimized the data warehouse in various aspects such as Presto compatible, partitioning, clustering, columnar formats, schema evolution.