https://bsky.app/profile/codingjhames.bsky.socialhttps://bsky.app/profile/codingjhames.bsky.social/post/3miovko537c2zFinal Peer Reviews for #DEZoomcamp complete! ✅ Just evaluated a complex SkyPulse Streaming Pipeline. Impressed by the real-time flight data visualization and the use of Apache Flink + Redpanda. Reviewing expert architectures like this is a game-changer for my engineering criteria.04 Apr 2026 18:48 +0000at://did:plc:lxft523rfqlsj4bb2gzuo732/app.bsky.feed.post/3miovko537c2zhttps://bsky.app/profile/codingjhames.bsky.social/post/3mi2z6kbhfc2qFinal Project for the Data Engineering Zoomcamp complete! 🚀 Built an end-to-end pipeline to audit Colombian public procurement (SECOP II) bridging Law and Tech. Used AWS (S3, Glue, Athena), dbt for transformations, and Looker Studio. Check my repo & dashboard: https://github.com/CodingJhames/secop-ii-data-pipeline-aws27 Mar 2026 21:00 +0000at://did:plc:lxft523rfqlsj4bb2gzuo732/app.bsky.feed.post/3mi2z6kbhfc2qhttps://bsky.app/profile/codingjhames.bsky.social/post/3mhydcqwwlc2vThe Data Warehouse is officially online! 🌩️ Mapped 100k raw SECOP II records in S3 using AWS Glue and queried them with Athena. The best part? Connecting my local James-T-850 via #dbt to run the first staging models directly in the cloud. 🚀 https://github.com/CodingJhames/secop-ii-data-pipeline-aws #DataEngineering #AWS #dbt26 Mar 2026 19:23 +0000at://did:plc:lxft523rfqlsj4bb2gzuo732/app.bsky.feed.post/3mhydcqwwlc2vhttps://bsky.app/profile/codingjhames.bsky.social/post/3mhvucgaml227Data Ingestion milestone reached! 🏗️ Successfully deployed #AWS S3 with #Terraform and ingested 100k records from the SECOP II API using Python on my James-T-850. Everything is now stored as Parquet. Repo: https://github.com/CodingJhames/secop-ii-data-pipeline-aws #DataEngineering #Python #Cloud #DEZoomcamp25 Mar 2026 19:49 +0000at://did:plc:lxft523rfqlsj4bb2gzuo732/app.bsky.feed.post/3mhvucgaml227https://bsky.app/profile/codingjhames.bsky.social/post/3mgxexcw7h227Week 7 #DataEngineering Zoomcamp 🏎️ Streamed 4.4M records via #Redpanda & #PySpark on my James-T-850. Speed is nothing without logic! Results: 📍 📏 Dist: 9506 🏙️ Zone: 74 ⏳ Session: 31m 💰 Peak Tip: 10-16 18:00 Progress: https://github.com/CodingJhames/de-zoomcamp-james #Streaming #Python #BigData #DataTalksClub13 Mar 2026 16:54 +0000at://did:plc:lxft523rfqlsj4bb2gzuo732/app.bsky.feed.post/3mgxexcw7h227https://bsky.app/profile/codingjhames.bsky.social/post/3mgcvwvopg22rWeek 6 Spark Module of #DataEngineeringZoomcamp completed! 🛠️ Bridging legal logic with large-scale batch processing. 🔹 PySpark & DataFrames 🔹 Parquet optimization 🔹 AWS EC2 deployment 🔹 Spark UI monitoring (4040) Solution: https://github.com/CodingJhames/de-zoomcamp-james Course: https://github.com/DataTalksClub/data-engineering-zoomcamp/05 Mar 2026 13:33 +0000at://did:plc:lxft523rfqlsj4bb2gzuo732/app.bsky.feed.post/3mgcvwvopg22rhttps://bsky.app/profile/codingjhames.bsky.social/post/3mfmx5dq4ws2l#DEZoomcamp W6: dlt & DuckDB! 🏁 Schema drift: API changed tip_amount to tip_amt. ⚠️ DuckDB's error logs pointed out the fix instantly. Running #dlt on an AWS t3.micro (1GB RAM). 0.2666 Credit prop | 6063.41 Tips. Repo: github.com/CodingJhames/de-zoomcamp-james #DataEngineering #AWS #BuildInPublic24 Feb 2026 19:55 +0000at://did:plc:lxft523rfqlsj4bb2gzuo732/app.bsky.feed.post/3mfmx5dq4ws2lhttps://bsky.app/profile/codingjhames.bsky.social/post/3mf5743ywjc27Data Engineering Week 5: Done! 🏁 Pivoted to #AWS from GCP. ☁️ Ran #PySpark on a t3.micro (1GB RAM) using a 4GB Swapfile. Processed NYC Taxi data smoothly without crashes. 🧠 Adaptability > Tools. 🦾 Code: https://github.com/CodingJhames/de-zoomcamp-james #DataEngineering #Spark #AWS #OpenSource18 Feb 2026 13:35 +0000at://did:plc:lxft523rfqlsj4bb2gzuo732/app.bsky.feed.post/3mf5743ywjc27https://bsky.app/profile/codingjhames.bsky.social/post/3metvy7qk4c2gWeek 4 Analytics Engineering: Complete! 👨‍💻 Mastered dbt with NYC Taxi data in AWS Athena. Overcoming those Parquet type mismatches was the final boss! 🚀 Project link: https://github.com/CodingJhames/de-zoomcamp-james/tree/04-analytics-engineering #DataEngineering #dbt #BuildInPublic14 Feb 2026 20:58 +0000at://did:plc:lxft523rfqlsj4bb2gzuo732/app.bsky.feed.post/3metvy7qk4c2ghttps://bsky.app/profile/codingjhames.bsky.social/post/3me7k6j5tes2nWeek 3 #DataZoomcamp done! 🚀 Migrated the DW logic to AWS Athena & S3 ☁️ 🔹 20M+ records with #Kestra 🔹 Optimized queries: 310MB → 26MB scan using Partitioning & Clustering 🔹 Mastered cloud-agnostic DW concepts Check my repo: 🔗 https://github.com/CodingJhames/de-zoomcamp-james #DataEngineering #AWS #Athena06 Feb 2026 18:34 +0000at://did:plc:lxft523rfqlsj4bb2gzuo732/app.bsky.feed.post/3me7k6j5tes2n