Learn the latest data science updates in the tech world.
Data Science Tech Brief By HackerNoon
Claim This Podcastby HackerNoon
222 episodes
Updated Weekly
Accepts GuestsHas Sponsors
Podcast Overview
Learn the latest data science updates in the tech world.
Language
🇺🇲
Publishing Since
5/10/2023
1 verified contact email on file for Data Science Tech Brief By HackerNoon
Pitch yourself as a guest, propose sponsorships, or reach out directly to the host.
Recent Episodes
July 4, 2026
I Tried Every Way to Scrape Amazon in 2026. Here is What Actually Works
<p>This story was originally published on HackerNoon at: <a href="https://hackernoon.com/i-tried-every-way-to-scrape-amazon-in-2026-here-is-what-actually-works">https://hackernoon.com/i-tried-every-way-to-scrape-amazon-in-2026-here-is-what-actually-works</a>. <br> I tested every way to scrape Amazon in 2026 — plain requests, Selenium, Playwright, free proxies, paid proxies. <br> Check more stories related to data-science at: <a href="https://hackernoon.com/c/data-science">https://hackernoon.com/c/data-science</a>. You can also check exclusive content about <a href="https://hackernoon.com/tagged/web-scraping">#web-scraping</a>, <a href="https://hackernoon.com/tagged/amazon-webscraping-guide">#amazon-webscraping-guide</a>, <a href="https://hackernoon.com/tagged/data-scraping">#data-scraping</a>, <a href="https://hackernoon.com/tagged/ai-web-scraping">#ai-web-scraping</a>, <a href="https://hackernoon.com/tagged/scrape-amazon">#scrape-amazon</a>, <a href="https://hackernoon.com/tagged/scrape-amazon-in-2026">#scrape-amazon-in-2026</a>, <a href="https://hackernoon.com/tagged/plain-requests">#plain-requests</a>, <a href="https://hackernoon.com/tagged/beautifulsoup">#beautifulsoup</a>, and more. <br> <br> This story was written by: <a href="https://hackernoon.com/u/olawanlejoel">@olawanlejoel</a>. Learn more about this writer by checking <a href="https://hackernoon.com/about/olawanlejoel">@olawanlejoel's</a> about page, and for more stories, please visit <a href="https://hackernoon.com">hackernoon.com</a>. <br> <br> Plain requests get blocked immediately. Free proxies are useless. Selenium and Playwright solve JavaScript rendering but are detectable as headless browsers. Residential proxies with BeautifulSoup finally work, but you trade the blocking problem for selector maintenance — and Amazon changes its DOM without warning. A managed scraping API that handles proxies, CAPTCHA, and AI-based extraction is the only approach that solves all three problems at once. </p>
June 25, 2026
How We Built a Per-Plant CO2 Dataset for 4,551 Power Stations Worldwide
<p>This story was originally published on HackerNoon at: <a href="https://hackernoon.com/how-we-built-a-per-plant-co2-dataset-for-4551-power-stations-worldwide">https://hackernoon.com/how-we-built-a-per-plant-co2-dataset-for-4551-power-stations-worldwide</a>. <br> An open dataset of 4,551 power stations: measured + modelled CO2, fuel, owner, capacity and climate zone. How we built it in Python, and the honest limits. <br> Check more stories related to data-science at: <a href="https://hackernoon.com/c/data-science">https://hackernoon.com/c/data-science</a>. You can also check exclusive content about <a href="https://hackernoon.com/tagged/data-engineering">#data-engineering</a>, <a href="https://hackernoon.com/tagged/python">#python</a>, <a href="https://hackernoon.com/tagged/global-energy-monitor">#global-energy-monitor</a>, <a href="https://hackernoon.com/tagged/greenhouse-gas-data">#greenhouse-gas-data</a>, <a href="https://hackernoon.com/tagged/carbon-accounting">#carbon-accounting</a>, <a href="https://hackernoon.com/tagged/climate-analytics">#climate-analytics</a>, <a href="https://hackernoon.com/tagged/energy-infrastructure">#energy-infrastructure</a>, <a href="https://hackernoon.com/tagged/python-etl">#python-etl</a>, and more. <br> <br> This story was written by: <a href="https://hackernoon.com/u/dmytroah">@dmytroah</a>. Learn more about this writer by checking <a href="https://hackernoon.com/about/dmytroah">@dmytroah's</a> about page, and for more stories, please visit <a href="https://hackernoon.com">hackernoon.com</a>. <br> <br> The authors built and openly published a dataset covering 4,551 power stations worldwide, combining emissions, ownership, capacity, fuel type, and climate-zone data into a single schema. The project's central finding is that only about 15% of plant-level emissions data comes from direct measurements, while the remaining 85% relies on modelled estimates, making provenance and transparency critical for anyone working with emissions datasets. </p>
June 25, 2026
Eliminating Data Latency with Event-Driven Pipelines at Enterprise Scale
<p>This story was originally published on HackerNoon at: <a href="https://hackernoon.com/eliminating-data-latency-with-event-driven-pipelines-at-enterprise-scale">https://hackernoon.com/eliminating-data-latency-with-event-driven-pipelines-at-enterprise-scale</a>. <br> How event-driven data pipelines reduce latency, automate schema changes, and improve reliability across large-scale data platforms. <br> Check more stories related to data-science at: <a href="https://hackernoon.com/c/data-science">https://hackernoon.com/c/data-science</a>. You can also check exclusive content about <a href="https://hackernoon.com/tagged/data-engineering">#data-engineering</a>, <a href="https://hackernoon.com/tagged/event-driven-architecture">#event-driven-architecture</a>, <a href="https://hackernoon.com/tagged/aws-glue">#aws-glue</a>, <a href="https://hackernoon.com/tagged/schema-evolution">#schema-evolution</a>, <a href="https://hackernoon.com/tagged/cloud-infrastructure">#cloud-infrastructure</a>, <a href="https://hackernoon.com/tagged/aws-step-functions">#aws-step-functions</a>, <a href="https://hackernoon.com/tagged/incremental-data-processing">#incremental-data-processing</a>, <a href="https://hackernoon.com/tagged/hackernoon-top-story">#hackernoon-top-story</a>, and more. <br> <br> This story was written by: <a href="https://hackernoon.com/u/rohitnagpal92">@rohitnagpal92</a>. Learn more about this writer by checking <a href="https://hackernoon.com/about/rohitnagpal92">@rohitnagpal92's</a> about page, and for more stories, please visit <a href="https://hackernoon.com">hackernoon.com</a>. <br> <br> Traditional batch-first data pipelines introduce artificial delays in data availability, forcing enterprise decisions to be made on stale information. This article introduces three production-proven event-driven architecture patterns: incremental processing of cloud data at petabyte scale, dynamic schema evolution with AStep Functions orchestration, and automated data quality reconciliation. These patterns eliminate data latency, cut infrastructure costs by as much as 85%, and enable real-time data availability for downstream analytics. </p>
222 total episodes available
Recent guests on Data Science Tech Brief By HackerNoon
Guests from recent episodes — sign up to see every guest that has ever appeared on this show.
Anup Moncy
Guest
Dharmateja
Guest
fromight
Guest
Devin Partida
Guest
hacker95231466
Guest
Melissa India
Guest
Eltsefon
Guest
Deep-dive analytics for Data Science Tech Brief By HackerNoon
Frequently asked questions
Have a different question and can't find the answer you're looking for? Reach out to our support team by sending us an email and we'll get back to you as soon as we can.
- What is Data Science Tech Brief By HackerNoon?
- How often does this podcast release new episodes?
This podcast updates weekly.
- Where can I listen to this podcast?
This podcast is available on 9 platforms including Apple Podcasts, Spotify, and more. You can also use the RSS feed directly.
- Does this podcast accept guests?
Yes, this podcast regularly features guests.
Legal Disclaimer
Pod Engine is not affiliated with, endorsed by, or officially connected with any of the podcasts displayed on this platform. We operate independently as a podcast discovery and analytics service.
All podcast artwork, thumbnails, and content displayed on this page are the property of their respective owners and are protected by applicable copyright laws. This includes, but is not limited to, podcast cover art, episode artwork, show descriptions, episode titles, transcripts, audio snippets, and any other content originating from the podcast creators or their licensors.
We display this content under fair use principles and/or implied license for the purpose of podcast discovery, information, and commentary. We make no claim of ownership over any podcast content, artwork, or related materials shown on this platform. All trademarks, service marks, and trade names are the property of their respective owners.
While we strive to ensure all content usage is properly authorized, if you are a rights holder and believe your content is being used inappropriately or without proper authorization, please contact us immediately at hey@podengine.ai for prompt review and appropriate action, which may include content removal or proper attribution.
By accessing and using this platform, you acknowledge and agree to respect all applicable copyright laws and intellectual property rights of content owners. Any unauthorized reproduction, distribution, or commercial use of the content displayed on this platform is strictly prohibited.