- Data engineering podcast reddit If you can do SQL, you can source, manipulate and store data. Lambda - A very cheap way to run short scripts in Python (or other languages), and have them trigger in response to either events you specify or on a schedule, without having to However, I chose Edureka's Data Engineering Masters program because it offers hands-on learning with real-time projects and excellent instructor support. The second job that I turned down was for a senior data analyst position. , Apache Spark, Hadoop, NiFi, Beam, etc). - Career-focused questions belong in r/DataAnalysisCareers - Comments Title: Exploitation Unveiled: How Technology Barons Exploit the Contributions of the Community Introduction: In the rapidly evolving landscape of technology, the contributions of engineers, scientists, and technologists play a pivotal role in driving innovation and progress [1]. Frequency: Twice weekly. In each episode, Jeff Perr Check out our curated and exhaustive list of the top data engineering podcasts for 2025! Podcasts have become an invaluable resource for tech professionals. Engineers apply the knowledge of math & science to design and manufacture maintainable systems used to solve specific problems. It's a very broad field, but when you are being interviewed the questions tend to be really specific. Both of them are general software podcasts, not tied to any specific technology. Keep working on python and SQL. So I think you would get ahead faster adding data tools to your skillset). If I ever want to settle down in a company, I would start looking only This is also why there are so many interviews for these top X companies; 1-2 DS&A interviews to rank candidates, then 3-4 culture fit, SQL, data modeling interviews to test data engineering capabilities. No matter how experienced the candidate is because the interviewer’s questions usually target multiple areas such as compatibility of the interviewee, leadership skills, project management skills, knowledge of technical tools, and so on. Soft Skills Engineering: These guys are great. Courses. (The Purdue University's "Post Graduate Program in Data Engineering" or the Washington University "Data Engineering" online boot camps, for example. To the best of my understanding, a data engineer is basically a programmer that specializes in maintaining data analytics infrastructure (e. The show focuses on the tools and techniques associated with data engineering, as well as the difficulties engineers might face when managing workflow Brady Heywood podcast. We are looking for future Get the Reddit app Scan this QR code to download the app now. As part of this mission, r/podcasts is curated to promote respectful and on-topic discussions. News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, distributed systems, streaming, batch, Big Data, and workflow engines. Somewhat easier to dive deep reading/seeing architecture diagrams than listening to a podcast imo. He has hosted multiple podcasts with Kaggle grandmasters and Fast. The Data Engineering Podcast is good for exploring individual new technologies. If you are a data engineer and would like to know about cloud computing, AWS is the first choice. Some, like Data Skeptic and The TWIML AI Podcast, release new episodes weekly, providing a steady stream of content. true Data Engineering is quite new so I'm not sure if a good guide exists (others please post as I'd like to read them as well). Archive. All you need for basic data engineering is the ability to source data, manipulate data, store data and automate the process. Reddit's original board game, tabletop game, and card game design sub! We are a vast resource for inspiration, design, creation, production, marketing and crowdfunding info for all kinds of hobby game design. I am applying for Senior Data Analyst positions , BI Developer, SQL Developer , very entry level Data Science positions, and now Junior Data Engineer/Data Engineer positions because LinkedIN keeps matching me with them. Check out our top picks! 20 Best Data Engineering Podcasts Get the Reddit app Scan this QR code to download the app now. io, explores the intersection of AI and data engineering. I'd say, my first couple of months on the job, I learned the following services. I've read this book, DDIA, DW Toolkit, Database Internals, and many other technical books related to data engineering. He discusses the evolution of Episode Length: 20-40 minutes Frequency: Weekly Listed as one of the 15 most inspiring podcasts for professionals by Forbes in 2017, The Engineering Career Coach has been helping engineers excel in their careers for more than 250 podcast episodes. This is not a place to promote your podcast. It features more than just engineering disasters, though. I am currently looking for a job in the Data world. SEASON 1 DATA BROSEldad and Boaz Farkash shared the same stuffed toys growing up as well as a big passion for 95 votes, 18 comments. . Action Movies & Series; Animated Movies & Series; News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data Data engineering is a rapidly evolving and ambiguous field. Hi all, looking to transition from automation engineering into data engineering and was hopping to borrow wisdom selecting "the best" data engineering bootcamp. Hey folks, podcasts are great for expanding your knowledge & keeping up with new tech. If you're on a quest for current, reliable knowledge, these podcasts are an excellent addition to your toolkit, offering insights that are both practical and forward-thinking. There's only so much you can enjoy listening to people talk about your software development job and I think I just got oversaturated. The official Python community for Reddit! Stay up to date with the latest news, packages, and Being prepared for a Data Engineer interview with a question type that the interviewee might ask is an excellent way to acing the interview. He is a Kaggle grandmaster and has worked at H2O and Meta. I'd love any recs for podcasts, youtube channels, newsletters, whatever. PS: If you have the time, check old episodes Not A Lot Of Jr Data Engineer Positions - I think I have only seen a few Jr. Data engineering is completely wide and varied in scope and the book tries to define it. The more experienced I become as a data scientist, the more convinced I am that I’m curious to see other responses. In searching for a good software engineering podcast to listen to, I’ve come across many solid suggestions like Software Engineering Daily, Software Engineering Radio, Soft Skills Engineering, Changelog, Stack Overflow Podcast, etc. Minimum. Data WE EXTENDED OUR 20% DISCOUNT FOR THE WHOLE MONTH OF MARCH! Celebrate our new Learn Data Engineering Academy features with us, including beginner and professional areas as well as expert-crafted, step-by-step roadmaps to work through. It won't necessarily make you a better DE, but it allows you to see the bigger picture as they explore their definition of the Data Engineering Lifecycle. more or less is a great In a recent Data Engineering Podcast episode I heard that there are data engineers and architects working on distributed data pipelines processing large amounts of data and a bunch of tools including distributed messaging systems or pub-sub tools like kafka, kinesis and data processing like spark, flink among others to deliver analytics and predictive algorithms. You can learn intriguing and critical parts of software development that you wouldn't learn If you are far from being fluent in python and SQL you will get a hard time finding an entry level data engineer position. Gaming. This both introduces you to DE and to a cloud platform and tools. Some companies want more Product Sense while others want Leadership Principles. Start looking into doing the same data modeling, but with Spark and learning alternate engines like Presto and Balista/Datafusion. Frequency: Twice a week. This Data Science podcast is available on Apple Podcasts and Spotify. Data Engineering Podcast. There was a discussion post this week about expensive tools where Fivetran came up with some comments about Estuary being an option. I don't have much cloud experience, so I'm actually planning to do this one: Data Engineering, Big Data, and Machine Learning on GCP Specialization Get the Reddit app Scan this QR code to download the app now. The principles of software engineering are applied in the field of DE and a backend developer can easily switch to data engineering and vice versa, Now there are some cases where switching fields in software development can be a little bit annoying and difficult, for example an android developer would Podcasts; Streamers; Tarot & Astrology; Movies & TV m in a couple tech slacks and discord and I’ve been asking around and doing keyword searches for entry / beginning data engineering role and just having no luck yet if anyone has suggestions, I’m all ears. Or check it out in the app stores This is all very reassuring lol, im a student and downloaded the data engineering podcast and so much of it seems over my head, Ive tried listening to 4 or 5 episodes and I feel like I only understand half of them. e. - Career-focused questions belong in r/DataAnalysisCareers - Comments should remain civil and We would like to show you a description here but the site won’t allow us. There aren't many certs out there, but the ones that do exist seem to be geared towards cloud services like Google Cloud Keep in mind I was applying for Data Engineering and Senior Data Analyst positions. When I was starting my Data Engineering career, I was given a task to write a shell script. Post graduate in data science might help you to find a data analyst position, but it seems you are more experienced in the development area with compsci masters + IT jobs, that could help you to land a backend role. processing high volumes of data in a short time on a single machine. Or check it out in the app stores News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, distributed systems, streaming, batch, Big Data, and workflow engines News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, distributed systems, streaming, batch, Big Data, and workflow engines. This was an ad-hoc operation to clean up data catalogs and move some part Listen to our story in the Data Engineering Podcast with Tobias Macey: Data Engineering Podcast With The Data Janitor Pipeline Academy on the Data Engineering Podcast Vol. Data Engineer position 6 months ago, which is more Analytics Engineer role. Not a podcast but the “data engineering weekly” is a good technical article digest. Plenty of non-tech interviews though too. IMO there are 2 dimensions to a DE technical skill set: Software Engineering and Architecture. News & discussion on Data Engineering topics, including but not limited to: data pipelines Summary In this episode of the Data Engineering Podcast Sean Knapp, CEO of Ascend. Or check it out in the app stores TOPICS. Or check it out in the app stores Podcasts; Streamers; Tarot & Astrology; Movies & TV. Neither are strictly adhered to in most modern data stacks, but still crucial knowledge Data Analysis - have to know how to translate business questions into code that get's the right results. Dive deep into data management on a weekly basis with the engineers and entrepreneurs who are reshaping the industry. Why don't you check out Edureka's Data Engineering course. Internet Culture (Viral) Amazing The Data Engineering Show Podcast Data engineering conferences: Coalesce Snowflake Summit Databricks Data + AI Summit DataCouncil Meetups and Conferences News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, distributed systems, streaming, batch, Big Data, and workflow engines. 2 Listen to the confessions several data engineers made on Youtube, Spotify, Apple Podcasts, Google Podcasts and even more platforms. You can check the DE interview guides on Prepfully or YouTube/Glassdoor/Blind for more specifics. Episode duration: 40 minutes to an hour. Software Engineering Radio (SER) and Software Eingineering Daily (SED) are my go to podcasts. The Data Engineering Show Podcast Attending data engineering conferences: Coalesce Snowflake Summit Databricks Data + AI Summit Data Engineering Podcast. Valheim; Genshin Impact; Minecraft; Pokimane; Halo Infinite; Data Engineering Podcast ep. But this has been shocking (similar to the way the new Google data engineer has been shocking). adgjl12. Chat. But I look at all these regular data engineer positions and 5 years of experience in data engineering. With the popularity of data technology, tools like Spark, Hive, Hadoop are widely used in big companies; also for such tools and technologies, cloud computing plays an important role. I started a podcast with my friend Dash Desai all about data engineering and machine learning. That IBM Data Engineering course lasts 5 months. I don't know what bootcamp you have in mind but proper bootcamps cost several thousand dollars. I would suggest picking one of the Cloud data engineering specializations on Coursera and doing that. Because it will be the same stuff but different products that you’ll hear/see. If you’re interested in the specialized role of data engineer, this podcast is for you. I interview data engineers for a mid size SaaS in Europe, our data team size is about 20 people. I would recommend that you focus less on trying to get good at any one particular tool and more on understanding what problem the tools are meant to solve. The Weekly Data Engineering Newsletter. ADMIN MOD Relevant Told in the perspective of Sebastian Flak (Data engineer @ C&F). Or check it out in the app stores News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, distributed systems, streaming, batch, Big Data, and workflow engines Get the Reddit app Scan this QR code to download the app now. Overall, it seems like most DE positions require I'm a ML engineer, but I've been a data engineer and data scientist in the past. There is a lot info online and frankly it feels a bit overwhelming to select the top tools that are being used or the "right" skillset, therefore was hoping that a bootcamp will help me News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, distributed systems, streaming, batch, Big Data, and workflow engines. Episode Length: 1-2 hours. I would consider doing the lighter Data Science courses + spending time training models, then learning frameworks to accelerate your work -- stuff like Spark, Pandas, AWS Glue (or whichever cloud aligned suite of tools). ai leaders talking about data engineering and machine learning topics. Once you follow for few months, you can slow down. produced and hosted by Tobias Macey, a DevOps manager at MIT – is an absolute must-listen for anyone who wants to keep up with data engineering trends or dive deeper into the field. It is available on Apple Get the Reddit app Scan this QR code to download the app now. That is relatively cheap. The Here are 15 Best Data Engineering Podcasts worth listening to in 2025. The blogs I listed above and also vendor specific blogs like AWS, Snowflake, Databricks are a good place to start, just keep in mind with the vendor blogs they're trying to sell a product at the end of It's SQL, Algo, Data Modeling and Behavioral. produced and hosted by Tobias Macey, a DevOps manager at MIT – is an absolute must-listen for anyone who wants to keep up with data engineering trends or 16. Action Movies & Series; Animated Movies & Series; News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, distributed systems, streaming, batch, Big Data, and workflow Congratulations, you can now literally handle 90% of data engineering problems. I just had to prep for an AWS interview which ended up going well, but it was a This podcast is one of our favorite ways to stay abreast of industry goings-on and in-depth discussions of new products and developments in data engineering. Probably one of the best engineering related podcasts I've The frequency of updates varies by podcast. ) As near as I can tell, data engineering is kind of a wild west of sorts. Click to read Data Engineering Weekly, by Ananth Packkildurai, a Substack publication with tens of thousands of subscribers. Most of the time it's a human factor, or at least even most technical failures seem to be able to be traced back to a human factor. To stay updated, you can subscribe to your I am currently a software engineering student and I love listening to Progamming Throwdown while I drive to and from campus. News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance I used to listen to many dev podcasts but gradually just lost interest over the years. In those 10 years I have held data engineer, scientist, architect roles in 5 blue chip companies working directly with heads of and C level execs. Data Modeling - be familiar with 3rd normal form and Kimball's dimensional modeling for data warehousing. Everyone is self-taught and there are a ton of free resources. This offer is valid throughout Podcasts; Streamers; Tarot & Astrology; Movies & TV. He’s interviewed many of the greats such as John Carmack. data engineer positions recently. Learn from the biggest influencers in tech about their practical day-to-day data challenges and solutions in a casual and fun setting. My hunch is: for software engineering, YES, learn Java. My previous experience is that of a Data Analyst, mainly in the healthcare realm. Profit from a HUGE 20% DISCOUNT for the 12 months and unlimited Academy access!. SER is more academic and more 'computer sciency', and SED is a more general trendy. The Data Engineering Podcast. I think it caters to existing Data Engineers, Data Architects and Managers. Thanks to these two I have learned a ton. r/podcasts: a subreddit to discover, discuss, and review podcasts with other podcast enthusiasts. If you can use shell scripting and cron, you can automate. So, the total is $250. 75% of candidates might pass the bar for data engineering capabilities, but now they have a pool of 500 candidates that must be further The problem with ML Engineer interviews is the they could be testing any or all of the fields software engineering, dev ops, ml ops, data science, data engineering. Their courses are really helpful for leveling up my skills and landing a solid data engineering job . In the ever-evolving realm of data science, staying informed and inspired is paramount. The podcast explores how some of the brightest minds in the field take a hands-on approach to solving business problems with machine learning or developing products for data scientists and engineers. DEWCon. Conclusion. News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, 120K subscribers in the dataengineering community. I was offered and accepted a Sr. They offer a mix of expert advice, industry insights, and In this article, we highlight eight of the best data science podcasts that can help new and experienced practitioners in their day-to-day roles and also in their career paths. EC2 - A virtual server where you can run code. Edit: unless you meant more about DSA, in which case if you do more than that then you should apply for SWE because you will never use more Yeah, I listen to a lot of podcasts, but find software to be a tough subject in the space. Data engineering podcasts provide context, expertise, and advice on real-world applications. Others, such as Gradient Dissent and Harvard Data Science Review Podcast, might update less frequently but still offer high-quality episodes. g. Most of the work is debugging/developing data pipelines and evolving the architecture. It's written by a data scientist at AirBnb. I think in general people make it seem more complicated than it needs to be (to start). Get the Reddit app Scan this QR code to download the app now. I found this article on Medium that lists some good podcasts that EMs and developers can listen to. Like I mentioned learn DB and Snowflake or if you want to get your hands on Microsoft services so learn Azure Data Services or learn Fabric (a lot Azure features will be there in it and you can learn Data Modelling, Real time data processing as well, you can prepare for Fabric Data Engineer certification if getting certified is the goal as Get the Reddit app Scan this QR code to download the app now News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, distributed systems, streaming, batch, Big Data, and workflow engines. About. For Data engineering, every system these days offer both, client libraries for python and for Java (and HTTP APIs are agnostic). A reddit dedicated 50 votes, 11 comments. Listen to the high-level episodes of the Data Engineering Podcast. Compared to most other languages (haven't tried Rust yet, but have tried Go as well as Java and more traditional languages), for performance-critical processing Yes, a data engineer is mainly a specialized software developer/engineer. I ended up getting the engineering one and honestly I thought it would be the other way around because I have more experience as an analyst. While it is definitely a newer tool/service, there are a few features which look very interesting: realtime syncs, inline transforms for EtLT (t = estuary, T = dbt) both stateful and non-stateful, cost savings, materializing the same enriched data to The Data Stack Show: A Podcast on Data Engineering Blog Hey everyone, I'm one of the hosts of a podcast show, called the data stack show. I've used C++ in data engineering to write data processing steps that needed to be as performant as possible, i. He’s a MIT AI guy himself. He's a forensic engineer that goes into different types of disasters such as bridge collapses, and what caused them to fail. 1. #151 with The Data Janitor Tobias Macey, the Joe Rogan of the data engineering scene interviewed my partner, Daniel in his Subscribe the DE newsletter, podcasts Reddit and twitter has too many noise. This show goes behind the News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, The Data Engineering Podcast. The podcast has been around for 10 years and has two guys with a lot of industry experience that chat about various tech things with a Here are some thoughts from a fellow DE who started as a Geophysicist, switched to a Data Analyst role, and ultimately landed in Data Engineering. My first DE job I got 2 years ago wanted 2+ years of experience in SSIS, Azure, and SQL. Here are my “go-to”s for SW: Lex Fridman: Select podcasts anyways. You probably don't even need all of these to start: S3 - Where you store data. AskEngineers is a forum for questions about the technologies, standards, and processes used to design & build these systems, as well as for questions about the engineering profession and its many disciplines. Podcast with Australian psychologist, Matthew Browne, and anthropologist, Chris Kavanagh Background: I am coming with an MS degree in Analytics and 2+ YOE as a data analyst. I had literally none of that. Podcast. More importantly however, the behavior of reddit leadership in implementing these changes has I keep up to date by listening to podcasts and reading blogs. Reply reply Top 1% It's a podcast about engineering disasters (with slides). Demand and Competition: The high number of applicants per position is a News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, distributed systems, streaming, batch, Big Data, and workflow engines. These 10 data science podcasts cater to a diverse Nope, after 10 years in consultancy. WTYP covers engineering concepts, urban planning, transportation issues, and ties all the things that go wrong with an engineering or construction project into wider society in general and the failings of capitalism specifically. Subscribe in one place on FeedSpot Reader. A Beginner’s Guide to Data Engineering — Part I has been making the rounds in the data science blogosphere lately. The Data Engineering Show is a podcast for data engineering and BI practitioners to go beyond theory. I have about 12 years of experience. It's a comprehensive look at data engineering subjects. zjw rxif jvrgfr rgr exfa xdqn jjgpgfk mcr uffvho eujn wlpku giof slea xrjn bzir