PySpark Foundations: Process, analyze, and summarize data
Did you know that a billion records are processed daily in PySpark by companies worldwide? As big data is on the rise, you’ll need tools like PySpark to process massive amounts of data. This guided project was designed to introduce data analysts and data science beginners to data analysis in PySpark. By the end of this 2-hour-long guided project, you’ll create a Jupyter Notebook that processes, analyzes, and summarizes data using PySpark. Specifically, you will set up a PySpark environment, explore and clean large data, aggregate and summarize data, and visualize data using real-life examples
Skills you'll learn
We may earn a commission if you enroll through our links — it never affects the price you pay.
Similar courses
Launch & Optimize Email Series
Ready to transform scattered email sends into powerful, strategic sequences that build relationships and drive results? This Short Course was created to help Marketing professionals accomplish building and optimizing high-performing email series that outperform single-email campaigns. By completing this course, you'll be able to create cohesive multi-email campaigns with personalized content, implement A/B testing strategies, and use data analytics to continuously improve your email series performance. By the end of this course, you will be able to: Build and launch a 3-part email series us
All levels
Precalculus: Relations and Functions
This course helps to build the foundational material to use mathematics as a tool to model, understand, and interpret the world around us. This is done through studying functions, their properties, and applications to data analysis. Concepts of precalculus provide the set of tools for the beginning student to begin their scientific career, preparing them for future science and calculus courses. This course is designed for all students, not just those interested in further mathematics courses. Students interested in the natural sciences, computer sciences, psychology, sociology, or similar w
All levels
Observational Methods and Qualitative Data Analysis
This is primarily aimed at first- and second-year undergraduates interested in psychology, data analysis, and qualtitative research methods along with high school students and professionals with similar interests. This course delves into the qualitative research traditions of ethnographic inquiry and case study in psychology, emphasizing the use of participant observation. Students will explore the unique practices, data gathering and analysis methods, and researcher involvement in these traditions. This course explores the interviewing methods used in qualitative research in psychology. The
All levels
Introduction to Data Analytics
Ready to start a career in Data Analysis but don’t know where to begin? This course presents you with a gentle introduction to Data Analysis, the role of a Data Analyst, and the tools used in this job. You will learn about the skills and responsibilities of a data analyst and hear from several data experts sharing their tips & advice to start a career. This course will help you to differentiate between the roles of Data Analysts, Data Scientists, and Data Engineers. You will familiarize yourself with the data ecosystem, alongside Databases, Data Warehouses, Data Marts, Data Lakes and Data Pi
All levels