Before you can work with data you have to get some. This course will cover the basic ways that data can be obtained. The course will cover obtaining data from the web, from APIs, from databases, and from colleagues in various formats. It will also cover the basics of data cleaning and how to make data “tidy”.
Tidy data dramatically speed downstream data analysis tasks. The course will also cover the components of a complete data set including raw data, processing instructions, codebooks, and processed data. The course will cover the basics needed for collecting, cleaning, and sharing data.
WHAT YOU WILL LEARN
- Understand common data storage systems
- Apply data cleaning basics to make data “tidy”
- Use R for text and data manipulation
- Obtain usable data from the web, APIs, and databases
In this first week of the course, we look at finding data and reading different file types.
This week the primary goal is to introduce you to the most common data storage systems and the appropriate tools to extract data from the web or from databases like MySQL.
This week the lectures will focus on organizing, merging, and managing the data you have collected using the lectures from Weeks 1 and 2.
This week we finish up with lectures on text and date manipulation in R. In this final week we will also focus on peer grading of Course Projects.
- Jeff Leek
- Roger D. Peng
- Brian Caffo