Use the UNIX shell to wrangle log data

Module
9 Units

Beginner

Student

Data Scientist

Data Engineer

Developer

Azure

Learn how to use the UNIX shell to wrangle data and inspect data files.

Learning objectives

In this module, you'll learn how to:

Do basic file inspection with commands such as head, tail, wc, less, and sort.
Use the cat command to create, append, display, and concatenate files.
Write and use regex (regular expressions) for text pattern matching.
Use the grep command to search files, or stdin content for pattern matching along with regex.
Do basic text transformations on input streams by using sed and regex.
Use pipes and filters for data wrangling.

Prerequisites

Basic knowledge of the command line and basic shell commands

Get started with Azure

Choose the Azure account that's right for you. Pay as you go or try Azure free for up to 30 days. Sign up.

Introduction min
Perform file inspection in the UNIX shell min
Basic file manipulation with the cat command min
Introduction to regular expressions min
Use the grep command to match regular expressions min
Introduction to the stream editor min
Use pipes and filters to put it all together min
Module assessment min
Summary min