Hands-On Data Science with the Command Line

Book excerpt: Big data processing and analytics at speed and scale using command line tools. Key FeaturesPerform string processing, numerical computations, and more using CLI toolsUnderstand the essential components of data science development workflowAutomate data pipeline scripts and visualization with the command lineBook Description The Command Line has been in existence on UNIX-based OSes in the form of Bash shell for over 3 decades. However, very little is known to developers as to how command-line tools can be OSEMN (pronounced as awesome and standing for Obtaining, Scrubbing, Exploring, Modeling, and iNterpreting data) for carrying out simple-to-advanced data science tasks at speed. This book will start with the requisite concepts and installation steps for carrying out data science tasks using the command line. You will learn to create a data pipeline to solve the problem of working with small-to medium-sized files on a single machine. You will understand the power of the command line, learn how to edit files using a text-based and an. You will not only learn how to automate jobs and scripts, but also learn how to visualize data using the command line. By the end of this book, you will learn how to speed up the process and perform automated tasks using command-line tools. What you will learnUnderstand how to set up the command line for data scienceUse AWK programming language commands to search quickly in large datasets.Work with files and APIs using the command lineShare and collect data with CLI toolsPerform visualization with commands and functionsUncover machine-level programming practices with a modern approach to data scienceWho this book is for This book is for data scientists and data analysts with little to no knowledge of the command line but has an understanding of data science. Perform everyday data science tasks using the power of command line tools.