Data Science on the Google Cloud Platform: Implementing End-to-End Real-Time Data Pipelines: From Ingest to Machine Learning

Data Science on the Google Cloud Platform: Implementing End-to-End Real-Time Data Pipelines: From Ingest to Machine Learning image

Overview
Review
Comments
Download PDF

From the Preface In this book, we walk through an example of this new transformative, more collaborative way of doing data science. You will learn how to implement an end-to-end data pipeline-we will begin with ingesting the data in a serverless way and work our way through data exploration, dashboards, relational databases, and streaming data all the way to training and making operational a machine learning model. I cover all these aspects of data-based services because data engineers will be involved in designing the services, developing the statistical and machine learning models and implementing them in large-scale production and in real time. Who This Book Is For If you use computers to work with data, this book is for you. You might go by the title of data analyst, database administrator, data engineer, data scientist, or systems programmer today. Although your role might be narrower today (perhaps you do only data analysis, or only model building, or only DevOps), you want to stretch your wings a bit-you want to learn how to create data science models as well as how to implement them at scale in production systems. Google Cloud Platform is designed to make you forget about infrastructure. The marquee data services-Google BigQuery, Cloud Dataflow, Cloud Pub/Sub, and Cloud ML Engine-are all serverless and autoscaling. When you submit a query to BigQuery, it is run on thousands of nodes, and you get your result back; you dont spin up a cluster or install any software. Similarly, in Cloud Dataflow, when you submit a data pipeline, and in Cloud Machine Learning Engine, when you submit a machine learning job, you can process data at scale and train models at scale without worrying about cluster management or failure recovery. Cloud Pub/Sub is a global messaging service that autoscales to the throughput and number of subscribers and publishers without any work on your part. Even when youre running open source software like Apache Spark thats designed to operate on a cluster, Google Cloud Platform makes it easy. Leave your data on Google Cloud Storage, not in HDFS, and spin up a job-specific cluster to run the Spark job. After the job completes, you can safely delete the cluster. Because of this job-specific infrastructure, theres no need to fear overprovisioning hardware or running out of capacity to run a job when you need it. Plus, data is encrypted, both at rest and in transit, and kept secure. As a data scientist, not having to manage infrastructure is incredibly liberating. The reason that you can afford to forget about virtual machines and clusters when running on Google Cloud Platform comes down to networking. The network bisection bandwidth within a Google Cloud Platform datacenter is 1 PBps, and so sustained reads off Cloud Storage are extremely fast. What this means is that you dont need to shard your data as you would with traditional MapReduce jobs. Instead, Google Cloud Platform can autoscale your compute jobs by shuffling the data onto new compute nodes as needed. Hence, youre liberated from cluster management when doing data science on Google Cloud Platform. These autoscaled, fully managed services make it easier to implement data science models at scale-which is why data scientists no longer need to hand off their models to data engineers. Instead, they can write a data science workload, submit it to the cloud, and have that workload executed automatically in an autoscaled manner. At the same time, data science packages are becoming simpler and simpler. So, it has become extremely easy for an engineer to slurp in data and use a canned model to get an initial (and often very good) model up and running. With well-designed packages and easy-to-consume APIs, you dont need to know the esoteric details of data science algorithms-only what each algorithm does, and how to link algorithms together to solve realistic problems. This convergence between data science and data engineering is why you can stretch your wings beyond your current role. Rather than simply read this book cover-to-cover, I strongly encourage you to follow along with me by also trying out the code. The full source code for the end-to-end pipeline I build in this book is on GitHub. Create a Google Cloud Platform project and after reading each chapter, try to repeat what I did by referring to the code and to the Readme file in each folder of the GitHub repository. Read more

Details e-book Data Science on the Google Cloud Platform

🗸 Author(s):
🗸 Title: Data Science on the Google Cloud Platform: Implementing End-to-End Real-Time Data Pipelines: From Ingest to Machine Learning
🗸 Rating : 4.2 from 5 stars (72 reviews)
🗸 Languange: English
🗸 Format ebook: PDF, EPUB, Kindle, Audio, HTML and MOBI
🗸 Supported Devices: Android, iOS, PC and Amazon Kindle


Readers' opinions about Data Science on the Google Cloud Platform by Valliappa Lakshmanan

Adisson Wright
Embark on a thrilling adventure with this gripping mystery novel that keeps readers guessing until the very end. Set in a picturesque village plagued by secrets and lies, the story follows a determined detective as he unravels the truth behind a series of baffling crimes. With its clever plot twists and compelling characters, this book is a must-read for fans of the genre.
/
Bluebell Whittaker
Explore the wonders of the natural world with this captivating exploration of wildlife and ecosystems. From the depths of the ocean to the heights of the mountains, the author takes readers on a journey through some of the planet's most extraordinary habitats. With its stunning photography and fascinating insights, this book is a feast for the eyes and the mind.
/
Ethelda Dixon
Delve into the pages of this captivating novel, where the lines between reality and fantasy blur in a mesmerizing tale of magic and adventure. Set in a world where anything is possible, the story follows a group of unlikely heroes as they embark on a quest to save their kingdom from darkness. With its richly imagined world and engaging characters, this book is sure to enchant readers of all ages.
/

Plant Your Money Tree: A Guide to Growing Your Wealth Reformations: The Early Modern World, 1450-1650 Eve Isn’t Evil 40 Verses to Ignite Your Faith: Surprising Insights from Unexpected Passages Street Data: A Next-Generation Model for Equity, Pedagogy, and School Transformation 61 Minutes to a Miracle: Fulton Sheen and a True Story of the Impossible The Complete Guide to Drones: Whatever your budget – Build + Choose + Fly + Photograph True Love Reading Cards: Attract and Create the Love You Desire (Reading Card Series) The Magic of Believing: The Classic Guide to Unlocking the Power of Your Mind Cecil Essentials of Medicine (Cecil Medicine)


Preparing the link for download... Please wait in 30 seconds
DOWNLOAD FILE

Leave a Reply

Your email address will not be published. Required fields are marked *