27 Read and Write from Azure Cosmos DB using Spark | E2E Cosmos DB setup | NoSQL vs SQL Databases

PySpark - Zero to Hero | PySpark Tutorial 2025 | Spark Tutorial 2025 | Learn from Basics to Advanced Performance Optimization - 27 Read and Write from Azure Cosmos DB using Spark | E2E Cosmos DB setup | NoSQL vs SQL Databases

4.0 (1)

18 learners

What you'll learn

This course includes

9 hours of video
Certificate of completion
Access on mobile and TV

Summary

Keywords

spark interview questions apache spark tutorial beginners apache spark python apache spark full course how does apache spark work apache spark performance optimization techniques optimize pyspark Spark catalyst optimizer tungsten Catalyst optimizer interview questions Wide transformations spark examples Repartition coalesce pyspark Predicate pushdown spark example

Full Transcript

Video explains - How to read and write data from Azure Cosmos DB? What are NO-SQL databases? Why is Azure Cosmos DB so important? How to create a Azure Cosmos DB Account? What are the differences between SQL and NOSQL databases? What are different Write strategies in Azure Cosmos DB? Why are NO-SQL databases so popular? Chapters: 00:00 - Introduction 00:45 - What is NoSQL and SQL Databases and their differences? 01:32 - Azure Cosmos DB Basics 04:08 - How to Create Azure Cosmos DB Account in Azure Portal? 10:00 - Read from Cosmos DB using Spark 13:51 - Write to Cosmos DB using Spark 15:13 - Writing Strategies for Cosmos DB using Spark 17:50 - Using Secrets Securely Local PySpark Jupyter Lab setup - https://youtu.be/WhxljT3IfdM Python Basics - https://www.learnpython.org/ GitHub URL for code - https://github.com/subhamkharwal/spark-streaming-with-pyspark/blob/master/08_read_and_write_cosmos_db.ipynb The series provides a step-by-step guide to learning PySpark, a popular open-source distributed computing framework that is used for big data processing. New video in every 3 days ❤️ #spark #pyspark #python #dataengineering