Spark Streaming with PySpark | Structured Streaming Tutorial 2025 - 17 Read and Write from Azure Cosmos DB using Spark | E2E Cosmos DB setup | NoSQL vs SQL Databases

Video covers - How to read and write data from Azure Cosmos DB? What are NO-SQL databases? Why is Azure Cosmos DB so important? How to create a Azure Cosmos DB Account? What are the differences between SQL and NOSQL databases? What are different Write strategies in Azure Cosmos DB? Why are NO-SQL databases so popular? Chapters: 00:00 - Introduction 00:45 - What is NoSQL and SQL Databases and their differences? 01:32 - Azure Cosmos DB Basics 04:08 - How to Create Azure Cosmos DB Account in Azure Portal? 10:00 - Read from Cosmos DB using Spark 13:51 - Write to Cosmos DB using Spark 15:13 - Writing Strategies for Cosmos DB using Spark 17:50 - Using Secrets Securely URLs: Github Code - https://github.com/subhamkharwal/spark-streaming-with-pyspark/blob/master/08_read_and_write_cosmos_db.ipynb Data samples - https://github.com/subhamkharwal/spark-streaming-with-pyspark/blob/master/datasets/devices/late_data_samples.txt To setup Kafka with Spark in Local environment - https://youtu.be/BeZRe0f23hI JSON data Flattening and reading from files - https://youtu.be/wp_2CXyXV0w Keywords: Apache Spark, PySpark, Spark Streaming, Real-time Data Processing, Data Streaming, Big Data Analytics, PySpark Tutorial, Apache Spark Tutorial, Streaming Analytics, Spark Structured Streaming, PySpark Streaming, Big Data Processing, Azure Cosmos DB. New video in every 3 days ❤️ Make sure to like and Subscribe.