DAY TWO – Why Spark? – Learn Spark in Microsoft Fabric in September (2 of 30)
DAY TWO – Why Spark? – Learn Spark in Microsoft Fabric in September (2 of 30)
#DAY #Spark #Learn #Spark #Microsoft #Fabric #September
رابط تحميل الفيديو كامل HD .. <اضغط هنا>
كيف DAY TWO – Why Spark? – Learn Spark in Microsoft Fabric in September (2 of 30)
Learn Apache Spark in Microsoft Fabric in the 30 days of September.
Here’s the playlist for this series if you want to catchup: https://www.youtube.com/playlist?list=PLug2zSFKZmV1z1zUCs0iUEHgtmHJIwFiQ
Link to the GitHub for this series: https://github.com/LearnMicrosoftFabric/YouTube/tree/main/learn_spark_in_fabric
Spark is the engine behind both the Data Engineering AND the Data Science experience in Microsoft Fabric, so in September I’ll be walking you through Apache Spark: what it is, why you should learn it, how to use it, and how it integrates into Microsoft Fabric.
No previous Spark knowledge is required, some basic Python would be useful!
#pyspark #microsoftfabric #apachespark
Here’s the schedule:
1 Welcome – https://youtu.be/v5pJLJg9j6c
2 Why Spark? THIS VIDEO
3 Components of Spark – https://youtu.be/p3Ss_P6AyG0
4 Spark DataFrame – https://youtu.be/51EMJfnx47Q
5 Read Files into DataFrame – https://youtu.be/ja5MFgpdTAw
6 Read/Write to Lakehouse Table – https://youtu.be/bou77s-9b7c
7 Basic DataFrame Operations
8 DataFrame Filtering
9 GroupBy and Aggregate Functions
10 Handling missing values
11 Joining and merging DataFrames
12 Time-series
13 Spark SQL
14 MLlib Feature Engineering
15 MLlib Machine learning models
16 MLlib Model evaluation
17 Microsoft Fabric Runtime powered by Apache Spark
18 Spark Compute
19 Custom Spark pools
20 Spark Job Definitions
21 Managing Spark capacities
22 Library Management
23 Spark Scala
24 Spark R
25 Concurrency
26 Autotuning Spark
27 Fabric MSSparkUtils
28 Monitoring Spark
29 Answering your questions, FAQs
30 Continuing your Spark learning journey
Timeline
0:00 In this tutorial
1:16 Your comments
1:40 SparkSeptember playlist
2:05 GitHub link
2:45 Why does Spark exist?
3:13 How Spark (in Fabric) works under the hood
6:23 Why have Microsoft built Fabric around Spark?
7:26 When should we use Spark/ Fabric Notebooks?
9:51 Summary
–BROWSE MY OTHER FABRIC PLAYLISTS–
DATA ENGINEERING https://www.youtube.com/playlist?list=PLug2zSFKZmV1NvKfnRzG9e3Fl-8QLD5MK
END-TO-END FABRIC PROJECT https://www.youtube.com/playlist?list=PLug2zSFKZmV1BHk129X_2xi53ZRwQaTkb
INTRO TO MICROSOFT FABRIC https://www.youtube.com/playlist?list=PLug2zSFKZmV0Yaya7NxRQfrrPtfF2vj0K
DATA FACTORY https://www.youtube.com/playlist?list=PLug2zSFKZmV3FkUFDxlyrfSJMQ3CeqyEF
–LINKEDIN–
Not following the LinkedIn page yet? Here’s the link: https://www.linkedin.com/company/learnmicrosoftfabric/
–ABOUT WILL–
Hi, I’m Will! I’m hugely passionate about data and using it to create a better world. I currently work as a Consultant, focusing on Data Strategy, Data Engineering and Business Intelligence (within the Microsoft/Azure/Fabric environment). I have previously worked as a Data Scientist. I started Learn Microsoft Fabric to share my learnings on how Microsoft Fabric works and help you build your career and build meaningful things in Fabric.
–SUBSCRIBE–
Not subscribed yet? You should! There are lots of new videos in the pipeline covering all aspects of Microsoft Fabric.
https://youtube.com/@learnmicrosoftfabric?sub_confirmation=1
#DAY #Spark #Learn #Spark #Microsoft #Fabric #September