Learning Journal
Learning Journal
  • 867
  • 7 285 486
When do you need batch processing project | Understand with an example and use case
Data Engineering Learning Path
www.scholarnest.in/bundles/mastering-spark-and-databricks-cloud?ref=ae0dde
Advanced data engineering learning path
www.scholarnest.in/bundles/mastering-apache-spark-databricks-performance-tuning?ref=ae0dde
Individual Courses
www.scholarnest.in/courses/mastering-pyspark?ref=ae0dde
www.scholarnest.in/courses/apache-spark-and-databricks-structured-streaming?ref=ae0dde
www.scholarnest.in/courses/mastering-databricks-cloud?ref=ae0dde
www.scholarnest.in/courses/apache-spark-performance-tuning?ref=ae0dde
You can also find us on Udemy
www.udemy.com/courses/search/?q=prashant+kumar+pandey
You can also find us on Oreilly
www.oreilly.com/search/?q=author%3A%22ScholarNest%22&type=*&rows=10
www.oreilly.com/search/?q=author%3A%22Prashant%20Kumar%20Pandey%22&type=*&rows=10
Переглядів: 104

Відео

How to detect and tune data explosion problem | Apache Spark Performance Tuning Scenario
Переглядів 17814 годин тому
Get this course www.scholarnest.in/courses/apache-spark-performance-tuning?ref=ae0dde WhatsApp: 91-93534 65988 for current discount offers. Please visit our website below for more courses and live instructor-led training. Learn more at www.scholarnest.in/?ref=ae0dde Keep Learning and Keep Growing.
What is Database and SQL
Переглядів 29716 годин тому
Join this course www.scholarnest.in/courses/sql-essentials?ref=ae0dde WhatsApp: 91-93534 65988 for current discount offers. Please visit our website below for more courses and live instructor-led training. Learn more at www.scholarnest.in/?ref=ae0dde Keep Learning and Keep Growing.
What are the three approaches for Data Engineering
Переглядів 217День тому
Data Engineering Learning Path www.scholarnest.in/bundles/mastering-spark-and-databricks-cloud?ref=ae0dde Advanced data engineering learning path www.scholarnest.in/bundles/mastering-apache-spark-databricks-performance-tuning?ref=ae0dde Individual Courses www.scholarnest.in/courses/mastering-pyspark?ref=ae0dde www.scholarnest.in/courses/apache-spark-and-databricks-structured-streaming?ref=ae0dd...
Why is reading JSON slow and how do you optimize it | Apache Spark Performance Tuning Scenario
Переглядів 278День тому
Get this course www.scholarnest.in/courses/apache-spark-performance-tuning?ref=ae0dde WhatsApp: 91-93534 65988 for current discount offers. Please visit our website below for more courses and live instructor-led training. Learn more at www.scholarnest.in/?ref=ae0dde Keep Learning and Keep Growing.
Data Engineering Course | Freedom Sale | Grab at ScholarNest
Переглядів 63914 днів тому
Grab the offer at www.scholarnest.in/?ref=ae0dde WhatsApp: 91-93534 65988 for discount coupon Freedom sale is now live at ScholarNest.in Mastering PySpark, Mastering Azure Databricks, Spark Structured Streaming, Apache Spark Performance Tuning, Big Data Engineering Learning Path. Grab anything at 25% flat and another 25% extra discount. It's now or never an offer. Hurry up. The offer ends on 15...
What is Data Engineering | What is the job of Data Engineer
Переглядів 23914 днів тому
Data Engineering Learning Path www.scholarnest.in/bundles/mastering-spark-and-databricks-cloud?ref=ae0dde Advanced data engineering learning path www.scholarnest.in/bundles/mastering-apache-spark-databricks-performance-tuning?ref=ae0dde Individual Courses www.scholarnest.in/courses/mastering-pyspark?ref=ae0dde www.scholarnest.in/courses/apache-spark-and-databricks-structured-streaming?ref=ae0dd...
What is performance benchmarking and how do you do it | Apache Spark Performance Tuning
Переглядів 28114 днів тому
Get this course www.scholarnest.in/courses/apache-spark-performance-tuning?ref=ae0dde WhatsApp: 91-93534 65988 for current discount offers. Please visit our website below for more courses and live instructor-led training. Learn more at www.scholarnest.in/?ref=ae0dde Keep Learning and Keep Growing.
Learn Spark Programming in 2 Days | Free Course
Переглядів 57121 день тому
Data Engineering Learning Path www.scholarnest.in/bundles/mastering-spark-and-databricks-cloud?ref=ae0dde Advanced data engineering learning path www.scholarnest.in/bundles/mastering-apache-spark-databricks-performance-tuning?ref=ae0dde Individual Courses www.scholarnest.in/courses/mastering-pyspark?ref=ae0dde www.scholarnest.in/courses/apache-spark-and-databricks-structured-streaming?ref=ae0dd...
How do you identify and locate performance tuning opportunity | Apache Spark Performance Tuning
Переглядів 20221 день тому
Get this course www.scholarnest.in/courses/apache-spark-performance-tuning?ref=ae0dde WhatsApp: 91-93534 65988 for current discount offers. Please visit our website below for more courses and live instructor-led training. Learn more at www.scholarnest.in/?ref=ae0dde Keep Learning and Keep Growing.
What is Apache Spark Performance Tuning | How do you approach Spark Performance Tuning Problem
Переглядів 400Місяць тому
Get this course www.scholarnest.in/courses/apache-spark-performance-tuning?ref=ae0dde WhatsApp: 91-93534 65988 for current discount offers. Please visit our website below for more courses and live instructor-led training. Learn more at www.scholarnest.in/?ref=ae0dde Keep Learning and Keep Growing.
Apache Spark Performance Tuning | Scenario based interview question | Cluster Autoscaling
Переглядів 1,2 тис.3 місяці тому
Get this course www.scholarnest.in/courses/apache-spark-performance-tuning?ref=ae0dde Please visit our website below for more courses and live instructor-led training. Learn more at www.scholarnest.in/?ref=ae0dde Keep Learning and Keep Growing.
Apache Spark Performance Tuning Course | Tuning Terabyte Join | Tuning large table joins
Переглядів 9844 місяці тому
Get this course www.scholarnest.in/courses/apache-spark-performance-tuning?ref=ae0dde WhatsApp: 91-93534 65988 for current discount offers. Please visit our website below for more courses and live instructor-led training. Learn more at www.scholarnest.in/?ref=ae0dde Keep Learning and Keep Growing.
11 - Azure Databricks Platform Architecture
Переглядів 1,8 тис.4 місяці тому
This course is available on Udemy and Udemy for Business subscription. Check the below link if you wish to get it on Udemy. www.udemy.com/course/master-azure-databricks-for-data-engineers/?referralCode=6C313138590E175DAA6F Please visit our website below for more courses and live instructor-led training. Learn more at www.scholarnest.com/ Keep Learning and Keep Growing.
10 - Introduction to Databricks Workspace
Переглядів 1,3 тис.4 місяці тому
This course is available on Udemy and Udemy for Business subscription. Check the below link if you wish to get it on Udemy. www.udemy.com/course/master-azure-databricks-for-data-engineers/?referralCode=6C313138590E175DAA6F Please visit our website below for more courses and live instructor-led training. Learn more at www.scholarnest.com/ Keep Learning and Keep Growing.
9 - Creating Databricks Workspace Service
Переглядів 1,1 тис.5 місяців тому
9 - Creating Databricks Workspace Service
Apache Spark Performance Tuning on Databricks | Scenario based Spark performance tuning course
Переглядів 2,1 тис.5 місяців тому
Apache Spark Performance Tuning on Databricks | Scenario based Spark performance tuning course
08 - Azure Portal Overview
Переглядів 7435 місяців тому
08 - Azure Portal Overview
07 - Creating Azure Account
Переглядів 7105 місяців тому
07 - Creating Azure Account
06 - What will you learn in this section
Переглядів 7895 місяців тому
06 - What will you learn in this section
05 - Introduction to Databricks Platform
Переглядів 1,4 тис.6 місяців тому
05 - Introduction to Databricks Platform
04 - Why do we need Databricks for Apache Spark projects
Переглядів 1,7 тис.6 місяців тому
04 - Why do we need Databricks for Apache Spark projects
03 - Introduction to Data Engineering
Переглядів 1,6 тис.6 місяців тому
03 - Introduction to Data Engineering
02 - Course Prerequisites | Master Azure Databricks for Data Engineers
Переглядів 1,8 тис.6 місяців тому
02 - Course Prerequisites | Master Azure Databricks for Data Engineers
01 - Master Azure Databricks for Data Engineers | About the Course
Переглядів 5 тис.6 місяців тому
01 - Master Azure Databricks for Data Engineers | About the Course
02 - Course Prerequisites
Переглядів 8076 місяців тому
02 - Course Prerequisites
01 - About The Course
Переглядів 2,6 тис.6 місяців тому
01 - About The Course
Spark Installation Prerequisites
Переглядів 1,1 тис.10 місяців тому
Spark Installation Prerequisites
06 - Batch processing to stream processing
Переглядів 1,4 тис.10 місяців тому
06 - Batch processing to stream processing
07 - Your first application - Applying Best Practice
Переглядів 1,1 тис.10 місяців тому
07 - Your first application - Applying Best Practice

КОМЕНТАРІ

  • @leoxvic4701
    @leoxvic4701 День тому

    this is brilliant!

  • @soloboy118
    @soloboy118 2 дні тому

    hi sir, while doing patching of Kafka brokers, usually we do last for Control center patching right. if we done C3 first and then activate controller last then any issue vl happen ? pls help

  • @ashishsharan6503
    @ashishsharan6503 5 днів тому

    Is this course free on this platform

  • @swarnaravi
    @swarnaravi 6 днів тому

    databricks flate-farm or platform ?

  • @AbhishekKumar-kk6qs
    @AbhishekKumar-kk6qs 8 днів тому

    kafka dont allow more than 1 consumer or 2 consumer from a consumer group to read from the same topic ?

  • @AmitCodes
    @AmitCodes 10 днів тому

    Got it sir. In my company we have near real time setup Every 10mins we read data from hive table into Kafka topic This data is consumed by flink pipeline after this

  • @machisri
    @machisri 11 днів тому

    sir, Could you make a video on Generative AI in Databricks ( LLM, LongChain, DBRX, HuggingFace, MLFlow)

  • @user-fq1fx8me6y
    @user-fq1fx8me6y 12 днів тому

    best

  • @AmitCodes
    @AmitCodes 12 днів тому

    Thank you sir

  • @agenesistech
    @agenesistech 14 днів тому

    oh this is paid training.

  • @yuhao8430
    @yuhao8430 14 днів тому

    best

  • @durgaprasad-vm4mh
    @durgaprasad-vm4mh 15 днів тому

    You can't even enable coupon code in website ? Why so afraid?

    • @ScholarNest
      @ScholarNest 15 днів тому

      You can get it over WhatsApp after understanding terms and conditions and discussing multiple options to get your best deal

    • @durgaprasad-vm4mh
      @durgaprasad-vm4mh 15 днів тому

      @@ScholarNest why can't you mention all those details in website ? I really don't understand reasons behind it ? You don't want to reveal course price to public ? Is it that expensive ? It feels more like a scam if you're hiding everything.

  • @satyakiguha415
    @satyakiguha415 15 днів тому

    What will be the cost for the whole data engg with azure db offer?

    • @ScholarNest
      @ScholarNest 15 днів тому

      Check out the price of the Advanced learning path and apply for a 25% +25% discount. Advanced learning path includes everything

  • @ScholarNest
    @ScholarNest 15 днів тому

    Grab the offer at www.scholarnest.in/?ref=ae0dde WhatsApp: +91-93534 65988 for discount coupon

  • @Ronak-Data-Engineer
    @Ronak-Data-Engineer 15 днів тому

    Best teacher and content who want to land into data engineering... Keep learning keep growing 😃

  • @gudikandulasandeep2266
    @gudikandulasandeep2266 17 днів тому

    Where is this course available for free?

    • @ScholarNest
      @ScholarNest 17 днів тому

      Will be uploaded here on UA-cam on a weekly basis. One video every week

  • @AjayKumar-id7mb
    @AjayKumar-id7mb 17 днів тому

    Completed your course from udemy It was full of knowledge

  • @aminullahyousufi8142
    @aminullahyousufi8142 17 днів тому

    hello sir, it there any way to upload or transfer files from my windows to the hadoop hdfs ?

  • @aamirriyaz91
    @aamirriyaz91 20 днів тому

    I wonder out of 890 views. How many people have bought this course for 30000.

  • @NitikaKishore
    @NitikaKishore 22 дні тому

    How are you able to access the "Manage Account" option from the User drop-down if this Databricks instance was created using a Free Tier Azure account?

  • @NitikaKishore
    @NitikaKishore 22 дні тому

    How are you able to access the Manage Account option from the User drop-down if this Databricks instance was created using a Free Tier Azure account?

  • @MoltenThrower
    @MoltenThrower 22 дні тому

    32000 INR is bit too high for a course. I understand that your course are very detailed, but 32k. I would have bought it if it was 4k. Just like Udemy try to reach maximum students and sell more instead of high cost. All the entry level data engineers cant spend there one month salary for a course.

    • @ScholarNest
      @ScholarNest 22 дні тому

      Some skills are not for entry level data engineers. No offense but this course is not for volumes and beginners.

  • @ninaddesai7294
    @ninaddesai7294 23 дні тому

    For 1st time I felt that I am literally able to visualise things being taught here - sign of great teaching skills you have

  • @vishalmane3139
    @vishalmane3139 25 днів тому

    y ur courses r not for begineers?

    • @ScholarNest
      @ScholarNest 24 дні тому

      Expectations from beginners are growing higher now. A beginner course is supposed to help them learn by leaps and bounds

  • @swapnildongre5442
    @swapnildongre5442 25 днів тому

    Hello Sir, I am new to this field and want to learn Kafka. Do I need to have coding language Exp to start this. Or any other pre requisite. Please advise

    • @ScholarNest
      @ScholarNest 25 днів тому

      Kafka projects heavily use Java and Spring Boot. That's kind of mandatory for finding Kafka projects

  • @nuwan099
    @nuwan099 27 днів тому

    Such invaluable info taught so well! thank you!

  • @ranitreasa127
    @ranitreasa127 29 днів тому

    Thank you sir.. Highly recommended course

  • @Badkurdar
    @Badkurdar Місяць тому

    How to see user memory utilization ?

  • @rohanrustagi7857
    @rohanrustagi7857 Місяць тому

    What is zookeeper here

  • @1990mt
    @1990mt Місяць тому

    Hadoop is dead

  • @F-Zone1
    @F-Zone1 Місяць тому

    Hello sir Can you please explain how to connect db2 database from pyspark I'm searching lot of website and other sources i couldn't connect my company's ibm db2 to access tables please help me with supported jar files or what i need to use to access it thanks

  • @gurumoorthysivakolunthu9878
    @gurumoorthysivakolunthu9878 Місяць тому

    Very detailed... best ever explanation of a topic, Sir... This is amazing... Thank you, Sir....

  • @Sauravsuman11005
    @Sauravsuman11005 Місяць тому

    Datanode = 10 16 CPUs / node 64 GB Memory / node Please tell me cluster config we are going to choose ?

  • @shyamyadav-qk4zb
    @shyamyadav-qk4zb Місяць тому

    Very good video sir , my doubt is clear now much more helpful 🙏

  • @arnabghosh21
    @arnabghosh21 Місяць тому

    For the same 10 GB file suppose we have following resources: 38 GB worker memory with10 cores, 8gb driver memory with 2 cores, manually configured schuffle partitions - 80. How will it behave?

  • @ashutoshkandpal6792
    @ashutoshkandpal6792 Місяць тому

    How to become member to unlock videos?

  • @soumikdas7709
    @soumikdas7709 Місяць тому

    Nice explanation

  • @user-uo8jg2qm8q
    @user-uo8jg2qm8q Місяць тому

    Does creating workspace will charge you??

  • @SanjayKumar-rw2gj
    @SanjayKumar-rw2gj Місяць тому

    Great explanation, to the point no exaggeration. Thanks for the video

  • @Wilmar-xz5io
    @Wilmar-xz5io Місяць тому

    best explanation ever!

  • @VivekKBangaru
    @VivekKBangaru Місяць тому

    Very informative video. Thanks

  • @ayeshakhan8726
    @ayeshakhan8726 Місяць тому

    Easy explanation👍

  • @PANKAJKUMAR-fe8zn
    @PANKAJKUMAR-fe8zn 2 місяці тому

    Wonderful explanation. I was studying data cloud in salesforce and they were mentioning this data format multiple time. I was clueless but I got clarity from your video. Thank you sir