3/9/2024 0 Comments Winutils 64 bit windows 10![]() ![]() What is the problem in installing Spark in stand alone mode on Windows machine? Currently it is one of the most popular projects among the different tools used as part of Hadoop ecosystem. Spark is written in Scala & support Scala, Java, Python and R languages as of writing this post in January 2016. This also means that we do not need to set up Hadoop cluster to get started with Spark. One of the positives of Spark is that it can be run in standalone mode without having to setup nodes in the cluster. ![]() It also fits more in the distributed computing paradigm related to big data world. ![]() It claims to be upto 100 times more faster compared to Hadoop MapReduce processing methods. Spark is an execution engine which is gaining popularity due to its ability to perform in memory parallel processing. Net background and new to Java way of working might face similar difficulties tat I faced over a day to get Spark up and running. I got back to bit of programming after a long gap and it was quite evident that I struggledd a bit in configuring the system. This post is about my experice of setting up Spark as a standalone instance on Windows 10 64 bit machine. Hopefully the next ones will be much more frequent. Its been almost 2 years since I wrote a blog post. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |