Building spark is easy

I was amazed how easy it is to build Spark on Windows. Just have to

1. Download and install Scala 2.9.2. Ensure your SCALA_HOME is accurately setup.
2. Also make sure you have javac available in your environment path.
3. Download spark (0.7.0). Spark uses sbt (simple build tool and it is shipped together with the code.

After you extracted spark source code, goto the root folder and run

sbt/sbt package

And you're done! Awesome.

Comments

Post a Comment

Popular posts from this blog

The specified initialization vector (IV) does not match the block size for this algorithm

Image
If you're getting  exception when trying to assigned key to a symmetric key and getting error message below :- The specified initialization vector (IV) does not match the block size for this algorithm And your code probably look like something below :- Then you need to go into debug mode and start looking into the supported size for IV as shown in diagram below :- As you can see, IV is 16 bytes, so you need to provide 16 bytes. The same goes for Key field too, if you're adding anything to it. As long as you provide a valid key size, then we're good and you're code will be ready.
Read more