databricks how to install additional java packages

 

To create to a mongodb atlas, you need to have the proper library and have your compute instance setup already. 

Select Libraries tab and click on "install new".




Then select maven and click on search packages. You will see a whole list of packages available. 




You can select from Maven central or spark packages. We are just going to search for "mongo-spark" and then select this package. 



If you're getting similiar error messages as shown here, then try to provision your compute as a single personal instance. 

"Jars and Maven Libraries on Shared Clusters must be on the allowlist. Failed Libraries: org.mongodb.spark:mongo-spark-connector_2.12:3.0.1: PERMISSION_DENIED: 'org.mongodb.spark:mongo-spark-connector_2.12:3.0.1' is not in the artifact allowlist"














Comments

Post a Comment

Popular posts from this blog

The specified initialization vector (IV) does not match the block size for this algorithm

Image
If you're getting  exception when trying to assigned key to a symmetric key and getting error message below :- The specified initialization vector (IV) does not match the block size for this algorithm And your code probably look like something below :- Then you need to go into debug mode and start looking into the supported size for IV as shown in diagram below :- As you can see, IV is 16 bytes, so you need to provide 16 bytes. The same goes for Key field too, if you're adding anything to it. As long as you provide a valid key size, then we're good and you're code will be ready.
Read more