facebook field guide to machine learning series.




https://research.fb.com/the-facebook-field-guide-to-machine-learning-video-series/

Comments

Post a Comment

Popular posts from this blog

Solving Sonarqube :- Project was never analyzed. A regular analysis is required before a branch analysis

This means :- sonarqube don't have any info about your project. you need to setup your project in sonarqube.

The end goal here is to get your login - which is a guid for example,  "9f6cf20347297da17ce4591b1d2ada820a30d23e" and your project key which is a unique alphanumeric value to differentiate your project.


Goto Create Project - > Generate a token -> Provide  your project name -> Select C# or VB or Java (when prompt Run analysis on your project"

At the end of the dialog you will get Login :- which is a has and Project Key.

Then you pass those info into MsBuild or whatever build tools you currently using.


Read more

spark - pyspark reading from excel files

I guess a common mistake is to load the right jar file when loading excel file. Yes, you have to use version 2.11 and not 2.12, :)



You can try using the following command line


pyspark --packages com.crealytics:spark-excel_2.11:0.11.1


And use the following code to load an excel file in a data folder. If you have not created this folder, please create it and place an excel file in it.


from com.crealytics.spark.excel import *
## using spark-submit with option to execute script from command line ## spark-submit --packages spark-excel_2.11:0.11.1 excel_email_datapipeline.py
## pyspark --packages spark-excel_2.11:0.11.1 ## pyspark --packages com.crealytics:spark-excel_2.11:0.11.1
from pyspark.sql import SparkSession
spark = SparkSession.builder.appName("excel-email-pipeline").getOrCreate()
df = spark.read.format("com.crealytics.spark.excel").option("useHeader", "true").option("inferSchema", "true").load("data/excel.xlsx")
df.sh…
Read more