Click next, when you are given the following screen :-
Next, you need to configure the handler. Handler always start off with your assembly (ONLY DLL please, exe is not supported). More detail info, please have a look at diagram below.
Set the runtime to C#.
If you encounter this error,
"errorMessage": "Could not find the LambdaSerializerAttribute on the assembly 'TestApp, Culture=neutral, PublicKeyToken=null' or method 'Main' while attempting to deserialize input data of type 'System.String'. To use types other than System.IO.Stream as input/output parameters, the assembly or Lambda function should be annotated with Amazon.Lambda.LambdaSerializerAttribute."
it probably means you are passing a argument in your aws lambda function. It should not take in any arguments unless those type supported by AWS.
To get started with django rest framework, you gotta started reading from the back cuz for some reasons these guys like to give out the best implementation in the end.
Anyways, go ahead to create your virtualenv
pip install django
pip install djangorestframework
# Set up a new project with a single application
django-admin.py startproject tutorial .# Note the trailing '.' character
django-admin.py startapp quickstart
cd .. Let's start of with Request/Response object. As these remain critical for our development efforts and work with urls.py
What it is saying on 2nd like, is we are creating a root api for our application and the "name" properties you see in 3rd and 4th line are references for us to do reverse look up which you will see later.
1. Install Anaconda Python - which has all the goodies you need.
2.Download Spark and unzip into a folder.
3. After you have all these setup, next you need to issue the following command (spark only supports python 3.5)
conda create -n py35 python=3.5 anaconda
4. Goto your spark installation folder, goto "bin" and run "pyspark".
5. You probably going to get some exceptions but still should be able to run the following scripts :
from pyspark import SparkContext
sc = SparkContext.getOrCreate()
tf = sc.textFile("j:\\tmp\\data.txt")
Please make sure you have your "data.txt" pointed correctly.
This setup looks easier than it is. Spent a lot of time today trying to get it up and running.
Next create a file call setup.py which contains some basic information about your package
from distutils.core import setup
setup( name = 'kepungmath', packages = ['kepungmath'], # this must be the same as the name above version = '0.1', description = 'A random test lib', author = 'Jeremy Woo', author_email = 'email@example.com', url = 'https://github.com/appcoreopc/kepungmath', # use the URL to the github repo download_url = 'https://github.com/appcoreopc/kepungmath/archive/0.1.tar.gz', # I'll explain this in a second keywords = ['testing', 'logging', 'example'], # arbitrary…
Jupyter notebook is a web based application that uses web socket to talk to ipython, execute python (or other languages like Julia and Haskell). It is really popular when it comes to executing machine learning kernels.
Say for example, you trying to use numpy to read off certain csv files and runs mathplot, you can easily do so using IPython.
Great! So how does it work?
First you need to setup jupyter notebook. I assumed that you have installed Anaconda in your system.
First, lets setup our virtual environment virtualenv notebook
Now activate our newly created environment.
activate notebookpip install --upgrade setuptools pip
git clone https://github.com/jupyter/notebook
pip install -e .
From diagram below, we can see notebook depends on jupyter_client (purple) to talk to ipython (yellow)