This repository contains the entire Python Data Science Handbook, in the form of (free!) Jupyter notebooks.
You can read the book in its entirety online at https://jakevdp.github.io/PythonDataScienceHandbook/
The book was written and tested with Python 3.5, though older Python versions (including Python 2.7) should work in nearly all cases.
The book introduces the core libraries essential for working with data in Python: particularly IPython, NumPy, Pandas, Matplotlib, Scikit-Learn, and related packages. Familiarity with Python as a language is assumed; if you need a quick introduction to the language itself, see the free companion project, A Whirlwind Tour of Python: it's a fast-paced introduction to the Python language aimed at researchers and scientists.
See Index.ipynb for an index of the notebooks available to accompany the text.
The code in the book was tested with Python 3.5, though most (but not all) will also work correctly with Python 2.7 and other older Python versions.
The packages I used to run the code in the book are listed in requirements.txt (Note that some of these exact version numbers may not be available on your platform: you may have to tweak them for your own use). To install the requirements using conda, run the following at the command-line:
To create a stand-alone environment named with Python 3.5 and all the required package versions, run the following:
You can read more about using conda environments in the Managing Environments section of the conda documentation.
See blog post
"A project by Sam Greydanus" "You know nothing Jon Snow" (print) "You know nothing Jon Snow" (cursive)
"lowering the bias" "makes the writing messier" "but more random"
For an easy intro to the code (along with equations and explanations) check out these Jupyter notebooks:
Now you have two options:
This model is trained on the IAM handwriting dataset and was inspired by the model described by the famous 2014 Alex Graves paper. It consists of a three-layer recurrent neural network (LSTM cells) with a Gaussian Mixture Density Network (MDN) cap on top. I have also implemented the attention mechanism from the paper which allows the network to 'focus' on character at a time in a sequence as it draws them.
The model at one time step looks like this
Unrolling in time, we get
I've implemented the attention mechanism from the paper:
The Team Data Science Process (TDSP) is an agile, iterative data science methodology to deliver predictive analytics solutions and intelligent applications efficiently. TDSP helps improve team collaboration and learning. It contains a distillation of the best practices and structures from Microsoft and others in the industry that facilitate the successful implementation of data science initiatives. The goal is to help companies fully realize the benefits of their analytics program.
The TDSP is comprised of the following key components:
Note: You can follow a complete example of this process using Azure Machine Learning:
This workshop guides you through a series of exercises you can use to learn to implement the TDSP in your Data Science project, using only Python in a Notebook. You can change the Setup and Lab cells in this Notebook to use another language, another platform, and with more or fewer prompts based on your audience's needs.