Frameworks, Tools and Libs

Updated: 2021-11-19

A typical Data Scientist/ML Engineer's toolbox.

Basic Python Tools

  • Pandas
  • Scikit Learn
  • Jupyter

Deep Learning / Neural Network

Model Deployment

Models may be developed by one language(e.g. Python, R), however your production environment may use another(e.g. Java). One way to bridge the gap is to encode the models in a language/tool-neutral way:

  • ONNX: A collaboration between Facebook and Microsoft. Supports Caffe2, PyTorch, and Cognitive Toolkit.
  • PMML: XML
  • PFA: YAML or JSON

ONNX

Open Neural Network Exchange: AWS, Microsoft, Facebook

ONNX is intended to be a standardized format that will allow deep learning models trained on one framework to be transferred to another framework with minimal extra work.