Data processing¶
pandas, Dask, SciPy, scikit-learn, pydantic, pandera, NLTK and more.
This section holds 14 notebooks from demo_notebooks/data_processing/ in the ganymede repository. Each page shows the notebook as committed; use the buttons at the top right of a page to download the .ipynb or open it on GitHub.
Notebooks¶
- AWS Wrangler: AWS Wrangler: Pandas on AWS: read and write pandas DataFrames in Amazon S3 and other AWS data services.
- Flox: Flox: Strategies for fast GroupBy reductions with dask.array. A Python demo notebook from ganymede.
- Mpmath: Mpmath: Python library for real and complex floating-point arithmetic with arbitrary precision. A Python demo notebook from ganymede.
- NLTK: NLTK: A suite of open source Python modules, data sets, and tutorials supporting research and development in Natural Language Processing
- Pandas: Pandas: A Python package that provides fast, flexible, and expressive data structures designed to make working with “relational” or “labeled” data both easy…
- Pandera: Pandera: Validate dataframes against a schema: column types, nullability and value checks, with clear error reports when the data does not match.
- PyDantic: PyDantic: Data validation using Python type hints. A Python demo notebook from ganymede.
- Scikit-learn: Scikit-learn: Machine learning in Python: classification, regression, clustering, dimensionality reduction and model selection.
- Scipy: Scipy: Fundamental algorithms for scientific computing in Python. A Python demo notebook from ganymede.
Sections¶
- Dask: 4 notebooks
- Ray (RayDP): 1 notebook