Skip to content

fsspec

This section holds 16 notebooks from demo_notebooks/data_storage/filesystems/fsspec/ in the ganymede repository. Each page shows the notebook as committed; use the buttons at the top right of a page to download the .ipynb or open it on GitHub.

Notebooks

  • ADLFS (Azure Data Lake FileSystem): ADLFS (Azure Data Lake FileSystem): Interact with Azure Data Lake. A Python demo notebook from ganymede.
  • ArrowFs: ArrowFs: Work with data in pyarrow. Arrow manages data in arrays, which can be grouped in tables, to represent columns of data in tabular data.
  • AsyncLocal: AsyncLocal: Work with your local filesystem asynchronously. A Python demo notebook from ganymede.
  • DictFs: DictFS is a nested dictionary-based, in-memory filesystem and acts more like a real LocalFileSystem.
  • FSSpec: FSSpec: Work with local and remote filesystems. A Python demo notebook from ganymede.
  • GCSFS (and GS): GCSFS (and GS): List objects from google cloud blob storage. A Python demo notebook from ganymede.
  • GDriveFS: Work with objects in google drive through fsspec, with the gdrive_fsspec package (pip install gdrive-fsspec; the unrelated PyPI package gdrivefs is a FUSE tool)
  • GitHubFS: GitHubFS: Work with data in github. A Python demo notebook from ganymede.
  • Hdfs: Hdfs: Work with data via hadoop. A Python demo notebook from ganymede.
  • HTTPFS: HTTPFS: Work with data via http. A Python demo notebook from ganymede.
  • LibArchiveFS: LibArchiveFS: Compressed archives as a filesystem. A Python demo notebook from ganymede.
  • Memfs: Memfs: Work with data in memory. In-Memory Object Storage FileSystem based on Trie data-structure. A Python demo notebook from ganymede.
  • OverlayFS: OverlayFS: Allows overlaying multiple fsspec-based filesystems. A Python demo notebook from ganymede.
  • S3FS: S3FS: Interact with data in s3. A Python demo notebook from ganymede.
  • SFTPFS: SFTPFS: Work with data via SFTP. A Python demo notebook from ganymede.
  • SSHFS: SSHFS: Interact with data via ssh and python. A Python demo notebook from ganymede.