fsspec¶
This section holds 16 notebooks from demo_notebooks/data_storage/filesystems/fsspec/ in the ganymede repository. Each page shows the notebook as committed; use the buttons at the top right of a page to download the .ipynb or open it on GitHub.
Notebooks¶
- ADLFS (Azure Data Lake FileSystem): ADLFS (Azure Data Lake FileSystem): Interact with Azure Data Lake. A Python demo notebook from ganymede.
- ArrowFs: ArrowFs: Work with data in pyarrow. Arrow manages data in arrays, which can be grouped in tables, to represent columns of data in tabular data.
- AsyncLocal: AsyncLocal: Work with your local filesystem asynchronously. A Python demo notebook from ganymede.
- DictFs: DictFS is a nested dictionary-based, in-memory filesystem and acts more like a real LocalFileSystem.
- FSSpec: FSSpec: Work with local and remote filesystems. A Python demo notebook from ganymede.
- GCSFS (and GS): GCSFS (and GS): List objects from google cloud blob storage. A Python demo notebook from ganymede.
- GDriveFS: Work with objects in google drive through fsspec, with the gdrive_fsspec package (pip install gdrive-fsspec; the unrelated PyPI package gdrivefs is a FUSE tool)
- GitHubFS: GitHubFS: Work with data in github. A Python demo notebook from ganymede.
- Hdfs: Hdfs: Work with data via hadoop. A Python demo notebook from ganymede.
- HTTPFS: HTTPFS: Work with data via http. A Python demo notebook from ganymede.
- LibArchiveFS: LibArchiveFS: Compressed archives as a filesystem. A Python demo notebook from ganymede.
- Memfs: Memfs: Work with data in memory. In-Memory Object Storage FileSystem based on Trie data-structure. A Python demo notebook from ganymede.
- OverlayFS: OverlayFS: Allows overlaying multiple fsspec-based filesystems. A Python demo notebook from ganymede.
- S3FS: S3FS: Interact with data in s3. A Python demo notebook from ganymede.
- SFTPFS: SFTPFS: Work with data via SFTP. A Python demo notebook from ganymede.
- SSHFS: SSHFS: Interact with data via ssh and python. A Python demo notebook from ganymede.