lakeFS-spec
a filesystem-spec backend implementation for the lakeFS data lake
Erfahre mehr über unsere Open-Source-Library lakeFS-spec! Das Python-Package vereinfacht den Dateizugriff und die Versionierung in einem lakeFS Data-Lake und macht sie so leicht wie die Arbeit im lokalen Dateisystem.
Highlights:
Simple repository operations in lakeFS
Easy access to underlying storage and versioning operations
Seamless integration with the fsspec ecosystem
Directly access lakeFS objects from popular data science libraries (including Pandas, Polars, DuckDB, Hugging Face Datasets, PyArrow) with minimal code
Transaction support for reliable data version control
Smart data transfers through client-side caching (up-/download)
Auto-discovery configuration