kedro.io

Description

kedro.io provides functionality to read and write to a number of datasets. At the core of the library is the AbstractDataset class.

Classes

kedro.io.AbstractDataset()

AbstractDataset is the base class for all dataset implementations.

kedro.io.AbstractVersionedDataset(filepath, ...)

AbstractVersionedDataset is the base class for all versioned dataset implementations.

kedro.io.CachedDataset(dataset[, version, ...])

CachedDataset is a dataset wrapper which caches in memory the data saved, so that the user avoids io operations with slow storage media.

kedro.io.DataCatalog([datasets, feed_dict, ...])

DataCatalog stores instances of AbstractDataset implementations to provide load and save capabilities from anywhere in the program.

kedro.io.LambdaDataset(load, save[, exists, ...])

LambdaDataset loads and saves data to a dataset.

kedro.io.MemoryDataset([data, copy_mode, ...])

MemoryDataset loads and saves data from/to an in-memory Python object.

kedro.io.Version(load, save)

This namedtuple is used to provide load and save versions for versioned datasets.

Exceptions

kedro.io.DatasetAlreadyExistsError

DatasetAlreadyExistsError raised by `DataCatalog and KedroDataCatalog classes in case of trying to add a dataset which already exists in the DataCatalog.

kedro.io.DatasetError

DatasetError raised by AbstractDataset implementations in case of failure of input/output methods.

kedro.io.DatasetNotFoundError

DatasetNotFoundError raised by `DataCatalog and KedroDataCatalog classes in case of trying to use a non-existing dataset.