CovtFD

class capymoa.datasets.CovtFD

Bases: DownloadARFFGzip

CovtFD is an adaptation from the classic Covtype classification problem with added feature drifts.

• Number of instances: 581,011 (30m^2 cells)

• Number of attributes: 104 (10 continuous, 44 categorical, 50 dummy)

• Number of classes: 7 (forest cover types)

Given 30x30-meter cells obtained from the US Resource Information System (RIS). The dataset includes 10 continuous and 44 categorical features, which we augmented by adding 50 dummy continuous features drawn from a Normal probability distribution with μ = 0 and σ = 1. Only the continuous features were randomly swapped with 10 (out of the fifty) dummy features to simulate drifts. We added such synthetic drift twice, one at instance 193, 669 and another at 387, 338.

References:

1. Gomes, Heitor Murilo, Rodrigo Fernandes de Mello, Bernhard Pfahringer, and Albert Bifet. “Feature scoring using tree-based ensembles for evolving data streams.” In 2019 IEEE International Conference on Big Data (Big Data), pp. 761-769. IEEE, 2019.

2. Blackard,Jock. (1998). Covertype. UCI Machine Learning Repository. https://doi.org/10.24432/C50K5N.

3. https://archive.ics.uci.edu/ml/datasets/Covertype

See Also:

• Covtype - The classic covertype dataset

• CovtypeNorm - A normalized version of the classic covertype dataset

• CovtypeTiny - A truncated version of the classic covertype dataset

CLI_help() → str

Return cli help string for the stream.

__init__(

directory: str = PosixPath('data'),

auto_download: bool = True,

CLI: str | None = None,

schema: str | None = None,

)

Construct a Stream from a MOA stream object.

Usually, you will want to construct a Stream using the capymoa.stream.stream_from_file() function.

Parameters:

• moa_stream – The MOA stream object to read instances from. Is None if the stream is created from a numpy array.

• schema – The schema of the stream. If None, the schema is inferred from the moa_stream.

• CLI – Additional command line arguments to pass to the MOA stream.

Raises:

• ValueError – If no schema is provided and no moa_stream is provided.

• ValueError – If command line arguments are provided without a moa_stream.

__iter__() → Iterator[_AnyInstance]

Get an iterator over the stream.

This will NOT restart the stream if it has already been iterated over. Please use the restart() method to restart the stream.

Yield:

An iterator over the stream.

__next__() → _AnyInstance

Get the next instance in the stream.

Returns:

The next instance in the stream.

download(working_directory: Path) → Path

Download the dataset and return the path to the downloaded dataset within the working directory.

Parameters:

working_directory – The directory to download the dataset to.

Returns:

The path to the downloaded dataset within the working directory.

extract(stream_archive: Path) → Path

Extract the dataset from the archive and return the path to the extracted dataset.

Parameters:

stream_archive – The path to the archive containing the dataset.

Returns:

The path to the extracted dataset.

get_moa_stream() → InstanceStream | None

Get the MOA stream object if it exists.

get_path()

get_schema() → Schema

Return the schema of the stream.

has_more_instances() → bool

Return True if the stream have more instances to read.

next_instance() → _AnyInstance

Return the next instance in the stream.

Raises:

ValueError – If the machine learning task is neither a regression nor a classification task.

Returns:

A labeled instances or a regression depending on the schema.

restart()

Restart the stream to read instances from the beginning.

to_stream(stream: Path) → Any

Convert the dataset to a MOA stream.

Parameters:

stream – The path to the dataset.

Returns:

A MOA stream.