Skip to content

core.services.data.dataset.utils

utils

Functions:

Name Description
load_coco_datasets_impl

Implementation logic to load COCO datasets depending on the pipeline context type.

load_yolo_datasets_impl

Implementation logic to load YOLO datasets depending on the pipeline context type.

validate_dataset_impl

load_coco_datasets_impl(context, skip_asset_listing)

Implementation logic to load COCO datasets depending on the pipeline context type.

Handles both training and processing contexts and downloads assets and annotations accordingly.

Parameters:

Name Type Description Default

context

PicselliaTrainingContext | LocalTrainingContext | PicselliaProcessingContext | LocalProcessingContext

Either a training or processing context instance.

required

skip_asset_listing

bool

Whether to skip asset listing before download.

required

Returns:

Type Description
DatasetCollection[CocoDataset] | CocoDataset

DatasetCollection[CocoDataset] or CocoDataset: The loaded dataset(s).

load_yolo_datasets_impl(context, skip_asset_listing)

Implementation logic to load YOLO datasets depending on the pipeline context type.

Handles both training and processing contexts and downloads assets and annotations accordingly.

Parameters:

Name Type Description Default

context

PicselliaTrainingContext | LocalTrainingContext | PicselliaProcessingContext | LocalProcessingContext

Either a training or processing context instance.

required

skip_asset_listing

bool

Whether to skip asset listing before download.

required

Returns:

Type Description
DatasetCollection[YoloDataset] | YoloDataset

DatasetCollection[YoloDataset] or YoloDataset: The loaded dataset(s).

validate_dataset_impl(dataset, fix_annotation=False)