Data Loading, Transformation & Validation

Dataset/IterableDataset/DataLoader/Transform/Compose/CollateFn core, plus concrete modality implementations (tabular CSV, image, text, audio, a reduced-scope video frame-directory stub) and generic dataset validation (descriptive statistics, missingness/outlier detection), all built on the Deep Learning Modules and Layers Tensor. More...

Files
file	audio_collate.hpp
	AudioPadCollate – zero-pads variable-length waveforms into one batch Tensor.
file	audio_folder_dataset.hpp
	Directory-of-class-subfolders audio Dataset, mirroring ImageFolderDataset.
file	audio_transforms.hpp
	Sample-level audio Transforms – linear-interpolation resampling.
file	bounded_queue.hpp
	Fixed-capacity thread-safe blocking queue – the staged-pipeline backbone.
file	collate.hpp
	Batch assembly – Batch, CollateFn, DefaultCollate.
file	csv_dataset.hpp
	Dataset over a CSV file's numeric feature/label columns – Phase 1's tabular reference case.
file	csv_reader.hpp
	Minimal hand-rolled CSV parser – RFC-4180-ish, whole-file-at-once.
file	data_loader.hpp
	Orchestrates sampling, fetch, and collation into batches.
file	data_thread_pool.hpp
	Minimal generic thread pool for CPU-side data pipeline work.
file	dataset.hpp
	Random-access dataset abstraction – Sample, Dataset (size()/get()).
file	dataset_validator.hpp
	Generic per-field descriptive statistics + missingness/outlier detection over any Dataset.
file	image_decoder.hpp
	Decodes image files (PNG/JPEG/BMP/etc.) into Tensors via stb_image.
file	image_folder_dataset.hpp
	Directory-of-class-subfolders image Dataset, mirroring torchvision's ImageFolder.
file	image_transforms.hpp
	Sample-level image Transforms – resize, center-crop, normalize, horizontal flip.
file	iterable_dataset.hpp
	Streaming dataset abstraction – reset()/next() for sources with no random access.
file	mnist_dataset_adapter.hpp
	Adapts a pre-loaded MnistDataset onto the generic Dataset interface.
file	sampler.hpp
	Index-order abstraction for DataLoader – SequentialSampler, ShuffleSampler.
file	text_collate.hpp
	PadCollate – right-pads variable-length token sequences into one batch Tensor.
file	text_dataset.hpp
	Line-delimited corpus Dataset – tokenizes and indexes each line into a Tensor.
file	tokenizer.hpp
	Minimal deterministic whitespace/punctuation word-level tokenizer.
file	transform.hpp
	Sample-level preprocessing abstraction – Transform, Compose, TransformDataset.
file	video_frame_directory_dataset.hpp
	Directory-of-pre-extracted-frames video Dataset (reduced-scope stub, no codec decode).
file	video_transforms.hpp
	Frame-sampling Transform – selects a fixed number of evenly-spaced frames.
file	vocabulary.hpp
	Token<->index lookup with a reserved <unk> fallback, plus a frequency-ranked builder.
file	wav_reader.hpp
	Hand-rolled 16-bit PCM WAV decoder.

Detailed Description

Dataset/IterableDataset/DataLoader/Transform/Compose/CollateFn core, plus concrete modality implementations (tabular CSV, image, text, audio, a reduced-scope video frame-directory stub) and generic dataset validation (descriptive statistics, missingness/outlier detection), all built on the Deep Learning Modules and Layers Tensor.