dataloader

Base Dataloader class(es) used in graphnet.

graphnet.data.dataloader.collate_fn(graphs)[source]

Remove graphs with less than two DOM hits.

Should not occur in “production.

Return type:

Batch

Parameters:

graphs (List[Data])

graphnet.data.dataloader.do_shuffle(selection_name)[source]

Check whether to shuffle selection with name selection_name.

Return type:

bool

Parameters:

selection_name (str)

class graphnet.data.dataloader.DataLoader(dataset, batch_size, shuffle, num_workers, persistent_workers, collate_fn=<function collate_fn>, prefetch_factor, **kwargs)[source]

Bases: DataLoader

Class for loading data from a Dataset.

Construct DataLoader.

Parameters:

  • dataset (Dataset[T_co])

  • batch_size (int | None)

  • shuffle (bool)

  • num_workers (int)

  • persistent_workers (bool)

  • collate_fn (Callable)

  • prefetch_factor (int | None)

  • kwargs (Any)

classmethod from_dataset_config(config, **kwargs)[source]

Construct DataLoader`s based on selections in `DatasetConfig.

Return type:

Union[DataLoader, Dict[str, DataLoader]]

Parameters: