Code

Add FiftyOneTorchDataset#5321

Code

Open

jacobsela wants to merge 32 commits intodevelopvoxel51/fiftyone:developfrom feature/torch-datasetvoxel51/fiftyone:feature/torch-datasetCopy head branch name to clipboard

+2,283

Commits

Commits on Dec 13, 2024

• first commit

  

  Jacob Sela

  committed
  5f19373

  Copy full SHA for 5f19373

• made it cleaner

  

  Jacob Sela

  committed
  354c660

  Copy full SHA for 354c660

Commits on Dec 16, 2024

• some docs

  

  Jacob Sela

  committed
  ee8c483

  Copy full SHA for ee8c483

• some docs

  

  Jacob Sela

  committed
  7c4f0e9

  Copy full SHA for 7c4f0e9

Commits on Dec 17, 2024

• caching values for faster dataloaders

  

  Jacob Sela

  committed
  592dec6

  Copy full SHA for 592dec6

Commits on Dec 18, 2024

• changed to torch serialization because it is better if not using fork

  

  Jacob Sela

  committed
  aa95bc6

  Copy full SHA for aa95bc6

• typo

  

  Jacob Sela

  committed
  4585d93

  Copy full SHA for 4585d93

• added note about dataset persistence

  

  Jacob Sela

  committed
  6ae1f27

  Copy full SHA for 6ae1f27

Commits on Dec 20, 2024

• DDP

  

  Jacob Sela

  committed
  963dc62

  Copy full SHA for 963dc62

Commits on Dec 23, 2024

• important docs

  

  Jacob Sela

  committed
  7d6162c

  Copy full SHA for 7d6162c

• added top level util function

  

  Jacob Sela

  committed
  c7f3df8

  Copy full SHA for c7f3df8

Commits on Dec 24, 2024

• optimization - when using database backed, read right from dataset rather than view. Way faster.

  

  Jacob Sela

  committed
  dd7480b

  Copy full SHA for dd7480b

• added note about changing default start method for processes

  

  Jacob Sela

  committed
  0a40b31

  Copy full SHA for 0a40b31

Commits on Dec 26, 2024

• refined notes

  

  Jacob Sela

  committed
  2313c0f

  Copy full SHA for 2313c0f

• Basic example, cached field example, mnist training example

  

  Jacob Sela

  committed
  967b84b

  Copy full SHA for 967b84b

• removed weights

  

  Jacob Sela

  committed
  85fd0e4

  Copy full SHA for 85fd0e4

• added dataloader for cahed field notebook and some fixes

  

  Jacob Sela

  committed
  b7e3e51

  Copy full SHA for b7e3e51

Commits on Dec 27, 2024

• added no_grad to eval

  

  Jacob Sela

  committed
  fc61ed1

  Copy full SHA for fc61ed1

• added util for authorizing process communcation in case user is on torchrun

  

  Jacob Sela

  committed
  d1ffeca

  Copy full SHA for d1ffeca

• more notes on ddp

  

  Jacob Sela

  committed
  e08a447

  Copy full SHA for e08a447

Commits on Dec 30, 2024

• mnist ddp exmaple

  

  Jacob Sela

  committed
  fa8db3d

  Copy full SHA for fa8db3d

Commits on Jan 14, 2025

• updated note about serializability

  

  Jacob Sela

  committed
  b7c5230

  Copy full SHA for b7c5230

• warnings and more doc cleanup

  

  Jacob Sela

  committed
  0a583dd

  Copy full SHA for 0a583dd

• expanded DDP

  

  Jacob Sela

  committed
  011fec9

  Copy full SHA for 011fec9

• replaced prints with logging

  

  Jacob Sela

  committed
  ea49206

  Copy full SHA for ea49206

Commits on Jan 15, 2025

• removed redundant if

  

  Jacob Sela

  committed
  1558ad1

  Copy full SHA for 1558ad1

• renamed cache_fields to cache_field_names

  

  Jacob Sela

  committed
  6bf3639

  Copy full SHA for 6bf3639

• added distributed init function, updated docs accordingly

  

  Jacob Sela

  committed
  c03db90

  Copy full SHA for c03db90

• updated basic example

  

  Jacob Sela

  committed
  0382c80

  Copy full SHA for 0382c80

• renamed tutorial for cache_field_names

  

  Jacob Sela

  committed
  a505e87

  Copy full SHA for a505e87

• updated cache field tutorial to reflect name change

  

  Jacob Sela

  committed
  8a52fdf

  Copy full SHA for 8a52fdf

Commits on Jan 16, 2025

• updated ddp example to use distributed_init method and new cache_field_names argument

  

  Jacob Sela

  committed
  4448027

  Copy full SHA for 4448027