Code

Add video support#430

Code

Draft

iejMac wants to merge 28 commits intomlfoundations:mainmlfoundations/open_clip:mainfrom iejMac:vivitiejMac/open_clip:vivitCopy head branch name to clipboard

Commits

Commits on Feb 15, 2023

• Add video support

  iejMac

  committed
  3ec0ed8

  Copy full SHA for 3ec0ed8

Commits on Feb 16, 2023

• Merge branch 'main' into vivit

  iejMac

  authored
  0403d1d

  Copy full SHA for 0403d1d

Commits on Feb 18, 2023

• data loading: correct shapes in training loop (crappy code)

  iejMac

  committed
  1cd33e4

  Copy full SHA for 1cd33e4

• Merge branch 'vivit' of https://github.com/iejMac/open_clip into vivit

  iejMac

  committed
  107292f

  Copy full SHA for 107292f

• update model progress

  iejMac

  committed
  b995750

  Copy full SHA for b995750

Commits on Feb 19, 2023

• rename file + create_model loads something

  iejMac

  committed
  be04c06

  Copy full SHA for be04c06

• update

  iejMac

  committed
  0ad7168

  Copy full SHA for 0ad7168

• update

  iejMac

  committed
  f9dfd02

  Copy full SHA for f9dfd02

• embeddings get to loss, time to implement video encoding

  iejMac

  committed
  df1c698

  Copy full SHA for df1c698

• update, set num_samples

  iejMac

  committed
  7643ce3

  Copy full SHA for 7643ce3

• more filling in

  iejMac

  committed
  cb12acd

  Copy full SHA for cb12acd

• slightly improved preprocessing

  iejMac

  committed
  67a2d33

  Copy full SHA for 67a2d33

• update

  iejMac

  committed
  f0615f9

  Copy full SHA for f0615f9

• update weird lag

  iejMac

  committed
  7bd848e

  Copy full SHA for 7bd848e

Commits on Feb 20, 2023

• simpler dataloader same results

  iejMac

  committed
  80f41a0

  Copy full SHA for 80f41a0

Commits on Feb 21, 2023

• properly normalize frames

  iejMac

  committed
  f5af600

  Copy full SHA for f5af600

• update no temporal

  iejMac

  committed
  982ee88

  Copy full SHA for 982ee88

Commits on Feb 26, 2023

• filter no mp4 samples

  iejMac

  committed
  3f4fde7

  Copy full SHA for 3f4fde7

• update

  iejMac

  committed
  7176d95

  Copy full SHA for 7176d95

• adding projection removes weird const loss bug but training doesn't go very well

  iejMac

  committed
  3f64b62

  Copy full SHA for 3f64b62

Commits on Feb 27, 2023

• some updates

  iejMac

  committed
  8d3cc48

  Copy full SHA for 8d3cc48

Commits on Mar 11, 2023

• save changes

  iejMac

  committed
  4230428

  Copy full SHA for 4230428

Commits on Mar 26, 2023

• update dataloader to use video2dataset

  iejMac

  committed
  9413c5e

  Copy full SHA for 9413c5e

Commits on Mar 27, 2023

• update

  iejMac

  committed
  5c65a52

  Copy full SHA for 5c65a52

Commits on Mar 28, 2023

• repeat is bad

  iejMac

  committed
  f2fa5bd

  Copy full SHA for f2fa5bd

Commits on Apr 4, 2023

• enable loading CLIP weights to spatial and text encoders

  iejMac

  committed
  3125171

  Copy full SHA for 3125171

Commits on Apr 15, 2023

• update

  iejMac

  committed
  b093a4c

  Copy full SHA for b093a4c

Commits on Jun 9, 2023

• update

  

  iejmac

  committed
  9db7425

  Copy full SHA for 9db7425