localhorst/CLIP_on_Tesla_K20Xm
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Reduce half of similarity muls after encoding

Browse Source 
(cAB)^T = c B^T A^T
Saves half of the similarity products in the CLIP model.py after the visual/text encoding stages
This commit is contained in:
or-toledano
2021-08-13 13:06:00 +03:00
committed by GitHub
parent fa56f25251
commit a8aa7cb265
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
clip/model.py
View File

@ -362,7 +362,7 @@ class CLIP(nn.Module):
# cosine similarity as logits # cosine similarity as logits
logit_scale = self.logit_scale.exp() logit_scale = self.logit_scale.exp()
logits_per_image = logit_scale * image_features @ text_features.t() logits_per_image = logit_scale * image_features @ text_features.t()
logits_per_text = logit_scale * text_features @ image_features.t() logits_per_text = logits_per_image.t()
# shape = [global_batch_size, global_batch_size] # shape = [global_batch_size, global_batch_size]
return logits_per_image, logits_per_text return logits_per_image, logits_per_text