Commit Graph

9 Commits

Author SHA1 Message Date
a2f6647a4e Add truncate_text option to tokenize
This makes it possible to run tokenize on texts that are longer than the number of tokens
that fit the context length without having to try to guess how to cut in number of 
characters beforehand
2021-07-08 17:34:16 +02:00
8a665a683d fixed model loading issue (#66) 2021-03-23 03:05:17 -04:00
290ac5cb15 Correctly initializing the logit scale parameter
adding numpy import
2021-03-22 22:09:57 -04:00
43c953e231 Correctly initializing the logit scale parameter
cf. #46
2021-03-22 18:07:08 -04:00
fd6c1443c2 add RN101 and RN50x4; update paper URL and model card 2021-03-04 12:30:39 -05:00
4c0275784d Load model from path (#41)
* Load model from path

* showing download progress in "MiB"

* clip.load() now can take a file path

Co-authored-by: Jong Wook Kim <jongwook@openai.com>
2021-02-16 06:19:42 -05:00
8f6deb52a1 showing download progress in "MiB" 2021-02-15 22:00:33 -05:00
c42a8e3c9e added parameter initialization (fixes #15) 2021-01-30 03:26:10 +09:00
3bee28119e Make the repo installable as a package (#26) 2021-01-30 03:05:01 +09:00