10 Commits

Author	SHA1	Message	Date
Romain Beaumont	a2737ac264	Add truncate option to tokenize (#126) ... * Add truncate_text option to tokenize This makes it possible to run tokenize on texts that are longer than the number of tokens that fit the context length without having to try to guess how to cut in number of characters beforehand * add doc, rename to just "truncate", use eot_token Co-authored-by: Jong Wook Kim <jongwook@openai.com>	2021-07-18 20:17:40 -07:00
Jong Wook Kim	db20393f4a	Using non-JIT by default; compat fix with 1.8+	2021-07-18 18:45:21 -07:00
Jong Wook Kim	8a665a683d	fixed model loading issue (#66)	2021-03-23 03:05:17 -04:00
Jong Wook Kim	290ac5cb15	Correctly initializing the logit scale parameter ... adding numpy import	2021-03-22 22:09:57 -04:00
Jong Wook Kim	43c953e231	Correctly initializing the logit scale parameter ... cf. #46	2021-03-22 18:07:08 -04:00
Jong Wook Kim	fd6c1443c2	add RN101 and RN50x4; update paper URL and model card	2021-03-04 12:30:39 -05:00
Sebastian Berns	4c0275784d	Load model from path (#41) ... * Load model from path * showing download progress in "MiB" * clip.load() now can take a file path Co-authored-by: Jong Wook Kim <jongwook@openai.com>	2021-02-16 06:19:42 -05:00
Jong Wook Kim	8f6deb52a1	showing download progress in "MiB"	2021-02-15 22:00:33 -05:00
Jong Wook Kim	c42a8e3c9e	added parameter initialization (fixes #15)	2021-01-30 03:26:10 +09:00
boba_and_beer	3bee28119e	Make the repo installable as a package (#26)	2021-01-30 03:05:01 +09:00