py-tiktoken

v 0.5.2 Updated: 12 months ago

Fast BPE tokeniser for use with OpenAI's models.


https://github.com/openai/tiktoken

Installable ports:

py311-tiktoken
py312-tiktoken

Details
Add to my watchlist

Installations 0
Requested Installations 0


Quick Links:
MacPorts
Port Information was updated:
16 hours ago
45cd6a7a

Most recent build (in app's database) ran:
an hour ago

Latest stats submission was received:
28 seconds ago