CSharp BPE Encoder Decoder for GPT-3
GPT-3 编码器/解码器的 C# 实现
GPT-3 use byte pair encoding to turn text into a series of integers to feed into the model. This is a C# implementation of OpenAI's original encoder/decoder.
这是一个 OpenAI 原始编码器/解码器的 C# 实现
Install-Package GPT-3-Encoder-Sharp
Compatible with .Net >= 6.0
框架要求 >= .Net 6.0
Encoder encoder = Encoder.Get_Encoder();
string str = "This is an example sentence to try encoding out on!";
var encoded = encoder.Encode(str);
Console.WriteLine("encoded is: \r\n" + string.Join(',', encoded));
Console.WriteLine($"Tokens: {encoded.Count()}, Characters: {str.Length}");
Console.WriteLine("decoded is: \r\n" + encoder.Decode(encoded));
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent